A Time Sequence Images Matching Method Based on the Siamese Network.

Sensors (Basel)

Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan 430081, China.

Published: September 2021


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

The similar analysis of time sequence images to achieve image matching is a foundation of tasks in dynamic environments, such as multi-object tracking and dynamic gesture recognition. Therefore, we propose a matching method of time sequence images based on the Siamese network. Inspired by comparative learning, two different comparative parts are designed and embedded in the network. The first part makes a comparison between the input image pairs to generate the correlation matrix. The second part compares the correlation matrix, which is the output of the first comparison part, with a template, in order to calculate the similarity. The improved loss function is used to constrain the image matching and similarity calculation. After experimental verification, we found that it not only performs better, but also has some ability to estimate the camera pose.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8433774PMC
http://dx.doi.org/10.3390/s21175900DOI Listing

Publication Analysis

Top Keywords

time sequence
12
sequence images
12
matching method
8
based siamese
8
siamese network
8
image matching
8
correlation matrix
8
matching
4
images matching
4
method based
4

Similar Publications

The ability of parasitoid wasps to precisely locate hosts in complex environments is a key factor in suppressing pest populations. Chemical communication plays an essential role in mediating insect behaviors such as locating food sources, hosts, and mates. Odorant receptors (ORs) are the key connection between external odors and olfactory nerves.

View Article and Find Full Text PDF

Background: Tecovirimat (TPOXX) is an antiviral authorized for the treatment of mpox infections in Canada, but recent clinical trials found it has no impact on symptom duration.

Methods: We conducted a prospective cohort study of individuals diagnosed with mpox in Toronto, Canada. Skin lesion swabs were collected weekly to quantify infectious monkeypox virus (MPXV) shedding through cell culture.

View Article and Find Full Text PDF

BackgroundThe production of verbal tenses is impaired in people with Alzheimer's disease (AD), as shown by several studies focusing on time reference and using sentence completion tasks. However, there is currently a limited understanding of how tense is produced in discourse with this disease. Discourse is interesting as it involves building a mental representation of the event to be narrated with its temporal framework and translating this framework into language using tense.

View Article and Find Full Text PDF

Knowledge tracing can reveal students' level of knowledge in relation to their learning performance. Recently, plenty of machine learning algorithms have been proposed to exploit to implement knowledge tracing and have achieved promising outcomes. However, most of the previous approaches were unable to cope with long sequence time-series prediction, which is more valuable than short sequence prediction that is extensively utilized in current knowledge-tracing studies.

View Article and Find Full Text PDF

Transposition is a well-known genome rearrangement event that switches two consecutive sub-strings on a string. Since a transposition makes changes to a string, the genome here is just a string. The problem of transforming one string into the other by a sequence of transposition operations has attracted a lot of attention.

View Article and Find Full Text PDF