Article Synopsis

  • Estimating animal pose in computer vision is tricky due to occlusions and the high similarity between animals, making it hard to identify individual animals during interactions.
  • We enhance DeepLabCut, an existing pose estimation tool, by adding features for tracking multiple animals and predicting their identities, which helps during occlusions.
  • Our framework is tested on four diverse datasets that we are releasing to support future research in this area.

Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Estimating the pose of multiple animals is a challenging computer vision problem: frequent interactions cause occlusions and complicate the association of detected keypoints to the correct individuals, as well as having highly similar looking animals that interact more closely than in typical multi-human scenarios. To take up this challenge, we build on DeepLabCut, an open-source pose estimation toolbox, and provide high-performance animal assembly and tracking-features required for multi-animal scenarios. Furthermore, we integrate the ability to predict an animal's identity to assist tracking (in case of occlusions). We illustrate the power of this framework with four datasets varying in complexity, which we release to serve as a benchmark for future algorithm development.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9007739PMC
http://dx.doi.org/10.1038/s41592-022-01443-0DOI Listing

Publication Analysis

Top Keywords

pose estimation
8
multi-animal pose
4
estimation identification
4
identification tracking
4
tracking deeplabcut
4
deeplabcut estimating
4
estimating pose
4
pose multiple
4
multiple animals
4
animals challenging
4

Similar Publications

Background: Median arcuate ligament release (MALR) surgery is the most common procedure used to treat median arcuate ligament syndrome (MALS). Estimates of the success rate of this surgery range from 70-80%. Factors that affect the success of this procedure are not well understood.

View Article and Find Full Text PDF

Polar protic and aprotic solvents can effectively simulate the maturation of breast carcinoma cells. Herein, the influence of polar protic solvents (water and ethanol) and aprotic solvents (acetone and DMSO) on the properties of 3-(dimethylaminomethyl)-5-nitroindole (DAMNI) was investigated using density functional theory (DFT) computations. Thermodynamic parameters retrieved from the vibrational analysis indicated that the DAMNI's entropy, heat capacity, and enthalpy increased with rising temperature.

View Article and Find Full Text PDF

A single-laboratory ultra-performance liquid chromatography-mass spectrometry method was developed and validated for the estimation of tetraniliprole, BCS CQ 63359, spirotetramat and its metabolites from chilli and brinjal (commonly known as eggplant, aubergine or guinea squash) samples for assessing the dissipation kinetics and dietary risk assessment of field-applied tetraniliprole and spirotetramat. The control samples of brinjal and chilli fortified with tetraniliprole, spirotetramat and their metabolites at three levels of 0.01, 0.

View Article and Find Full Text PDF

Transformers have been successfully applied in the field of video-based 3D human pose estimation. However, the high computational costs of these video pose transformers (VPTs) make them impractical on resource-constrained devices. In this paper, we present a hierarchical plug-and-play pruning-and-recovering framework, called Hierarchical Hourglass Tokenizer (HOT), for efficient transformer-based 3D human pose estimation from videos.

View Article and Find Full Text PDF

Background: Pelvic and acetabular fractures, often resulting from high-impact trauma, pose significant challenges due to extensive blood loss and complex surgical procedures. Tranexamic acid (TXA), widely used in elective orthopedic surgeries, offers a potential strategy for managing blood loss. However, its efficacy and safety in pelvic-acetabular trauma surgeries have shown inconsistent results in prior studies.

View Article and Find Full Text PDF