A Novel Method for Monocular Depth Estimation Using an Hourglass Neck Module.

Sensors (Basel)

Department of Electronic Engineering, Hanbat National University, 125, Dongseo-daero, Yuseong-gu, Daejeon 34158, Republic of Korea.

Published: February 2024


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

In this paper, we propose a novel method for monocular depth estimation using the hourglass neck module. The proposed method has the following originality. First, feature maps are extracted from Swin Transformer V2 using a masked image modeling (MIM) pretrained model. Since Swin Transformer V2 has a different patch size for each attention stage, it is easier to extract local and global features from images input by the vision transformer (ViT)-based encoder. Second, to maintain the polymorphism and local inductive bias of the feature map extracted from Swin Transformer V2, a feature map is input into the hourglass neck module. Third, deformable attention can be used at the waist of the hourglass neck module to reduce the computation cost and highlight the locality of the feature map. Finally, the feature map traverses the neck and proceeds through a decoder, comprised of a deconvolution layer and an upsampling layer, to generate a depth image. To evaluate the objective reliability of the proposed method in this paper, we used the NYU Depth V2 dataset to compare and evaluate the methods published in other papers. As a result of the experiment, the RMSE value of the novel method for monocular depth estimation using the hourglass neck module proposed in this paper was 0.274, which was lower than those published in other papers. The lower the RMSE value, the better the depth estimation method; therefore, its efficiency compared to other techniques has been proven.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10892898PMC
http://dx.doi.org/10.3390/s24041312DOI Listing

Publication Analysis

Top Keywords

hourglass neck
20
neck module
20
depth estimation
16
feature map
16
novel method
12
method monocular
12
monocular depth
12
estimation hourglass
12
swin transformer
12
module proposed
8

Similar Publications

Article Synopsis
  • - Neuralgic amyotrophy (NA) is a rare condition characterized by sudden shoulder pain followed by weakness in the arm, primarily affecting the upper brachial plexus, and can often mimic cervical radiculopathy due to its similar symptoms.
  • - A 76-year-old male developed NA after hip surgery, experiencing shoulder pain and arm weakness; diagnostic imaging confirmed brachial plexopathy and unique signs of NA including a focal constriction at the suprascapular nerve.
  • - Treatment for NA involved corticosteroids and physical therapy, leading to significant recovery in shoulder muscle strength within a month, highlighting the importance of recognizing NA's distinct features for accurate diagnosis.
View Article and Find Full Text PDF

Junctions between the endoplasmic reticulum (ER) and the outer membrane of the nuclear envelope (NE) physically connect both organelles. These ER-NE junctions are essential for supplying the NE with lipids and proteins synthesized in the ER. However, little is known about the structure of these ER-NE junctions.

View Article and Find Full Text PDF

Insights into the function and regulation of the calcium-activated chloride channel TMEM16A.

Cell Calcium

July 2024

Department of Physiology and Biophysics, School of Medicine, Universidad Autónoma de San Luis Potosí. Ave. V. Carranza 2905, Los Filtros, San Luis Potosí, SLP 78210, Mexico.

The TMEM16A channel, a member of the TMEM16 protein family comprising chloride (Cl) channels and lipid scramblases, is activated by the free intracellular Ca increments produced by inositol 1,4,5-trisphosphate (IP3)-induced Ca release after GqPCRs or Ca entry through cationic channels. It is a ubiquitous transmembrane protein that participates in multiple physiological functions essential to mammals' lives. TMEM16A structure contains two identical 10-segment monomers joined at their transmembrane segment 10.

View Article and Find Full Text PDF

The septin cytoskeleton is extensively regulated by posttranslational modifications, such as phosphorylation, to achieve the diversity of architectures including rings, hourglasses, and gauzes. While many of the phosphorylation events of septins have been extensively studied in the budding yeast Saccharomyces cerevisiae, the regulation of the kinases involved remains poorly understood. Here, we show that two septin-associated kinases, the LKB1/PAR-4-related kinase Elm1 and the Nim1/PAR-1-related kinase Gin4, regulate each other at two discrete points of the cell cycle.

View Article and Find Full Text PDF

A Novel Method for Monocular Depth Estimation Using an Hourglass Neck Module.

Sensors (Basel)

February 2024

Department of Electronic Engineering, Hanbat National University, 125, Dongseo-daero, Yuseong-gu, Daejeon 34158, Republic of Korea.

In this paper, we propose a novel method for monocular depth estimation using the hourglass neck module. The proposed method has the following originality. First, feature maps are extracted from Swin Transformer V2 using a masked image modeling (MIM) pretrained model.

View Article and Find Full Text PDF