Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

In this study, we introduce a novel shared-control system for key-hole docking operations, combining a commercial camera with occlusion-robust pose estimation and a hand-eye information fusion technique. This system is used to enhance docking precision and force-compliance safety. To train a hand-eye information fusion network model, we generated a self-supervised dataset using this docking system. After training, our pose estimation method showed improved accuracy compared to traditional methods, including observation-only approaches, hand-eye calibration, and conventional state estimation filters. In real-world phantom experiments, our approach demonstrated its effectiveness with reduced position dispersion (1.23 $\pm$ 0.81 mm vs. 2.47 $\pm$ 1.22 mm) and force dispersion (0.78 $\pm$ 0.57 N vs. 1.15 $\pm$ 0.97 N) compared to the control group. These advancements in semi-autonomy co-manipulation scenarios enhance interaction and stability. The study presents an anti-interference, steady, and precise solution with potential applications extending beyond laparoscopic surgery to other minimally invasive procedures.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TBME.2025.3550974DOI Listing

Publication Analysis

Top Keywords

hand-eye fusion
12
pose estimation
8
semi-autonomous laparoscopic
4
laparoscopic robot
4
docking
4
robot docking
4
docking learned
4
hand-eye
4
learned hand-eye
4
fusion study
4

Similar Publications

Tracking forearm movement via measured physiological signals is crucial for understanding human motor control mechanism. Current methods mainly use muscle-derived signals to predict arm movements while often overlooking the potential role of gaze attention, which is important for hand-eye coordination and instant and continuous motion planning and execution. In this study, we explored the impact of gaze on motion tracking.

View Article and Find Full Text PDF

A novel spatial-temporal image fusion method for augmented reality-based endoscopic surgery.

Med Image Anal

July 2025

Institute of Biomedical Manufacturing and Life Quality Engineering, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200241, China; Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200241, China. Electronic address:

Augmented reality (AR) has significant potential to enhance the identification of critical locations during endoscopic surgeries, where accurate endoscope calibration is essential for ensuring the quality of augmented images. In optical-based surgical navigation systems, asynchrony between the optical tracker and the endoscope can cause the augmented scene to diverge from reality during rapid movements, potentially misleading the surgeon-a challenge that remains unresolved. In this paper, we propose a novel spatial-temporal endoscope calibration method that simultaneously determines the spatial transformation from the image to the optical marker and the temporal latency between the tracking and image acquisition systems.

View Article and Find Full Text PDF

In this study, we introduce a novel shared-control system for key-hole docking operations, combining a commercial camera with occlusion-robust pose estimation and a hand-eye information fusion technique. This system is used to enhance docking precision and force-compliance safety. To train a hand-eye information fusion network model, we generated a self-supervised dataset using this docking system.

View Article and Find Full Text PDF
Article Synopsis
  • Point clouds are precise measurement results used in various applications due to their accuracy, density, and minimal environmental impact.
  • To improve measurements of large components, it’s important to globalize small local point clouds, and this paper proposes using an indoor Global Positioning System (iGPS) for high-accuracy globalization.
  • Two calibration models are presented, both demonstrating minimal average calibration errors (0.12 mm and 0.17 mm), showing that the method maintains precision over a large spatial range useful in engineering contexts.
View Article and Find Full Text PDF

Background: Endoscope retrograde cholangiopancreatography is a standard surgical treatment for gallbladder and pancreatic diseases. However, surgeons is at high risk and require sufficient surgical experience and skills.

Methods: (1) The simultaneous localisation and mapping technique to reconstruct the surgical environment.

View Article and Find Full Text PDF