Large language model-driven natural language interaction control framework for single-operator bimanual teleoperation.

Bimanual teleoperation imposes cognitive and coordination demands on a single human operator tasked with simultaneously controlling two robotic arms. Although assigning each arm to a separate operator can distribute workload, it often leads to ambiguities in decision authority and degrades overall efficiency. To overcome these challenges, we propose a novel bimanual teleoperation large language model assistant (BTLA) framework, an intelligent co-pilot that augments a single operator's motor control capabilities.

A fully autonomous robotic ultrasound system for thyroid scanning.

The current thyroid ultrasound relies heavily on the experience and skills of the sonographer and the expertise of the radiologist, and the process is physically and cognitively exhausting. In this paper, we report a fully autonomous robotic ultrasound system, which is able to scan thyroid regions without human assistance and identify malignant nod- ules. In this system, human skeleton point recognition, reinforcement learning, and force feedback are used to deal with the difficulties in locating thyroid targets.

A Product Fuzzy Convolutional Network for Detecting Driving Fatigue.

Existing driving fatigue detection methods rarely consider how to effectively fuse the advantages of the electroencephalogram (EEG) and electrocardiogram (ECG) signals to enhance detection performance under noise conditions. To address the issues, this article proposes a new type of the deep learning (DL) framework based on EEG and ECG called the product fuzzy convolutional network (PFCN). It should be noted that this article first investigates how to fuse EEG and ECG signals to deal with driving fatigue detection under noise conditions in both simulated and real-field driving environments.

Active Collision Avoidance for Human-Robot Interaction With UKF, Expert System, and Artificial Potential Field Method.

With the development of Industry 4.0, the cooperation between robots and people is increasing. Therefore, man-machine security is the first problem that must be solved.

Human-manipulator interface using particle filter.

This paper utilizes a human-robot interface system which incorporates particle filter (PF) and adaptive multispace transformation (AMT) to track the pose of the human hand for controlling the robot manipulator. This system employs a 3D camera (Kinect) to determine the orientation and the translation of the human hand. We use Camshift algorithm to track the hand.

A novel flexible virtual fixtures for teleoperation.

This paper proposed a novel spatial-motion-constraints virtual fixtures (VFs) method for the human-machine interface collaborative technique. In our method, two 3D flexible VFs have been presented: warning pipe and safe pipe. And a potential-collision-detection method based on two flexible VFs has been proposed.

IMU-based online kinematic calibration of robot manipulator.

Robot calibration is a useful diagnostic method for improving the positioning accuracy in robot production and maintenance. An online robot self-calibration method based on inertial measurement unit (IMU) is presented in this paper. The method requires that the IMU is rigidly attached to the robot manipulator, which makes it possible to obtain the orientation of the manipulator with the orientation of the IMU in real time.