98%
921
2 minutes
20
For individuals who are blind or have low vision, tactile maps provide essential spatial information but are limited in the amount of data they can convey. Digitally augmented tactile maps enhance these capabilities with audio feedback, thereby combining the tactile feedback provided by the map with an audio description of the touched elements. In this context, we explore an embodied interaction paradigm to augment tactile maps with conversational interaction based on Large Language Models, thus enabling users to obtain answers to arbitrary questions regarding the map. We analyze the types of questions the users are interested in asking, engineer the Large Language Model's prompt to provide reliable answers, and study the resulting system with a set of 10 participants, evaluating how the users interact with the system, its usability, and user experience.
Download full-text PDF |
Source |
---|---|
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC12392394 | PMC |
http://dx.doi.org/10.1109/access.2025.3566286 | DOI Listing |
IEEE Access
May 2025
The Smith-Kettlewell Eye Research Institute, San Francisco, CA 94115, USA.
For individuals who are blind or have low vision, tactile maps provide essential spatial information but are limited in the amount of data they can convey. Digitally augmented tactile maps enhance these capabilities with audio feedback, thereby combining the tactile feedback provided by the map with an audio description of the touched elements. In this context, we explore an embodied interaction paradigm to augment tactile maps with conversational interaction based on Large Language Models, thus enabling users to obtain answers to arbitrary questions regarding the map.
View Article and Find Full Text PDFSensors (Basel)
August 2025
Bio-Inspired Robotics Laboratory, University of Cambridge, Cambridge CB2 1PZ, UK.
Much as the information generated by our fingertips is used for fine-scale grasping and manipulation, closed-loop dexterous robotic manipulation requires rich tactile information to be generated by artificial fingertip sensors. In particular, fingertip shear sensing dominates modalities such as twisting, dragging, and slipping, but there is limited research exploring soft shear predictions from an increasingly popular single-material tactile technology: electrical impedance tomography (EIT). Here, we focus on the twisting of a screwdriver as a representative shear-based task in which the signals generated by EIT hardware can be analyzed.
View Article and Find Full Text PDFSensors (Basel)
August 2025
School of Computer Science and Mathematics, Kingston University, London KT1 2EE, UK.
Utilizing tactile sensors embedded in intelligent mats is an attractive non-intrusive approach for human motion analysis. Interpreting tactile pressure 2D maps for accurate posture estimation poses significant challenges, such as dealing with data sparsity, noise interference, and the complexity of mapping pressure signals. Our approach introduces a novel dual-diffusion signal enhancement (DDSE) architecture that leverages tactile pressure measurements from an intelligent pressure mat for precise prediction of 3D body joint positions, using a diffusion model to enhance pressure data quality and a convolutional-transformer neural network architecture for accurate pose estimation.
View Article and Find Full Text PDFFront Robot AI
July 2025
Command and Robotics Laboratory, École de Technologie Supérieure, Montreal, QC, Canada.
Efficient robotic grasping increasingly relies on artificial intelligence (AI) and tactile sensing technologies, which necessitate the acquisition of substantial data-a task that can often prove challenging. Consequently, the alternative of generating tactile data through precise and efficient simulations is becoming increasingly appealing. A significant challenge for simulating tactile sensors is balancing the trade-off between accuracy and processing time in simulation algorithms and models.
View Article and Find Full Text PDFNeurobiol Dis
October 2025
Aix-Marseille University - CNRS, Center for Research in Psychology and Neuroscience (CRPN), UMR 7077, Marseille, France. Electronic address:
After injury to the primary somatosensory cortex (S1), most studies have focused on perilesional remodeling and its role in functional recovery. In contrast, alterations within the contralesional cortex remain poorly understood, even though the interhemispheric communication is disrupted by the lesion. Using electrophysiological mapping, we investigated in rats the time-course of cutaneous map remodeling in the intact hemisphere following unilateral focal damage to the forepaw area in S1 along with behavioral assessment of sensorimotor deficits.
View Article and Find Full Text PDF