Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

For individuals who are blind or have low vision, tactile maps provide essential spatial information but are limited in the amount of data they can convey. Digitally augmented tactile maps enhance these capabilities with audio feedback, thereby combining the tactile feedback provided by the map with an audio description of the touched elements. In this context, we explore an embodied interaction paradigm to augment tactile maps with conversational interaction based on Large Language Models, thus enabling users to obtain answers to arbitrary questions regarding the map. We analyze the types of questions the users are interested in asking, engineer the Large Language Model's prompt to provide reliable answers, and study the resulting system with a set of 10 participants, evaluating how the users interact with the system, its usability, and user experience.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC12392394PMC
http://dx.doi.org/10.1109/access.2025.3566286DOI Listing

Publication Analysis

Top Keywords

tactile maps
16
large language
8
tactile
5
mapio gestural
4
gestural conversational
4
conversational interface
4
interface tactile
4
maps
4
maps individuals
4
individuals blind
4

Similar Publications

For individuals who are blind or have low vision, tactile maps provide essential spatial information but are limited in the amount of data they can convey. Digitally augmented tactile maps enhance these capabilities with audio feedback, thereby combining the tactile feedback provided by the map with an audio description of the touched elements. In this context, we explore an embodied interaction paradigm to augment tactile maps with conversational interaction based on Large Language Models, thus enabling users to obtain answers to arbitrary questions regarding the map.

View Article and Find Full Text PDF

Much as the information generated by our fingertips is used for fine-scale grasping and manipulation, closed-loop dexterous robotic manipulation requires rich tactile information to be generated by artificial fingertip sensors. In particular, fingertip shear sensing dominates modalities such as twisting, dragging, and slipping, but there is limited research exploring soft shear predictions from an increasingly popular single-material tactile technology: electrical impedance tomography (EIT). Here, we focus on the twisting of a screwdriver as a representative shear-based task in which the signals generated by EIT hardware can be analyzed.

View Article and Find Full Text PDF

Utilizing tactile sensors embedded in intelligent mats is an attractive non-intrusive approach for human motion analysis. Interpreting tactile pressure 2D maps for accurate posture estimation poses significant challenges, such as dealing with data sparsity, noise interference, and the complexity of mapping pressure signals. Our approach introduces a novel dual-diffusion signal enhancement (DDSE) architecture that leverages tactile pressure measurements from an intelligent pressure mat for precise prediction of 3D body joint positions, using a diffusion model to enhance pressure data quality and a convolutional-transformer neural network architecture for accurate pose estimation.

View Article and Find Full Text PDF

A hybrid elastic-hyperelastic approach for simulating soft tactile sensors.

Front Robot AI

July 2025

Command and Robotics Laboratory, École de Technologie Supérieure, Montreal, QC, Canada.

Efficient robotic grasping increasingly relies on artificial intelligence (AI) and tactile sensing technologies, which necessitate the acquisition of substantial data-a task that can often prove challenging. Consequently, the alternative of generating tactile data through precise and efficient simulations is becoming increasingly appealing. A significant challenge for simulating tactile sensors is balancing the trade-off between accuracy and processing time in simulation algorithms and models.

View Article and Find Full Text PDF

After injury to the primary somatosensory cortex (S1), most studies have focused on perilesional remodeling and its role in functional recovery. In contrast, alterations within the contralesional cortex remain poorly understood, even though the interhemispheric communication is disrupted by the lesion. Using electrophysiological mapping, we investigated in rats the time-course of cutaneous map remodeling in the intact hemisphere following unilateral focal damage to the forepaw area in S1 along with behavioral assessment of sensorimotor deficits.

View Article and Find Full Text PDF