Robot System Assistant (RoSA): evaluation of touch and speech input modalities for on-site HRI and telerobotics.

Front Robot AI

Neuro-Information Technology Group, Faculty of Electrical Engineering and Information Technology, Otto-von-Guericke-University, Magdeburg, Germany.

Published: July 2025


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Future work scenarios envision increased collaboration between humans and robots, emphasizing the need for versatile interaction modalities. Robotic systems can support various use cases, including on-site operations and telerobotics. This study investigates a hybrid interaction model in which a single user engages with the same robot both on-site and remotely. Specifically, the Robot System Assistant (RoSA) framework is evaluated to assess the effectiveness of touch and speech input modalities in these contexts. The participants interact with two robots, and , utilizing both input modalities. The results reveal that touch input excels in precision and task efficiency, while speech input is preferred for its intuitive and natural interaction flow. These findings contribute to understanding the complementary roles of touch and speech in hybrid systems and their potential for future telerobotic applications.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC12343565PMC
http://dx.doi.org/10.3389/frobt.2025.1561188DOI Listing

Publication Analysis

Top Keywords

touch speech
12
speech input
12
input modalities
12
robot system
8
system assistant
8
assistant rosa
8
input
5
rosa evaluation
4
touch
4
evaluation touch
4

Similar Publications

Tactile stimulations reduce or promote the segregation of auditory streams: psychophysics and modeling.

PLoS Comput Biol

August 2025

Department of Mathematics and Statistics, Faculty of Environment, Science and Economy, University of Exeter, Exeter, United Kingdom.

Auditory stream segregation plays a crucial role in understanding the auditory scene. This study investigates the role of tactile stimulation in auditory stream segregation through psychophysics experiments and a computational model of audio-tactile interactions. We examine how tactile pulses, synchronized with one group of tones (high- or low-frequency tones) in a sequence of interleaved high- and low-frequency tones (ABA- triplets), influence the likelihood of perceiving integrated or segregated auditory streams.

View Article and Find Full Text PDF

Robot System Assistant (RoSA): evaluation of touch and speech input modalities for on-site HRI and telerobotics.

Front Robot AI

July 2025

Neuro-Information Technology Group, Faculty of Electrical Engineering and Information Technology, Otto-von-Guericke-University, Magdeburg, Germany.

Future work scenarios envision increased collaboration between humans and robots, emphasizing the need for versatile interaction modalities. Robotic systems can support various use cases, including on-site operations and telerobotics. This study investigates a hybrid interaction model in which a single user engages with the same robot both on-site and remotely.

View Article and Find Full Text PDF

Multisensory integration plays a central role in shaping perceptual experience, but how such processes develop in the absence of vision remains unclear. Previous work has shown that sighted individuals integrate tactile air-puff cues with auditory speech signals, even in the absence of linguistic experience linking the two modalities. This study asked whether congenitally blind individuals form similar perceptual associations.

View Article and Find Full Text PDF

This study explores how physical contact is used in parent-infant dyads from 9 to 12 months of age, focusing on the role of touch and the use of objects in supporting language development. Thirty-five monolingual Spanish-speaking dyads were observed longitudinally in a free play situation. We analyzed physical contact, considering who initiated the contact, its function, the use of objects and the coordination with speech.

View Article and Find Full Text PDF

Purpose: Mounting research supports the use of motor-based intervention (e.g., Dynamic Temporal and Tactile Cueing [DTTC]) for children with childhood apraxia of speech (CAS), but large randomized controlled trials (RCTs) are needed to better understand optimal treatment conditions.

View Article and Find Full Text PDF