A Model of Multi-Finger Coordination in Keystroke Movement.

Sensors (Basel)

Key Laboratory of Mechanism Theory and Equipment Design, Ministry of Education, Tianjin University, Tianjin 300350, China.

Published: February 2024


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

In multi-finger coordinated keystroke actions by professional pianists, movements are precisely regulated by multiple motor neural centers, exhibiting a certain degree of coordination in finger motions. This coordination enhances the flexibility and efficiency of professional pianists' keystrokes. Research on the coordination of keystrokes in professional pianists is of great significance for guiding the movements of piano beginners and the motion planning of exoskeleton robots, among other fields. Currently, research on the coordination of multi-finger piano keystroke actions is still in its infancy. Scholars primarily focus on phenomenological analysis and theoretical description, which lack accurate and practical modeling methods. Considering that the tendon of the ring finger is closely connected to adjacent fingers, resulting in limited flexibility in its movement, this study concentrates on coordinated keystrokes involving the middle and ring fingers. A motion measurement platform is constructed, and Leap Motion is used to collect data from 12 professional pianists. A universal model applicable to multiple individuals for multi-finger coordination in keystroke actions based on the backpropagation (BP) neural network is proposed, which is optimized using a genetic algorithm (GA) and a sparrow search algorithm (SSA). The angular rotation of the ring finger's MCP joint is selected as the model output, while the individual difference information and the angular data of the middle finger's MCP joint serve as inputs. The individual difference information used in this study includes ring finger length, middle finger length, and years of piano training. The results indicate that the proposed SSA-BP neural network-based model demonstrates superior predictive accuracy, with a root mean square error of 4.8328°. Based on this model, the keystroke motion of the ring finger's MCP joint can be accurately predicted from the middle finger's keystroke motion information, offering an evaluative method and scientific guidance for the training of multi-finger coordinated keystrokes in piano learners.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10892657PMC
http://dx.doi.org/10.3390/s24041221DOI Listing

Publication Analysis

Top Keywords

keystroke actions
12
professional pianists
12
finger's mcp
12
mcp joint
12
multi-finger coordination
8
coordination keystroke
8
multi-finger coordinated
8
ring finger
8
coordinated keystrokes
8
ring finger's
8

Similar Publications

"Motor fluency" refers to the ease with which an action can be performed and several studies have shown how it can modulate various cognitive processes, such as memory and decision making. To investigate these implications of motor fluency, typing-based paradigms have been proven to be useful. In this literature, based on pioneering works that analysed inter-keystroke intervals (IKIs, the time that elapses between two keystrokes), several studies have assumed that letter dyads typed with different hands are more fluent than dyads typed with the same hand.

View Article and Find Full Text PDF

Background: Cognitive dysfunction in bipolar disorder persists in the euthymic state and has been shown to be associated with a number of negative sequelae including treatment resistance and increased risk of relapse. There has been recent attention on digital phenotyping and passive sensing through smart, connected devices to probe cognition in real-world settings. BiAffect is a custom-built smartphone keyboard that captures keystroke metadata ('how you type, not what you type').

View Article and Find Full Text PDF

Neurotechnological interfaces have the potential to create new forms of human-machine interactions, by allowing devices to interact directly with neurological signals instead of via intermediates such as keystrokes. Surface electromyography (sEMG) has been used extensively in myoelectric control systems, which use bioelectric activity recorded from muscles during contractions to classify actions. This technology has been used primarily for rehabilitation applications.

View Article and Find Full Text PDF

Temporal binding describes an illusory compression of time between voluntary actions and their effects. In two experiments, using stable, preexisting action-effect associations, we investigated whether motor identity prediction (prediction of the effect's identity) enhances temporal binding. Touch-typists performed keystrokes and were presented with congruent (corresponding letter) or incongruent (noncorresponding letter) effects after different intervals.

View Article and Find Full Text PDF

Accelerating text input in augmentative and alternative communication (AAC) is a long-standing area of research with bearings on the quality of life in individuals with profound motor impairments. Recent advances in large language models (LLMs) pose opportunities for re-thinking strategies for enhanced text entry in AAC. In this paper, we present SpeakFaster, consisting of an LLM-powered user interface for text entry in a highly-abbreviated form, saving 57% more motor actions than traditional predictive keyboards in offline simulation.

View Article and Find Full Text PDF