A Model of Multi-Finger Coordination in Keystroke Movement

Overview

Journal Sensors (Basel)

Publisher MDPI

Specialty Biotechnology

Date 2024 Feb 24

PMID 38400379

Authors

Jialuo Lin

Baihui Ding

Zilong Song

Zheng Li

Shengchao Li

Affiliations

Soon will be listed here.

Abstract

In multi-finger coordinated keystroke actions by professional pianists, movements are precisely regulated by multiple motor neural centers, exhibiting a certain degree of coordination in finger motions. This coordination enhances the flexibility and efficiency of professional pianists' keystrokes. Research on the coordination of keystrokes in professional pianists is of great significance for guiding the movements of piano beginners and the motion planning of exoskeleton robots, among other fields. Currently, research on the coordination of multi-finger piano keystroke actions is still in its infancy. Scholars primarily focus on phenomenological analysis and theoretical description, which lack accurate and practical modeling methods. Considering that the tendon of the ring finger is closely connected to adjacent fingers, resulting in limited flexibility in its movement, this study concentrates on coordinated keystrokes involving the middle and ring fingers. A motion measurement platform is constructed, and Leap Motion is used to collect data from 12 professional pianists. A universal model applicable to multiple individuals for multi-finger coordination in keystroke actions based on the backpropagation (BP) neural network is proposed, which is optimized using a genetic algorithm (GA) and a sparrow search algorithm (SSA). The angular rotation of the ring finger's MCP joint is selected as the model output, while the individual difference information and the angular data of the middle finger's MCP joint serve as inputs. The individual difference information used in this study includes ring finger length, middle finger length, and years of piano training. The results indicate that the proposed SSA-BP neural network-based model demonstrates superior predictive accuracy, with a root mean square error of 4.8328°. Based on this model, the keystroke motion of the ring finger's MCP joint can be accurately predicted from the middle finger's keystroke motion information, offering an evaluative method and scientific guidance for the training of multi-finger coordinated keystrokes in piano learners.

References

Chen P, Antonelli M . Conceptual Models of Food Choice: Influential Factors Related to Foods, Individual Differences, and Society. Foods. 2020; 9(12). PMC: 7766596. DOI: 10.3390/foods9121898. View

Furuya S, Goda T, Katayose H, Miwa H, Nagata N . Distinct Inter-Joint Coordination during Fast Alternate Keystrokes in Pianists with Superior Skill. Front Hum Neurosci. 2011; 5:50. PMC: 3107480. DOI: 10.3389/fnhum.2011.00050. View

Zhang S, Chen S, Jiang H . A back propagation neural network model for accurately predicting the removal efficiency of ammonia nitrogen in wastewater treatment plants using different biological processes. Water Res. 2022; 222:118908. DOI: 10.1016/j.watres.2022.118908. View

Bird J, Ekart A, Faria D . British Sign Language Recognition via Late Fusion of Computer Vision and Leap Motion with Transfer Learning to American Sign Language. Sensors (Basel). 2020; 20(18). PMC: 7571093. DOI: 10.3390/s20185151. View

Pereira J, Dubreuil D, Devlin A, Held A, Sapir Y, Berezovski E . Human sensorimotor organoids derived from healthy and amyotrophic lateral sclerosis stem cells form neuromuscular junctions. Nat Commun. 2021; 12(1):4744. PMC: 8346474. DOI: 10.1038/s41467-021-24776-4. View

Furuya S, Altenmuller E . Flexibility of movement organization in piano performance. Front Hum Neurosci. 2013; 7:173. PMC: 3712142. DOI: 10.3389/fnhum.2013.00173. View

Bella S, Palmer C . Rate effects on timing, key velocity, and finger kinematics in piano performance. PLoS One. 2011; 6(6):e20518. PMC: 3121738. DOI: 10.1371/journal.pone.0020518. View

Khwaounjoo P, Singh G, Grenfell S, Ozsoy B, MacAskill M, Anderson T . Non-Contact Hand Movement Analysis for Optimal Configuration of Smart Sensors to Capture Parkinson's Disease Hand Tremor. Sensors (Basel). 2022; 22(12). PMC: 9230824. DOI: 10.3390/s22124613. View

Kong X, Kong R, Orban C, Wang P, Zhang S, Anderson K . Sensory-motor cortices shape functional connectivity dynamics in the human brain. Nat Commun. 2021; 12(1):6373. PMC: 8568904. DOI: 10.1038/s41467-021-26704-y. View

10.

Wang H, Nonaka T, Abdulali A, Iida F . Coordinating upper limbs for octave playing on the piano via neuro-musculoskeletal modeling. Bioinspir Biomim. 2023; 18(6). DOI: 10.1088/1748-3190/acfa51. View

11.

Inouye J, Valero-Cuevas F . Muscle Synergies Heavily Influence the Neural Control of Arm Endpoint Stiffness and Energy Consumption. PLoS Comput Biol. 2016; 12(2):e1004737. PMC: 4750997. DOI: 10.1371/journal.pcbi.1004737. View

12.

Sobinov A, Bensmaia S . The neural mechanisms of manual dexterity. Nat Rev Neurosci. 2021; 22(12):741-757. PMC: 9169115. DOI: 10.1038/s41583-021-00528-7. View

13.

Furuya S, Flanders M, Soechting J . Hand kinematics of piano playing. J Neurophysiol. 2011; 106(6):2849-64. PMC: 3234081. DOI: 10.1152/jn.00378.2011. View

14.

Shafti A, Haar S, Mio R, Guilleminot P, Faisal A . Playing the piano with a robotic third thumb: assessing constraints of human augmentation. Sci Rep. 2021; 11(1):21375. PMC: 8560761. DOI: 10.1038/s41598-021-00376-6. View

15.

Lyu J, Shi H, Zhang J, Norvilitis J . Prediction model for suicide based on back propagation neural network and multilayer perceptron. Front Neuroinform. 2022; 16:961588. PMC: 9435582. DOI: 10.3389/fninf.2022.961588. View

16.

Lampe R, Thienel A, Mitternacht J, Blumenstein T, Turova V, Alves-Pinto A . Piano training in youths with hand motor impairments after damage to the developing brain. Neuropsychiatr Dis Treat. 2015; 11:1929-38. PMC: 4529264. DOI: 10.2147/NDT.S84090. View

17.

Xu L, Wang M, Trenga A, Grindel S, Daley R . The Ideal Insertion Site for the Flexor Digitorum Profundus Tendon in Jersey Finger Repair: A Biomechanical Analysis. J Hand Surg Am. 2020; 46(5):426.e1-426.e6. DOI: 10.1016/j.jhsa.2020.10.018. View

18.

Furuya S, Soechting J . Speed invariance of independent control of finger movements in pianists. J Neurophysiol. 2012; 108(7):2060-8. PMC: 3545004. DOI: 10.1152/jn.00378.2012. View

19.

Bressler S, Kelso J . Coordination Dynamics in Cognitive Neuroscience. Front Neurosci. 2016; 10:397. PMC: 5023665. DOI: 10.3389/fnins.2016.00397. View

20.

Park Y, Bae J . A Three-dimensional Finger Motion Measurement System of a Thumb and an Index Finger Without a Calibration Process. Sensors (Basel). 2020; 20(3). PMC: 7038521. DOI: 10.3390/s20030756. View