» Articles » PMID: 35330594

Motion Fatigue State Detection Based on Neural Networks

Overview
Specialty Biology
Date 2022 Mar 25
PMID 35330594
Authors
Affiliations
Soon will be listed here.
Abstract

Aiming at the problem of fatigue state detection at the back of sports, a cascade deep learning detection system structure is designed, and a convolutional neural network fatigue state detection model based on multiscale pooling is proposed. Firstly, face detection is carried out by a deep learning model MTCNN to extract eye and mouth regions. Aiming at the problem of eye and mouth state representation and recognition, a multiscale pooling model (MSP) based on RESNET  is proposed to train the eye and mouth state. In real-time detection, the state of the eye and mouth region is recognized through the trained convolution neural network model. Finally, the athlete's fatigue is determined based on PERCLOS and the proposed mouth opening and closing frequency (FOM). The experimental results show that in the training process, we set the batch_size = 100 and the initial learning rate = 0.01. When the evaluation index is no longer improved, the learning rate is reduced by 10 times to 0.001, and a total of 50 epochs are trained. The precision and recall of the system are high. Compared with the infrared image simulating the night state, the RGB image taken by the ordinary camera in the daytime has higher precision and recall. It is proven that the neural network has high detection accuracy, meets the real-time requirements, and has high robustness in complex environments.

References
1.
Han C, Xu G, Xie J, Chen C, Zhang S . Highly Interactive Brain-Computer Interface Based on Flicker-Free Steady-State Motion Visual Evoked Potential. Sci Rep. 2018; 8(1):5835. PMC: 5895715. DOI: 10.1038/s41598-018-24008-8. View

2.
Franchini E, Takito M, Alves E, Shiroma S, Julio U, Humberstone C . Effects of Different Fatigue Levels on Physiological Responses and Pacing in Judo Matches. J Strength Cond Res. 2019; 33(3):783-792. DOI: 10.1519/JSC.0000000000003006. View

3.
Yan W, Xu G, Li M, Xie J, Han C, Zhang S . Steady-State Motion Visual Evoked Potential (SSMVEP) Based on Equal Luminance Colored Enhancement. PLoS One. 2017; 12(1):e0169642. PMC: 5218567. DOI: 10.1371/journal.pone.0169642. View

4.
Chai X, Zhang Z, Guan K, Zhang T, Xu J, Niu H . Effects of fatigue on steady state motion visual evoked potentials: Optimised stimulus parameters for a zoom motion-based brain-computer interface. Comput Methods Programs Biomed. 2020; 196:105650. DOI: 10.1016/j.cmpb.2020.105650. View

5.
Xie J, Xu G, Wang J, Li M, Han C, Jia Y . Effects of Mental Load and Fatigue on Steady-State Evoked Potential Based Brain Computer Interface Tasks: A Comparison of Periodic Flickering and Motion-Reversal Based Visual Attention. PLoS One. 2016; 11(9):e0163426. PMC: 5033480. DOI: 10.1371/journal.pone.0163426. View