Detection of Sitting Posture Using Hierarchical Image Composition and Deep Learning

Overview

Journal PeerJ Comput Sci

Date 2021 Apr 9

PMID 33834109

Citations 11

Authors

Audrius Kulikajevas

Rytis Maskeliunas

Robertas Damasevicius

Affiliations

Soon will be listed here.

Abstract

Human posture detection allows the capture of the kinematic parameters of the human body, which is important for many applications, such as assisted living, healthcare, physical exercising and rehabilitation. This task can greatly benefit from recent development in deep learning and computer vision. In this paper, we propose a novel deep recurrent hierarchical network (DRHN) model based on that allows for greater flexibility by reducing or eliminating posture detection problems related to a limited visibility human torso in the frame, i.e., the occlusion problem. The DRHN network accepts the RGB-Depth frame sequences and produces a representation of semantically related posture states. We achieved 91.47% accuracy at 10 fps rate for sitting posture recognition.

Citing Articles

Exploiting the features of deep residual network with SVM classifier for human posture recognition.

Kareem I, Ali S, Bilal M, Hanif M PLoS One. 2024; 19(12):e0314959.

PMID: 39636954 PMC: 11620452. DOI: 10.1371/journal.pone.0314959.

A fine-tuned YOLOv5 deep learning approach for real-time house number detection.

Tasyurek M, Ozturk C PeerJ Comput Sci. 2023; 9:e1453.

PMID: 37547390 PMC: 10403189. DOI: 10.7717/peerj-cs.1453.

Posture monitoring in healthcare: a systematic mapping study and taxonomy.

Camboim B, da Rosa Tavares J, Tavares M, Barbosa J Med Biol Eng Comput. 2023; 61(8):1887-1899.

PMID: 37347401 DOI: 10.1007/s11517-023-02851-w.

Optically Non-Contact Cross-Country Skiing Action Recognition Based on Key-Point Collaborative Estimation and Motion Feature Extraction.

Qi J, Li D, He J, Wang Y Sensors (Basel). 2023; 23(7).

PMID: 37050699 PMC: 10098931. DOI: 10.3390/s23073639.

YoNet: A Neural Network for Yoga Pose Classification.

Ashraf F, Islam M, Kabir M, Uddin J SN Comput Sci. 2023; 4(2):198.

PMID: 36785804 PMC: 9907194. DOI: 10.1007/s42979-022-01618-8.

References

Zhang J, Wu C, Wang Y . Human Fall Detection Based on Body Posture Spatio-Temporal Evolution. Sensors (Basel). 2020; 20(3). PMC: 7039221. DOI: 10.3390/s20030946. View

Cagnie B, Danneels L, Van Tiggelen D, De Loose V, Cambier D . Individual and work related risk factors for neck pain among office workers: a cross sectional study. Eur Spine J. 2006; 16(5):679-86. PMC: 2213555. DOI: 10.1007/s00586-006-0269-7. View

Sharma M, Majumdar P . Occupational lifestyle diseases: An emerging issue. Indian J Occup Environ Med. 2010; 13(3):109-12. PMC: 2862441. DOI: 10.4103/0019-5278.58912. View

Li Y, Shen L . Skin Lesion Analysis towards Melanoma Detection Using Deep Learning Network. Sensors (Basel). 2018; 18(2). PMC: 5855504. DOI: 10.3390/s18020556. View

Dias D, Silva Cunha J . Wearable Health Devices-Vital Sign Monitoring, Systems and Technologies. Sensors (Basel). 2018; 18(8). PMC: 6111409. DOI: 10.3390/s18082414. View

Li Y, Xu H, Bian M, Xiao J . Attention Based CNN-ConvLSTM for Pedestrian Attribute Recognition. Sensors (Basel). 2020; 20(3). PMC: 7038686. DOI: 10.3390/s20030811. View

GRANDJEAN E, Hunting W . Ergonomics of posture--review of various problems of standing and sitting posture. Appl Ergon. 1977; 8(3):135-40. DOI: 10.1016/0003-6870(77)90002-3. View

Ji B, Hong E . Deep-Learning-Based Real-Time Road Traffic Prediction Using Long-Term Evolution Access Data. Sensors (Basel). 2019; 19(23). PMC: 6929170. DOI: 10.3390/s19235327. View

Wang J, Zhang J, Cai Y, Deng L . DeepMiR2GO: Inferring Functions of Human MicroRNAs Using a Deep Multi-Label Classification Model. Int J Mol Sci. 2019; 20(23). PMC: 6928926. DOI: 10.3390/ijms20236046. View

10.

Mousavi Hondori H, Khademi M . A Review on Technical and Clinical Impact of Microsoft Kinect on Physical Therapy and Rehabilitation. J Med Eng. 2016; 2014:846514. PMC: 4782741. DOI: 10.1155/2014/846514. View

11.

Hernandez-Belmonte U, Ayala-Ramirez V . Real-Time Hand Posture Recognition for Human-Robot Interaction Tasks. Sensors (Basel). 2016; 16(1). PMC: 4732069. DOI: 10.3390/s16010036. View

12.

Bibbo D, Carli M, Conforto S, Battisti F . A Sitting Posture Monitoring Instrument to Assess Different Levels of Cognitive Engagement. Sensors (Basel). 2019; 19(3). PMC: 6387236. DOI: 10.3390/s19030455. View

13.

Matthew R, Seko S, Bailey J, Bajcsy R, Lotz J . Estimating Sit-to-Stand Dynamics Using a Single Depth Camera. IEEE J Biomed Health Inform. 2019; 23(6):2592-2602. DOI: 10.1109/JBHI.2019.2897245. View

14.

Chen H, Dou Q, Yu L, Qin J, Heng P . VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images. Neuroimage. 2017; 170:446-455. DOI: 10.1016/j.neuroimage.2017.04.041. View

15.

Zhou J, Tian Y, Yuan C, Yin K, Yang G, Wen M . Improved UAV Opium Poppy Detection Using an Updated YOLOv3 Model. Sensors (Basel). 2019; 19(22). PMC: 6891478. DOI: 10.3390/s19224851. View

16.

Pham H, Salmane H, Khoudour L, Crouzil A, Zegers P, Velastin S . Spatio⁻Temporal Image Representation of 3D Skeletal Movements for View-Invariant Action Recognition with Deep Convolutional Neural Networks. Sensors (Basel). 2019; 19(8). PMC: 6514994. DOI: 10.3390/s19081932. View

17.

Jankovic J, McDermott M, Carter J, Gauthier S, Goetz C, Golbe L . Variable expression of Parkinson's disease: a base-line analysis of the DATATOP cohort. The Parkinson Study Group. Neurology. 1990; 40(10):1529-34. DOI: 10.1212/wnl.40.10.1529. View

18.

Bouvier B, Duprey S, Claudon L, Dumas R, Savescu A . Upper Limb Kinematics Using Inertial and Magnetic Sensors: Comparison of Sensor-to-Segment Calibrations. Sensors (Basel). 2015; 15(8):18813-33. PMC: 4570347. DOI: 10.3390/s150818813. View

19.

Hirasawa T, Aoyama K, Tanimoto T, Ishihara S, Shichijo S, Ozawa T . Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images. Gastric Cancer. 2018; 21(4):653-660. DOI: 10.1007/s10120-018-0793-2. View

20.

Garcia Patino A, Khoshnam M, Menon C . Wearable Device to Monitor Back Movements Using an Inductive Textile Sensor. Sensors (Basel). 2020; 20(3). PMC: 7038988. DOI: 10.3390/s20030905. View