Computer Vision-Augmented Exergaming for Spine Health
-
Thandavamurthy Jayasree
,
Palchamy Pragathi
,
Saravanan Premkumar
,
Senthilkumar Revathi Sree Krishna
Abstract
Introduction: Back pain remains a prevalent musculoskeletal condition with significant implications for quality of life and long-term spinal health. Conventional rehabilitation approaches often suffer from low patient adherence and limited engagement, highlighting the need for innovative, technology-driven solutions that motivate sustained therapeutic participation.
Materials and Methods: A real-time pose detection system was integrated with a Unity-based gaming platform to deliver personalized exercise regimens targeting flexibility, strength, and postural correction. The system incorporated computer vision algorithms for real-time biomechanical analysis and immediate performance feedback. Three therapeutic exercises were evaluated: the knee-to-chest stretch (cross crunches), side bend, and forward and backward bends. Exercise performance was gamified within the Unity engine to enhance user motivation and adherence.
Results: The system successfully detected and analysed user performance across all three target exercises in real time. A measurable improvement in user scoring patterns was observed over successive sessions, indicating enhanced engagement and more effective exercise execution. The gamified framework demonstrated reliable performance analysis and responsiveness to individual rehabilitation needs.
Conclusion: Integrating real-time pose detection with interactive game-based environments represents a viable and scalable approach to back pain rehabilitation. By transforming therapeutic exercises into engaging gameplay, the proposed system promotes greater adherence to treatment protocols and supports superior long-term spinal health outcomes. The framework's adaptability positions it as a promising tool for individuals with diverse rehabilitation requirements.
Hayden JA, Ellis J, Ogilvie R, Malmivaara A, van Tulder MW. Exercise therapy for chronic low back pain. The Cochrane Database of Systematic Reviews. 2021; 9(9):CD009790. [DOI:10.1002/14651858.CD009790.pub2] [PMID]
Cheng M, Tian Y, Ye Q, Li J, Xie L, Ding F. Evaluating the effectiveness of six exercise interventions for low back pain: A systematic review and meta-analysis. BMC Musculoskeletal Disorders. 2025; 26(1):433. [DOI:10.1186/s12891-025-08658-0] [PMID]
Goncalves RS, Prado RA, Ladeira G.MV, Gasparini ALP. Development of Serious Games for the Rehabilitation of the Human Vertebral Spine for Home Care. Robotics. 2023; 12(2):58. [DOI:10.3390/robotics12020058]
Gmez-Portes C, Lacave C, Molina AI, Vallejo D. Home rehabilitation based on gamification and serious games for young people: A systematic mapping study. Applied Sciences. 2020; 10(24):8849. [DOI:10.3390/app10248849]
Daoud MI, Alhusseini A, Ali MZ, Alazrai R. A game-based rehabilitation system for upper-limb cerebral palsy: A feasibility study. Sensors (Basel). 2020; 20(8):2416. [DOI:10.3390/s20082416] [PMID]
Alexandre R, Postolache O, Silva Girao P. Physical Rehabilitation based on Smart Wearable and Virtual Reality Serious Game. Paper presented at: 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC). 20-23 May 2019; Auckland, New Zealand. [DOI:10.1109/I2MTC.2019.8826947]
Pintado-Izquierdo S, Cano-de-la-Cuerda R, Ortiz-Gutie’rrez RM. Video game-based therapy on balance and gait of patients with stroke: A systematic review. Applied Sciences. 2020; 10(18):6426. [DOI:10.3390/app10186426]
Chow Mei Yeng A, Ying Han P, How KW, Shih Yin O. Hand Gesture Controlled Game for Hand Rehabilitation. Proceedings of the International Conference on Computer, Information Technology and Intelligent Computing (CITIC 2022). 2022; 205-15. [DOI:10.2991/978-94-6463-094-7_17]
Altayeb M. Hand gestures replicating robot arm based on medi- aPipe. Indonesian Journal of Electrical Engineering and Informatics (IJEEI). 2023; 11(3):727-37. [DOI:10.52549/ijeei.v11i3.4491]
Kim JW, Choi JY, Ha EJ, Choi JH. Human pose estimation using mediaPipe pose and optimization method based on a humanoid model. Applied Sciences. 2023; 13(4):2700.[DOI:10.3390/app13042700]
Patil A, Rao D, Utturwar K, Shelke T, Sarda E. Body posture detection and motion tracking using AI for medical exercises and recommendation system. International Conference on Automation, Computing and Communication. 2022; 44:6. [DOI:10.1051/itmconf/20224403043]
Chung YY, Annaswamy TM, Prabhakaran B. Performance and user experience studies of HILLES: Home-based immersive lower limb exergame system. Proceedings of the 14th Conference on ACM Multimedia Systems. 2023; 62-73. [DOI:10.1145/3587819.3590985]
Rangari T, Kumar S, Roy PP, Dogra DP, Kim BG. Video based exercise recognition and correct pose detection. Multimedia Tools and Applications. 2022; 81:30267–82. [DOI:10.1007/s11042-022-12299-z]
Debnath B, O’Brien M, Yamaguchi M, Behera A. A review of computer vision-based approaches for physical rehabilitation and assessment. Multimedia Systems. 2021; 28:209-39. [DOI:10.1007/s00530-021-00815-4]
Schez-Sobrino S, Vallejo D, Monekosso DN, Glez-Morcillo C, Remagnino P. A Distributed Gamified System Based on Automatic Assessment of Physical Exercises to Promote Remote Physical Rehabilitation. IEEE Access. 2020; 8:91424-34. [DOI:10.1109/ACCESS.2020.2995119]
Alfieri FM, da Silva Dias C, de Oliveira NC, Battistella LR. Gamification in musculoskeletal rehabilitation. Current Reviews in Musculoskeletal Medicine. 2022; 15(6):629-36. [DOI:10.1007/s12178-022-09797-w] [PMID]
Schonauer C, Pintaric T, Kaufmann H, Jansen - Kosterink S, Vollenbroek-Hutten M. Chronic pain rehabilitation with a serious game using multimodal input. IInternational Conference on Virtual Rehabilitation. 27-29 June 2011; Zurich, Switzerland. [DOI:10.1109/ICVR.2011.5971855]
Mueller J, Niederer D, Tenberg S, Oberheim L, Moesner A, Mueller S. Acute effects of game-based biofeedback training on trunk motion in chronic low back pain: A randomized cross-over pilot trial. BMC Sports Science, Medicine & Rehabilitation. 2022; 14(1):192. [DOI:10.1186/s13102-022-00586-z] [PMID]
Trost Z, Zielke M, Guck A, Nowlin L, Zakhidov D, France CR, et al. The promise and challenge of virtual gaming technologies for chronic pain: The case of graded exposure for low back pain. Pain Management. 2015; 5(3):197-206. [DOI:10.2217/pmt.15.6] [PMID]
Stamm O, Dahms R, Müller-Werdan U. Virtual reality in pain therapy: A requirements analysis for older adults with chronic back pain. Journal of NeuroEngineering and Rehabilitation. 2020; 17(1):129. [DOI:10.1186/s12984-020-00753-8] [PMID]
France CR, Thomas JS. Virtual immersive gaming to optimize recovery (VIGOR) in low back pain: A phase II randomized controlled trial. Contemporary Clinical Trials. 2018; 69:83-91. [DOI:10.1016/j.cct.2018.05.001] [PMID]
Fatoye F, Gebrye T, Mbada CE, Fatoye CT, Makinde MO, Ayomide S, et al. Cost effectiveness of virtual reality game compared to clinic based McKenzie extension therapy for chronic nonspecific low back pain. British Journal of Pain. 2022; 16(6):601-9. [DOI:10.1177/20494637221109108] [PMID]
Jansen-Kosterink SM, Huis In 't Veld RM, Schönauer C, Kaufmann H, Hermens HJ, Vollenbroek-Hutten MM. A serious exergame for patients suffering from chronic musculoskeletal back and neck pain: A pilot study. Games for Health Journal. 2013; 2(5):299-307. [DOI:10.1089/g4h.2013.0043] [PMID]
Garofano M, Del Sorbo R, Calabrese M, Giordano M, Di Palo MP, Bartolomeo M, et al. Remote rehabilitation and virtual reality interventions using motion sensors for chronic low back pain: a systematic review of biomechanical, pain, quality of life, and adherence outcomes. Technologies. 2025; 13(5):186. [DOI: 10.3390/technologies13050186]
Brauner P, Ziefle M. Serious motion-based exercise games for older adults: evaluation of usability, performance, and pain mitigation. JMIR Serious Games. 2020; 8(2):e14182.[DOI:10.2196/14182] [PMID]
Zhang K, Zhang P, Tu X, Liu Z, Xu P, Wu C, et al. SR-POSE: A novel non-contact real-time rehabilitation evaluation method using lightweight technology. IEEE Transactions on neural systems and rehabilitation engineering: A Publication of the IEEE Engineering in Medicine and Biology Society. 2023; 31:4179-88. [DOI:10.1109/TNSRE.2023.3324960] [PMID]
Dey M, Musib A, Mandal S, Chell S, Kar M. Yoga pose detection for human rehabilitation using deep leaning. International Journal for Research in Applied Science and Engineering Technology. 2023; 11(12):231-5. [DOI:10.22214/ijraset.2023.57281]
Pereira B, Cunha B, Viana P, Lopes M, Melo ASC, Sousa ASP. A machine learning app for monitoring physical therapy at home. Sensors (Basel). 2023; 24(1):158. [DOI:10.3390/s24010158] [PMID]
Adolf J, Dolezal J, Kutilek P, Hejda J, Lhotska L. Single camera-based remote physical therapy: verification on a large video dataset. Applied Sciences (Switzerland). 2022; 12(2):799. [DOI:10.3390/app12020799]
Palermo M, Lopes JM, André J, Matias AC, Cerqueira J, Santos CP. A multi-camera and multimodal dataset for posture and gait analysis. Scientific Data. 2022; 9(1):603. [DOI:10.1038/s41597-022-01722-7] [PMID]
IJsselsteijn, WA, de Kort, YAW, Poels, K, The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven; 2013. [Link]
Elona JJ, Jayasree T. Smart Gaming System for Hand Rehabilitation. In: Singh BK, Sinha G, Pandey R, editors. Biomedical engineering science and technology. ICBEST 2023. Communications in Computer and Information Science, vol 2003. Cham: Springer; 2024. [DOI:10.1007/978-3-031-54547-4_4]
| Issue | Vol 20 No 2 (2026) | |
| Section | Research Article(s) | |
| DOI | https://doi.org/10.18502/jmr.v20i2.21716 | |
| Keywords | ||
| Back pain Pose detection technology Rehabilitation Unity Spinal health Gaming exercise | ||
| Rights and permissions | |
|
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |
