A Framework for Personalized Training at Home Based on Motion Capture

Hyunjoo Park - Department of Smart Information and Telecommunication Engineering, Sangmyung University, Cheonan, Chungnam, Republic of Korea
Seungdo Jeong - Department of Smart Information and Telecommunication Engineering, Sangmyung University, Cheonan, Chungnam, Republic of Korea

Citation Format:

DOI: http://dx.doi.org/10.30630/joiv.6.1-2.940


As the number of single-person households continues to increase, contents related to exercise at home are increasing. Therefore, this paper proposes a framework for efficient home fitness. The home fitness framework proposed in this paper is based on a method of acquiring expert motion information and providing it to users. To this end, content creation and provision are implemented by using Kinect and Unreal game engine. In addition, it is possible to provide customized home fitness in consideration of the user's athletic ability. The proposed system first captures the expert's motion and stores it. We propose a method that can efficiently store stop motion and dynamic motion storage. In the case of each user, since there is a difference in exercise ability for each individual, an adverse effect may occur if an excessively accurate motion is requested. Therefore, to solve these problems, we present the parts that can be considered for each joint. For the exercise motion provided by the expert, a method was provided that allows the user to adjust the degree of matching for each joint in consideration of user's own exercise ability. That is, joint parts that do not require exact matching could be completely excluded from matching. For parts that would be subject to large changes, a range of errors is specified. As the training progresses, the error range is reduced, and the excluded parts are presented to be matched gradually. Such adjustments are made based on expert feedback. In this way, it was possible to improve the exercise effect gradually. This paper proposes an effective method for personalized home fitness according to the user's athletic ability. This will apply to various fields besides home fitness.


Home fitness; kinect; unreal engine; motion capture; personalized training.

Full Text:



Recent one-person households: 1960 and 2015. Accessed on December 1, 2021. [Online]. Available: http://www.ipsnews.net/2017/02/the-rise-of-one-person-households/

Xiaonan, G., Jian, L., Cong, S., Hongbo, L., Yingying, C., and Mooi, C. C., "Device-free Personalized Fitness Assistant Using WiFi," Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. vol.2, no.4, December 2018, DOI: https://doi.org/10.1145/3287043.

Arlati, Sara, Vera Colombo, Daniele Spoladore, Luca Greci, Elisa Pedroli, Silvia Serino, Pietro Cipresso, Karine Goulene, Marco Stramba-Badiale, Giuseppe Riva, Andrea Gaggioli, Giancarlo Ferrigno, and Marco Sacco, "A Social Virtual Reality-Based Application for the Physical and Cognitive Training of the Elderly at Home," Sensors, vol.19, no. 2, 2019, DOI: https://doi.org/10.3390/s19020261

Stark, C., Duran, I., Cirak, S., Hamacher, S., Hoyer-Kuhn, H. K., Semler, O., & Schoenau, E., "Vibration-assisted home training program for children with spinal muscular atrophy," Child Neurology Open, vol.5, 2018.

S.-Y. Joo, C.-B. Lee, N.-Y. Joo, and C.-R. Kim, "Feasibility and Effectiveness of a Motion Tracking-Based Online Fitness Program for Office Workers," Healthcare, vol.9, no. 5, p. 584, 2021, DOI: https://doi.org/10.3390/healthcare9050584

Batrakoulis, Alexios, "European survey of fitness trends for 2020," ACSM's Health & Fitness Journal, vol.23, no.6, pp. 28-35, 2019.

Burton, Elissa, et al., "Reliability and validity of two fitness tracker devices in the laboratory and home environment for older community-dwelling people," BMC geriatrics, vol.18, no.1, pp. 1-12, 2018.

Miller Erin, "Training Devices Increase Patient Engagement and Adherence–Creating Better Outcomes," ONdrugDelivery Magazine, vol.97, pp. 47-50, 2019.

Johnson, Peter Arne, "Hidden in plain sight: The spatial and industrial logics of home fitness technologies," New Review of Film and Television Studies, pp. 1-25, 2021.

Tavares, Bruno F., et al., "Mobile applications for training plan using android devices: A systematic review and a taxonomy proposal," Information, vol.11, no.7 p. 343, 2020.

Federici, Ario, and R. Palanca, "Home-fitness: physical exercise and elderly's quality of life," Journal of Physical Education and Sport, vol.19, pp. 1852-1855, 2019.

Connolly, Luke J., et al., "Impact of a novel home-based exercise intervention on health indicators in inactive premenopausal women: a 12-week randomised controlled trial," European Journal of Applied Physiology, vo.120, no.4, pp. 771-782, 2020.

Rodrigues-Krause, Josianne, Mauricio Krause, and Alvaro Reischak-Oliveira, "Dancing for healthy aging: functional and metabolic perspectives," Alternative Therapies in Health & Medicine, vol.25, no.1, 2019.

Li, W. et al., "Application of virtual reality technology in Wushu education," The International Journal of Electrical Engineering & Education, 2020, DOI: https://doi.org/10.1177/0020720920940583.

Jialiang, H. and Huiying, Z., "Mobile-based education design for teaching and learning platform based on virtual reality," The International Journal of Electrical Engineering & Education, 2020, DOI: https://doi.org/10.1177/0020720920928547.

Rodrigues, Maria Andréia F., et al., "A serious game to practice stretches and exercises for a correct and healthy posture," Entertainment Computing, vol.28, pp. 78-88, 2018.

Box, Allyson G., et al. "Individual differences influence exercise behavior: how personality, motivation, and behavioral regulation vary among exercise mode preferences." Heliyon, vol.5, no.4, e01459, 2019.

Kinect 4 Unreal – Opaque Media Group. Accessed on July 10, 2021, [Online] Available: https://www.opaque.media/kinect-4-unreal/

Raheb, Katerina El, et al., "Dance interactive learning systems: A study on interaction workflow and teaching approaches," ACM Computing Surveys(CSUR), vol.52, no.3, pp. 1-37, 2019.

Uebelacker, Lisa, et al., "Examining the feasibility and acceptability of an online yoga class for mood disorders: A MoodNetwork study," Journal of Psychiatric Practice, vol.24, no.1, pp. 60-67, 2018.

Huberty, Jennifer, et al. "Online yoga to reduce post traumatic stress in women who have experienced stillbirth: a randomized control feasibility trial," BMC Complementary Medicine and Therapies, vol.20, no.1, pp. 1-19, 2020.

Milanko, Slobodan, Alexander Launi, and Shubham Jain, "Designing just-in-time detection for gamified fitness frameworks," arXiv preprint arXiv:2005.08834, 2020.

Zou, Yongpan, et al., "A low-cost smart glove system for real-time fitness coaching," IEEE Internet of Things Journal, vol.7, no.8, pp. 7377-7391, 2020.

Schlagenhauf, Franziska, Siddarth Sreeram, and William Singhose, "Comparison of kinect and vicon motion capture of upper-body joint angle tracking," 2018 IEEE 14th International Conference on Control and Automation (ICCA). IEEE, 2018.

Naeemabadi, MReza, et al., "Investigating the impact of a motion capture system on Microsoft Kinect v2 recordings: A caution for using the technologies together," PloS one, vol.13, no.9, e0204052, 2018.

Steinebach, Tim, et al, "Accuracy evaluation of two markerless motion capture systems for measurement of upper extremities: Kinect V2 and Captiv," Human Factors and Ergonomics in Manufacturing & Service Industries, vol.30, no.4, pp. 291-302, 2020.

Cordone, R., Unreal Engine 4 Game Development Quick Start Guide: Programming professional 3D games with Unreal Engine 4, Packt Publishing Ltd, 2019.

Plowman Jessica, Unreal Engine Virtual Reality Quick Start Guide: Design and Develop Immersive Virtual Reality Experiences with Unreal Engine 4, Packt Publishing Ltd, 2019.

Mack, Kevin, and Robert Ruud, Unreal Engine 4 Virtual Reality Projects: Build Immersive, Real-world VR Applications Using UE4, C++, and Unreal Blueprints, Packt Publishing Ltd, 2019.

Martinez-Gonzalez, Pablo, et al., "Unrealrox: an extremely photorealistic virtual reality environment for robotics simulations and synthetic data generation," Virtual Reality, vol.24, no.2, pp. 271-288, 2020.