Konki Sravan Kumar Ankhzaya, Jamsrandorj Kim, Jinwook Mun, Kyung-Ryoul 2024-01-12T03:41:16Z 2024-01-12T03:41:16Z 2022-11-30 2022-07 https://pubs.kist.re.kr/handle/201004/77158 The joint angular velocity during daily life exercises is an important clinical outcome for injury risk index, rehabilitation progress monitoring and athlete's performance evaluation. Recently, wearable sensors have been widely used to monitor lower limb kinematics. However, these sensors are difficult and inconvenient to use in daily life. To mitigate these limitations, this study proposes a vision-based system for estimating lower limb joint kinematics using a deep convolution neural network with bi-directional long-short term memory and gated recurrent unit network. The normalized correlation coefficient, and the mean absolute error were computed between the ground truth obtained from the optical motion capture system and estimated joint angular velocities using proposed models. The estimated results show a highest correlation 0.93 in squat and 0.92 in walking on treadmill action. Furthermore, independent model for each joint angular velocity at the hip, knee, and ankle were analyzed and compared. Among the three joint angular velocities, knee joint has a best estimated accuracy (0.96 in squat and 0.96 in walking on the treadmill). The proposed models show higher estimation accuracy under both the lateral and the frontal view regardless of the camera positions and angles. This study proves the applicability of using sensor free vision-based system to monitor the lower limb kinematics during home workouts for healthcare and rehabilitation. English Institute of Electrical and Electronics Engineers Inc. Prediction of lower limb kinematics from vision-based system using deep learning approaches Conference 10.1109/EMBC48229.2022.9871577 1 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022, pp.177 - 181 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022 177 181 UK Glasgow 2022-07-11 Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS