Shin, Hyesoo Kim, Sangdo Kim, Sunwoo Lee, Jongwon Kim, Jinkyu Kim, KangGeon 2025-09-17T02:02:00Z 2025-09-17T02:02:00Z 2025-09-16 2025-10 https://pubs.kist.re.kr/handle/201004/153166 Lower limb exoskeletons assist users by supporting joint movements. Since joint motion patterns vary depending on how the user moves, accurately recognizing the type of movement (locomotion mode) is crucial for controlling the exoskeleton and ensuring user safety. Inspired by how humans use multiple types of sensory information to control movement, we developed a multi-modal locomotion mode recognition (LMR) system that uses both mechanical and visual sensor data to identify locomotion modes. Our approach utilizes two fusion methods: intermediate fusion, which combines the data in the form of features, and late fusion, which integrates the sensor data by averaging the recognition results from each sensor. By fusing these two different modalities, the prediction accuracy improved by an average of 11.7% with the test data. Through comparisons with uni-modal LMR systems that rely on a single type of sensor data for locomotion mode recognition, we found that the improved performance of the multi-modal LMR system is due to the visual information's ability to generalize different gait patterns across users and the mechanical sensor data's consistency within the same classes. English Institute of Electrical and Electronics Engineers Inc. Multi-Modal Locomotion Mode Recognition in the Real World for Robotic Hip Complex Exoskeletons Article 10.1109/LRA.2025.3597482 1 IEEE Robotics and Automation Letters, v.10, no.10, pp.9718 - 9725 IEEE Robotics and Automation Letters 10 10 9718 9725 N scie scopus 001554444400023 2-s2.0-105013293270 Robotics Robotics Article GAIT Wearable robotics sensor fusion sensor fusion embedded systems for robotic and automation embedded systems for robotic and automation embedded systems for robotic and automation