Return to search

Towards Sparse IMU Sensor-Based Estimation of Walking Kinematics, Joint Moments, and Ground Reaction Forces in Multiple Locomotion Modes via Deep Learning

Acquiring joint kinematics, joint moments, and ground reaction forces (GRFs) during walking is essential for assessing disease progression and health monitoring during rehabilitation. However, spatial and temporal constraints, expert processing, and high costs limit the current gold standard methods, such as optical motion capture systems and floor-embedded force plates. Experts have suggested wearables with machine learning methods to address this issue, but their large sensor count renders them impractical for daily use, and the use of generic algorithms limits their accuracy. As a result, learning kinematics and kinetics in everyday life outside of laboratory settings is challenging. Thus, there is a need for an inexpensive, near-real-time system and an accurate method for estimating kinematics, joint moments, and GRFs. This dissertation proposes using shoe-mounted IMU sensors and deep learning to estimate these parameters across various locomotion modes, reflecting everyday walking conditions. Four different approaches are explored. The first approach uses shoe-embedded IMU sensors with novel deep learning models, DeepBBWAE-Net, Kinetics-FM-DLR-Ensemble-Net, and DL-Kinetics-FM-Net, which outperform state-of-the-art models but are computationally expensive. The second approach introduces Kinematics-Net and Kinetics-MMF-Net, which are lightweight yet maintain similar performance. Sparse IMU sensors on the feet may miss critical walking dynamics, so the third approach proposes a sensor distillation technique, transferring knowledge from a teacher model (trained with full sensors) to a student model (trained with sparse IMUs), enhancing estimation accuracy. Although our models are trained on a substantial number of subjects, deep learning models tend to perform better with larger datasets. Collecting extensive subject data is resource-intensive and time-consuming. Additionally, public datasets often differ in sensor types, locations, and protocols. Our fourth approach addresses this by proposing a domain adaptation technique that transfers knowledge from source datasets to the target dataset, improving performance in the target domain.

Identiferoai:union.ndltd.org:ucf.edu/oai:stars.library.ucf.edu:etd2023-1415
Date01 January 2024
CreatorsHossain, Md Sanzid Bin
PublisherSTARS
Source SetsUniversity of Central Florida
LanguageEnglish
Detected LanguageEnglish
Typetext
Formatapplication/pdf
SourceGraduate Thesis and Dissertation 2023-2024

Page generated in 0.0014 seconds