Back to search

Institutes outside Greece

Smart tele-rehabilitation and tele-monitoring system based on 3D sensors and advanced computer vision techniques

Abstract

dc:description

Telerehabilitation is important for the restoration of hand mobility in patients with after-stroke and after-surgery problems or neurological conditions. In this work, we aim to create a remote hand rehabilitation system employing the Virtual Glove (VG). The VG is a computer vision-based structure that simultaneously utilizes two synchronized Leap Motion Controller (LMC)s to track the motion of the hand and reconstruct a numerical hand model in real time. It has been conceptualized for telerehabilitation purposes, but it can also be used for human-system interaction. We have analyzed the use of computer vision methods that employ more than one sensor and focused on optimizing the function of the VG for detailed hand and finger movement tracking. Several methods have been developed and tested to efficiently combine the data from the two IR sensors. The problem of occlusions, frequent and common in computer vision systems, has been examined, and methods for minimizing them, while maintaining real-time, have been used. The results have been implemented to a complete framework for at-home hand rehabilitation, in a system made for the use of the patient as well as the therapist. The total of the data analysis procedure has been implemented in an interactive application designated to be used by a therapist to control and analyze hand telerehabilitation sessions, numerically control joints’ mobility, as well as to organize personalized exercises for each patient. Then, to allow the system to be used together with Machine Learning techniques, a humanoid actuator in the form of a human hand has been 3D printed and used to produce controlled wrist and finger movements, recorded by the VG. A complete pipeline for data analysis and a method to map spatial VG information to the motor movements of a mechanical actuator have been established. Also, a method for moving to a sensor-independent, hand-based Cartesian coordinate reference system has been developed. Finally, the pipeline has been developed to create a database of hand and finger movement data with ground truth information using the 3D printed actuator.

Degree

thesis:*
Grantor dc:publisher
Institutes outside Greece
Year dc:date
2023

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Theodoridou, Eleni
  • Θεοδωρίδου, Ελένη

Subjects

dc:subject × 15

Rights

Language dc:language
eng

Identifiers

dc:identifier.*
Identifier
10.12681/eadd/56660

Chain of custody

source
Harvested from
Greek National Archive of PhD Theses
Base URL
phdtheses.ekt.gr/eadd_oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Theodoridou, Eleni; Θεοδωρίδου, Ελένη. Smart tele-rehabilitation and tele-monitoring system based on 3D sensors and advanced computer vision techniques. Institutes outside Greece, 2023. http://hdl.handle.net/10442/hedi/56660