Latency has always been one of the essential problems within Virtual Reality (VR) domain since VR is inherently an interactive paradigm which performs the real-time estimation of human motions. From the user's point of view, the latency extremely reduces the presence experience of VR systems, especially when user won’t able to perform interactions accurately. To compensate the excessive latency, different prediction methods on human motion were studied in recent years. Among them, Kalman Filter was the most popular choice. However, the effectiveness of using Kalman Filter to eliminate the latency for VR systems is not always satisfactory in practice since the accuracy of the estimation of the users’ motion depends on several factors: the linearity of the motion, the prediction time, the computational time, and the algorithm’s limitation.Therefore, this thesis presents a VR-based haptic teleoperation system to study how to effectively eliminate the latency effectively using Kalman Filter. For investigating the performances of different prediction methods for VR systems with several factors considered, two types of Kalman Filter: Linear Kalman Filter (LKF) and Unscented Kalman Filter (UKF) have been used to predict the haptic motion dataset, under different amount of simulated latencies.The result shows, both LKF and UKF provide a good performance at compensating the latency. For 200ms latency, both filters satisfactorily eliminate the latency and improve the interaction effectiveness. The comparative study shows, LKF provides better performance since the linear rotational motion dataset captured by haptic device was used; both filters show a reduced performance when the prediction time is increased. Besides, UKF requires more computational time than LKF.

This work is to investigate the performance of two Kalman Filter Algorithms, namely Linear Kalman Filter and Extended Kalman Filter on control-based human motion prediction in a real-time teleoperation. The Kalman Filter Algorithm has been widely used in research areas of motion tracking and GPS-navigation. However, the potential of human motion prediction by utilizing this algorithm is rarely being mentioned. Combine with the known issue - the delay issue in today’s teleoperation services, the author decided to build a prototype of simple teleoperation model based on the Kalman Filter Algorithm with the aim of eliminated the unsynchronization between the user’s inputs and the visual frames, where all the data were transferred over the network. In the first part of the thesis, two types of Kalman Filter Algorithm are applied on the prototype to predict the movement of the robotic arm based on the user’s motion applied on a Haptic Device. The comparisons in performance among the Kalman Filters have also been focused. In the second part, the thesis focuses on optimizing the motion prediction which based on the results of Kalman filtering by using the smoothing algorithm. The last part of the thesis examines the limitation of the prototype, such as how much the delays are accepted and how fast the movement speed of the Phantom Haptic can be, to still be able to obtain reasonable predations with acceptable error rate.   The results show that the Extended Kalman Filter has achieved more advantages in motion prediction than the Linear Kalman Filter during the experiments. The unsynchronization issue has been effectively improved by applying the Kalman Filter Algorithm on both state and measurement models when the latency is set to below 200 milliseconds. The additional smoothing algorithm further increases the accuracy. More important, it also solves shaking issue on the visual frames on robotic arm which is caused by the wavy property of the Kalman Filter Algorithm. Furthermore, the optimization method effectively synchronizes the timing when robotic arm touches the interactable object in the prediction.   The method which is utilized in this research can be a good reference for the future researches in control-based human motion tracking and prediction. / Detta arbete fokuserar på att undersöka prestandan hos två Kalman Filter Algoritmer, nämligen Linear Kalman Filter och Extended Kalman Filter som används i realtids uppskattningar av kontrollbaserad mänsklig rörelse i teleoperationen. Dessa Kalman Filter Algoritmer har används i stor utsträckning forskningsområden i rörelsespårning och GPS-navigering. Emellertid är potentialen i uppskattning av mänsklig rörelse genom att utnyttja denna algoritm sällan nämnas. Genom att kombinera med det kända problemet – fördröjningsproblem i dagens teleoperation tjänster beslutar författaren att bygga en prototyp av en enkel teleoperation modell vilket är baserad på Kalman Filter algoritmen i syftet att eliminera icke-synkronisering mellan användarens inmatningssignaler och visuella information, där alla data överfördes via nätverket. I den första delen av avhandlingen appliceras både Kalman Filter Algoritmer på prototypen för att uppskatta rörelsen av robotarmen baserat på användarens rörelse som anbringas på en haptik enhet. Jämförelserna i prestandan bland de Kalman Filter Algoritmerna har också fokuserats. I den andra delen fokuserar avhandlingen på att optimera uppskattningar av rörelsen som baserat på resultaten av Kalman-filtrering med hjälp av en utjämningsalgoritm. Den sista delen av avhandlingen undersökes begräsning av prototypen, som till exempel hur mycket fördröjningar accepteras och hur snabbt den haptik enheten kan vara, för att kunna erhålla skäliga uppskattningar med acceptabel felfrekvens.   Resultaten visar att den Extended Kalman Filter har bättre prestandan i rörelse uppskattningarna än den Linear Kalman Filter under experimenten. Det icke-synkroniseringsproblemet har förbättrats genom att tillämpa de Kalman Filter Algoritmerna på både statliga och värderingsmodeller när latensen är inställd på under 200 millisekunder. Den extra utjämningsalgoritmen ökar ytterligare noggrannheten. Denna algoritm löser också det skakande problem hos de visuella bilder på robotarmen som orsakas av den vågiga egenskapen hos Kalman Filter Algoritmen. Dessutom effektivt synkroniserar den optimeringsmetoden tidpunkten när robotarmen berör objekten i uppskattningarna.   Den metod som används i denna forskning kan vara en god referens för framtida undersökningar i kontrollbaserad rörelse- spåning och uppskattning.