Back to search

University of the Aegean

Μεθοδολογικό πλαίσιο σχεδίασης της αλληλεπίδρασης μέσω ενάεριων χειρονομιών του χρήστη με πολλαπλούς στόχους στον φυσικό χώρο

Abstract

dc:description

This PhD thesis deals with issues of Human-Computer Interaction focusing on systems that support mid-air gestural interaction. In mid-air gestural interaction (or simply mid-air interaction), the user can interact directly with devices located in the same physical space, or with content projected on them (through some interface), using gestures or postures of his body (mainly with his hands). In mid-air interaction there are no general patterns and gesture sets that are ideal for all applications. Therefore, defining the most appropriate gestures is an important design issue that should be adapted to the needs and characteris-tics of each application.To date mid-air interaction has typically been studied in cases where the user interacts with a single device (target). However, the case of interacting with multiple targets in the same physical space has not been extensively researched, such as in smart homes, in rooms with various technological augmentations (e.g., classrooms), in exhibition places and museums, in spatial augmented reality scenarios, etc. In such cases, additional design challenges arise, some of the most important being that: the process of empirical gesture research, prototyping and evaluation is more complex, the problem of "addressing" a tar-get before commanding it is introduced, the risk of false activation is enhanced (also known as "Midas-touch"), the number of gestures that the user will have to memorize is very large, the possibility of having "conflicting" gestures is high, etc.The purpose of this PhD thesis is to propose and implement an iterative and integrated design methodology for systems with multiple interactive targets that support mid-air in-teraction, which uses, extents, and specializes design techniques that address the entire life cycle and include gesture elicitation, system design, prototyping and empirical evaluation. The objectives of the PhD thesis are: to critically review and analyze the methodological and technological state-of-the-art of mid-air interaction, to propose an integrated methodo-logical framework for the design of mid-air interaction on systems with multiple targets (i.e. various appliances of a smart home) that involves gesture elicitation, prototyping, and empirical evaluation, and to propose two interaction models that support two-stage or in-stant addressing and commanding of each target.During the experimental investigation of mid-air interaction with multiple targets, two dif-ferent interaction models were proposed and tested. In the first interaction model, "Ad-dress-then-Command" (AtC), the user must first make a gesture to address the device and then make a second gesture to activate the command on it. In the second interaction model, called "Address-and-Command" (A&C), the user must apply with both hands at the same time, a posture with the left hand for addressing the device and a gesture (or posture) with the right hand to command it. The above models were investigated for the case of smart home devices, a prototype was developed, and an empirical evaluation was conducted, according to the proposed methodology. The main result of the experimental research showed that mid-air interaction in the smart home is feasible, easy to remember, and easy to use. Between the two interaction models, the A&C model has some comparative ad-vantages over AtC mainly in terms of task completion time, and user errors.The contribution of this thesis focuses mainly on mid-air design methodology issues as well as on proposition of two interaction models for systems with multiple targets. At the stage of the empirical investigation of gesture design, a frame-based elicitation study is proposed, so that the user suggested gestures have an environmental validity with the con-text of the application. Also, the “User Consistency Rate” metric is introduced, which measures the agreement rate of the gestures proposed by one user for a given command on many different devices. At the stage of prototyping, an original technological synthesis is proposed by exploiting: tools that allow rapid prototyping of gesture definition and recognition, a game engine in order to implement the graphical interface of the system (displaying devices that provide graphical and audio feedback for each recognized ges-ture), and spatial augmented reality technology (using projection mapping) that allows the devices and the graphical interface of the "ecosystem" to be projected onto mock-ups in order to simulate a realistic interactive multi-targeted environment of a smart home. In the evaluation stage, an empirical evaluation with user participation and the use of a frame-work is proposed, similar to the one used during the stage of empirical gestural research in a process with three sessions (training, recap, and testing). Also, a set of evaluation metrics concerning gesture ease of use, user experience and memorability, are used, as well as questionnaires for benchmarking of the above.The PhD thesis is original in the following respects. It addresses the topic of mid-air in-teraction in multi-targeted environment through an integrated research approach that in-cludes empirical gesture research, prototyping, and evaluation. It explores the interaction with multiple devices as a single ecosystem rather than with each device individually. It presents, investigates, and compares two different mid-air interaction models that address the problem of "addressing" the devices, and the problem of "Midas touch", and allow the reduction of the gesture set (with respect to the total functions that activate) contributing to easy memorization. It proposes a single methodological framework for designing mid-air interaction with multiple devices.

Degree

thesis:*
Grantor dc:publisher
University of the Aegean
Year dc:date
2022

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Vogiatzidakis, Panagiotis
  • Βογιατζιδάκης, Παναγιώτης

Subjects

dc:subject × 20

Rights

Language dc:language
gre

Identifiers

dc:identifier.*
Identifier
10.12681/eadd/52714

Chain of custody

source
Harvested from
Greek National Archive of PhD Theses
Base URL
phdtheses.ekt.gr/eadd_oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Vogiatzidakis, Panagiotis; Βογιατζιδάκης, Παναγιώτης. Μεθοδολογικό πλαίσιο σχεδίασης της αλληλεπίδρασης μέσω ενάεριων χειρονομιών του χρήστη με πολλαπλούς στόχους στον φυσικό χώρο. University of the Aegean, 2022. http://hdl.handle.net/10442/hedi/52714