Return to search

Universal interaction and control in multiple display environments /

This dissertation presents interaction techniques for ubiquitous computing environments equipped with multiple, heterogeneous display devices and with novel augmented reality visualisation. Ubiquitous computing work environments are typically enhanced with a range of display technologies, personal information appliances, speech and natural language interfaces, interaction devices and contextual sensors. Interaction in these environments introduces new challenges not previously encountered in shared display or single display environments. / This dissertation describes a number of novel contributions that improve the state of the art in human computer interaction within ubiquitous computing environments. Firstly an interaction model is provided that can be used to categorise interaction tasks performed in ubiquitous computing environments. When interacting across multiple displays, users typically require temporary storage of information to allow data to be copied between devices. The second contribution of this dissertation of a clipboard model for ubiquitous computing environments to allow users to perform this task. Thirdly, a number of infrastructure modules were created to support interaction within these environments. The modules developed include: an Interaction Manager that implements the interaction model to allow any device to be used to control displays in the environments; a Clipboard Manager to manage the creation and access of ubiquitous computing clipboards as defined in the clipboard model; an Interaction Client to be run on each display to be controlled to implement the interaction tasks; and a rapidly adaptable tracking facility for ubiquitous computing environments. Fourthly, a Universal Interaction Controller was created to allow seamless interaction and control of displays in ubiquitous computing environments. With the Universal Interaction Controller, users are able to select a display by pointing at it, and then the interactions performed on the controller are forwarded to the selected display via the Interaction Manager. The controller also provides access to a number of clipboards as defined using the clipboard model. Finally, this dissertation describes the results of a user study that was run to determine the intuitiveness of the Universal Interaction Controller in multiple display and single display environments. This is performed by comparing users' performance with the device to their performance with the leading mobile pointing device and the traditional mouse. / Based on these contributions, two applications were developed to demonstrate how the infrastructure can be used in real world situations. The first application demonstrates the use of a Universal Interaction Controller and a Clipboard Manager for information visualisation. The second application interfaces with the traditional system clipboard to allow ubiquitous computing clipboards to be defined and accessed through traditional desktop clipboard techniques. / Thesis (PhDInformationTechnology)--University of South Australia, 2005.
CreatorsSlay, Hannah.
Source SetsAustraliasian Digital Theses Program
Detected LanguageEnglish
Rightscopyright under review

Page generated in 0.0023 seconds