De nos jours, l’industrie aérospatiale est composée d’acteurs internationaux.Due à la complexité de leur production (taille, nombre de composants,variété des systèmes, ...), la conception d’un avion ou d’un lanceurnécessite un grand nombre d’ingénieurs avec des domaines d’expertises variés.De plus, les industries aérospatiales sont distribuées de par le monde. Dans cecontexte complexe, il est nécessaire d’utiliser la réalité virtuelle afin de proposerdes environnements virtuels accessibles depuis des sites distants afin departager une expérience collaborative. Des problèmes particuliers, alors, surviennent,particulièrement par rapport à la perception des autres utilisateursimmergés.Cette thèse, en partenariat avec Airbus Group, se concentre sur la conceptionde techniques d’interaction collaboratives efficaces. Ces sessions collaborativespermettent de connecter plusieurs sites distants via le même environnementvirtuel. Ainsi, des experts de domaines variés peuvent travailler ensembleen étant immergés simultanément. Par exemple, si un problème survient durantles dernières étapes d’assemblage d’un lanceur, il peut être nécessairede rassembler des experts qui étaient impliqués en amont du projet (bureaud’étude pour la conception, usine pour la fabrication des systèmes), afin deconcevoir des solutions pour résoudre le problème.Dans cette thèse, nous proposons différentes techniques d’interactions afinde faciliter la collaboration à différents niveaux d’un projet industriel. Nousnous sommes intéressés à la communication et la perception entre collaborateursimmergés, à la prise d’annotation et la circulation de ces annotations età la collaboration asymétrique entre une salle de réunion et un environnementvirtuel à l’aide d’outil de réalité mixte. / The aerospace industry is no longer composed of local and individualbusinesses. Due to the complexity of the products (their size, the numberof components, the variety of systems, etc.), the design of an aircraft or alauncher involves a considerable number of engineers with various fields of expertise.Furthermore, aerospace companies often have industrial facilities allover the world. In such a complex setting, it is necessary to build virtual experimentsthat can be shared between different remote sites. Specific problemsthen arise, particularly in terms of the perception of other immersed users.We are working with Airbus Group in order to design efficient collaborativeinteraction methods. These collaborative sessions allow multiple sites to beconnected within the same virtual experiment and enable experts from differentfields to be immersed simultaneously. For instance, if a problem occurs duringthe final stages of a launcher assembly, it may be necessary to bring togetherexperts on different sites who were involved in previous steps ( initial design,manufacturing processes). In this thesis, we propose various interaction technique in order to ease thecollaboration at different moments of an industrial process. We contributedin the context of communication between immersed users, taking notes inthe virtual environment and sharing it outside virtual reality and asymmetriccollaboration between a physical meeting room and a virtual environment.

In this thesis, we propose a Serious Game (SG) for children with the Autism Spectrum Disorder (ASD) that builds on the concept of LEGO®-Based Therapy that is aimed at improving social and cognitive skills. The proposed SG is composed of building blocks augmented with electronic modules that connect to a computing device that provides visual feedback. We investigate the effects of using the proposed computer SG by comparing it to a non-computer block-game during two empirical studies, one following an unstructured play approach and a second one with structured play by assigning roles to the players. For the first study, the proposed system showed an improvement in social interaction, collaborative play and exercise performance, as well as a decrease in solitary play. For the second study, the proposed system showed an improvement in social interaction, positive vocalizations and exploratory behavior. There was also a marked preference towards the proposed game. Furthermore, we perceived a decrease on the assistance needed when using the proposed system during both studies. Our results suggest that the proposed system can be a useful play therapy tool aimed for young children with ASD.

Interactive digital art installations are fundamentally enabled by hardware and software. Through a combination of these elements an interactive experience is con- structed. The first half of this thesis discusses the technical complexity associated with design and implementation of digital interactive installation. A system, dreamIO, is proposed for mediating this complexity through providing wireless building blocks for creating interactive installations. The technical details–both hardware and software– of this system are outlined. Measurements of the system are presented followed by analysis and discussion of the real world impact of this data. Finally, a discussion of future improvements is presented. The second half of this thesis examines an example interactive installation, Trans- code, which uses the proposed system as the building block for the piece. The piece is presented as evidence for the value of the proposed system and as a work of art in it’s own right. The use of the dreamIO system is detailed followed by a discussion of the interactivity and aesthetic form of the work. The purposes of these specific design choices are then presented. Finally, the work is analyzed through a combination of Relational Aesthetics and Cybernetics. / Graduate

No description available.

<p dir="ltr">Recognition of human behavior and object status plays a significant role in context-aware applications. Although researchers have explored methods to detect users’ activities, there still exists a research gap where end-users are not able to build personalized applications that accurately recognize their activities in the physical environment. Therefore, in this thesis, to fill the gap, we explore different in-situ context-aware Augmented Reality (AR) applications that leverage hand-object recognition and support users to rapidly author context-aware applications by referring to their activities. We first explore the possibility that end-users develop AR applications with customized freehand interactions and introduce GesturAR, an end-to-end authoring tool that supports users to create freehand AR applications through embodied demonstration and visual programming. Next, we explore hand interactions with physical objects and propose ARnnotate, an AR system enabling end-users to create custom data. To further study context-aware applications with haptic feedback, we present Ubi Edge, an AR authoring tool that allows end-users to customize edges on daily objects as tangible user interface (TUI) inputs to control varied digital functions. We develop an integrated AR device and a vision-based detection workflow to track 3D edges and detect the touch interaction between fingers and edges. Finally, to enable end-users to apply AR applications in different physical environments, we propose AdapTUI, a system that can automatically adapt the geometric-based TUIs in various environments. In summary, our contribution lies in the development of several context-aware AR applications that effectively sense users’ activities and facilitate users’ authoring process intuitively and conveniently.</p>

Cette thèse traite des interfaces utilisateur tangibles (TUI). La première partie de ce manuscrit concerne l'interaction tangible sur table interactive. Nous introduisons tout d'abord les TUIs et les tables interactives. Nous validons une hypothèse concernant la spécialisation de la forme des interacteurs tangibles et nous en tirons les conséquences pour la conception des TUIs. Nous proposons une solution de boîtier à boutons pour y déporter certaines opérations dans le contexte d'une TUI sur table interactive. Nous abordons la construction et le développement d'un système de tables interactives tangibles transportables et à faible coût permettant de faire du prototypage rapide de TUIs. Nous terminons en soulignant les particularités de l'évaluation expérimentale des TUIs. La seconde partie de ce manuscrit traite un cas d'application d'une TUI pour les géosciences : GeoTUI. Nous commençons par présenter le contexte métier des géophysiciens et leurs besoins en terme de nouveaux moyens d'interaction. Nous présentons les résultats de notre conception d'une TUI pour les géosciences. Nous précisons le détail du développement de notre prototype. Pour terminer, nous présentons les deux expérimentations utilisateurs qui ont été conduites pour valider nos choix de conception. / This thesis focuses on tangible user interfaces (TUI). The first part of this manuscript is about tangible interaction on tabletop. We first introduce TUIs and tabletops. We validate an hypothesis about the specialization of the form of the tangible objects, and conclude from that consequences on TUIs design. We propose the solution of a button box to deport some operations in the context of tabletop TUI. We present the construction and development of a transportable and low cost tabletop TUI system that allows rapid TUI prototyping. We end pointing out the special features of user experiments of TUIs. The second part of this manuscript deals with an application case of a TUI for geoscience: GeoTUI. We start presenting the context of the geophysicists work and their need in term of new way of interation. We present the results of our design of a TUI for geoscience. We detail the development of our prototype. To finish, we present two user experiments we conducted to validate our design choices.

[pt] Com a incorporação de recursos computacionais aos elementos físicos, a computação evolui para a ubiquidade e está presente nos elementos do ambiente físico. Casas, móveis e objetos do dia-a-dia, isto é, o ambiente que nos cerca, são as novas interfaces com as quais as pessoas interagem para colaborar e se informar. Essas novas interfaces implicam em um novo paradigma de interação, ainda pouco conhecido e explorado, como é o caso das Interfaces Tangíveis (Tangible User Interfaces - TUIs), que usam artefatos físicos para representação e controle de informações digitais. Desenvolver Interfaces Tangíveis requer combinar o trabalho voltado para o concreto (forma) com a abstração característica do desenvolvimento de software (comportamento). Este trabalho propõe um método denominado Prototipação Colaborativa de Tangíveis Baseada na Engenharia Semiótica, que combina as abordagens de prototipação e da Engenharia Semiótica no projeto de interfaces tangíveis. Ao combinar estas abordagens, o método agrega os benefícios da experimentação continuada de forma estruturada proporcionada pela prototipação com as vantagens do foco na comunicabilidade da Engenharia Semiótica no projeto de tangíveis. Um estudo de caso é conduzido a fim de investigar a contribuição do método proposto para incorporação da perspectiva da Engenharia Semiótica ao projeto de interfaces tangíveis. / [en] With the embedding of computing resources into physical elements, computing is moving toward ubiquity (or pervasiveness) and is present throughout the physical environment. Homes, furniture, and everyday life objects are the interfaces with which people now interact. Such new interfaces harbinger a new interaction paradigm that is little known and exploited to date, such as Tangible User Interfaces (TUIs) that use physical artefacts for representing and manipulating digital information. Developing TUIs means acknowledging both concrete (form) and abstract (behavior) aspects of an interface. This work proposes a method called Collaborative Tangible Prototyping Based on Semiotics Engineering that combines prototyping and Semiotic Engineering approaches to tangible interfaces design. By combining these approaches, the method brings together the benefits of continued structured experimentation provided by prototyping with the advantages of a focus on communicability from Semiotic Engineering for designing tangibles. A case study is conducted to investigate whether the proposed method contributes to incorporate the Semiotic Engineering perspective in the design of tangible user interfaces.

一個進步的文明城市，公共區域建築物內皆設有無障礙空間設施以照顧社會弱勢的族群，使這些族群享有同等使用社會資源的權利。同樣的，在電腦科技日新月異的當下，某些人在享受科技帶來的資訊及便利，某些人則因使用介面的障礙而無法同等享受其便利，因而形成人機介面所造成的數位障礙。 電腦虛擬世界和現實世界本是涇渭分明，由於電腦科技的進步及人們的需要在現實世界中擴增虛擬訊息成為可能。憑藉擴增實境的應用及使用者互動方面的研究，來改善人機介面造成的數位障礙，讓更多不同族群的人享有資訊科技帶來的好處。 上述的數位障礙中，最普遍的族群是幼年與年長者，其通常亦是最需要醫療照護的族群；因此本研究以一個醫療衛教為主題實例，著重預防重於治療的前提，研究醫護人員如何讓一般民眾了解特定疾病或傷害的基本知識；用於在平時或治療前、治療後的醫病溝通，欲有助於減少特定疾病引發一連串成本較高的治療程序，進而減少醫療資源的使用，使全民健保預算有效運用。 人機介面是為溝通真實世界與電腦虛擬世界，因此在本研究中以實例運用目前主流的圖形使用者介面(Graphic Uesr Interface, GUI)的操作模式下，提供以有形使用者介面(Tangible User Interface, TUI)，以一個腦部虛擬實境的衛教應用，加上擴增實境技術，將教材內容具象化、內容可視化、可操作化，建立一個數位弱勢族群(如老人、小孩)易於使用的互動介面環境。

This thesis falls into a field of user interface design. It focuses on tangible user interfaces which utilize a camera and projector to augment physical objects with a digital information. It also includes description of calibration of those devices. The primary object of this thesis is the implementation of an augmented user interface for application windows management. The system consists of a stationary camera, overhead projector and movable tangible objects - boards. The boards are equipped with fiducial markers, in order to be tracked in a camera image. The projector displays the conventional desktop onto the table and the tangible objects. For example, application windows can be projected onto some boards, while the windows move and rotate simultaneously with the boards.

過去，感知物件的互動方式大多發展於大型互動桌上，其技術主要是採用影像辨識來進行互動偵測，隨著平板的普及，我們希望能將大型互動桌的實體互動體驗帶到平板世界，然而現今平板使用之電容式觸控技術有別於大型互動桌之影像偵測技術，無法直接應用影像式的物件辨識方法，因此設計出一套結合平板電腦與感知物件的開發工具，目的是要讓互動設計的開發者能夠快速開發感知物件的互動模式。 而電容式實體互動物件設計較為複雜，對於互動設計的開發者而言，要去製作、開發這些互動物件不論是在電路或是實體物件都是有一定的難度，並不是所有的開發者都擁有相關的背景或是資源。而為了讓原型製作更加的簡單在軟體上我們設計了一套SDK，在硬體上結合了樂高積木和導電的膠帶，不僅製作快速、成本低，在組裝上也能擁有一致的規格以減少誤差的發生。藉由其底座組合方式的差異也就代表著不同的感知物件。因此開發者只需套用我們所設計的SDK就可以將原有的作品加上實體互動物件的互動模式。 / The Tangible User Interface (TUI) has been widely adopted on interactive tabletops by using optical sensing techniques and fiducial markers. With the huge growth of smartphone and tablet market, we hope to expand the tangible interaction experience to the off-the-shelf touch devices. However, most touch devices use capacitive sensing techniques that can only detect human fingers. We create a tangible hardware toolkit base on capacitive touch devices so developers can use it to build tangible interactions in a fast way. We put conductive adhesive tape on LEGO blocks to form an identifiable footprint. The footprint could be attached onto a tangible object. And the pattern of the footprint could be easily arranged to represent different identities. We also provide a flash SDK that can be quickly integrated into a developer’s project and then enable tangible interactions. We expect our hardware toolkit and software SDK can benefit more developers to create tangible UI applications on the capacitive touch devices.