ServiceSketch is a collaborative tabletop tool for service design. It was developed to address some of the challenges designers face when developing service systems, including the dynamic, intangible nature of service and the complexity of coordinating multiple stakeholders over time and space. The concept for the tool draws from literature on service design, tangible user interfaces, and co-creation. It was also informed by user research sessions with graduate design students. The interface of ServiceSketch consists of a large multi-touch surface display that reacts to finger touches and a provided set of physical objects. Both the hardware and software development of ServiceSketch are described in this document. ServiceSketch was evaluated with groups of graduate design students who were asked to perform small group service design activities using the tool. These sessions showed that ServiceSketch was successful in supporting common service design processes and even inspired many participants to suggest possible future developments for the tool. ServiceSketch also seemed to encourage a playful, collaborative approach to service design. The results of the project hint at the possibilities for a new breed of service design tool, one that focuses on facilitating conversations about service through an engaging, interactive medium.

This thesis presents an exercise-based edutainment system intended for children. It is designed to enhance their cognitive development by encouraging movement in a fun way. The main idea behind the system is that children will have fun constructing a physical, tangible user interface. In addition, they will learn how to spell many words that represent objects and entities by stepping on a collection of coloured pads and receiving responses through a set of multimedia outputs related to these entities. For this purpose we have designed and implemented a tangible user interface that facilitates interaction with the system. This tangible user interface is called "SmartPads" and is composed of coloured tiles that can be physically connected to each other to form any shape. The pads are mapped onto a computer screen in real-time. A user interacts with the interface by stepping on the pads. We have incorporated two games that allow children of different ages to benefit from the system's functionalities and encourage them to interact with it. This thesis provides detailed information about the proposed system and its related components, discusses the design and development of the two games, and measures the system's performance when used by the children.

This thesis presents an exercise-based edutainment system intended for children. It is designed to enhance their cognitive development by encouraging movement in a fun way. The main idea behind the system is that children will have fun constructing a physical, tangible user interface. In addition, they will learn how to spell many words that represent objects and entities by stepping on a collection of coloured pads and receiving responses through a set of multimedia outputs related to these entities. For this purpose we have designed and implemented a tangible user interface that facilitates interaction with the system. This tangible user interface is called "SmartPads" and is composed of coloured tiles that can be physically connected to each other to form any shape. The pads are mapped onto a computer screen in real-time. A user interacts with the interface by stepping on the pads. We have incorporated two games that allow children of different ages to benefit from the system's functionalities and encourage them to interact with it. This thesis provides detailed information about the proposed system and its related components, discusses the design and development of the two games, and measures the system's performance when used by the children.

This Thesis explores the application of Tangible User Interfaces to Education. For this, a research study was conducted by building and testing an interactive game called Tangram Bridge. This Tangram based game was designed to teach players about basic physics principles such as balance, friction and motion on inclined planes. The focus of this Tangram Bridge is middle school physics, and therefore concerns children aged 11 years and up, their instructors and care givers. This research also lays a lot of emphasis on constructive play amongst children. Tangram Bridge is a versatile platform that can be scaled for younger or older populations A comparative study of existing Tangible User Interfaces ( TUIs) revealed opportunity spaces for this project. Through a compilation of related research in the fields of education, hands on learning, Tangible interaction and understanding play and learning amongst children, the constructionist views on learning are explored as guidelines for the design of this study. Through the analysis of comparative research studies, trends on TUI with relation to education emerged, informing the design process for Tangram Bridge. This research study discusses the application of Tangible user interfaces to education. It combines the research data collected through market research, user testing and literature reviews to explore the efficacy of TUI as teaching tool for abstract concepts that require imagination and experimentation.

This thesis explores how an Android application that is used in combination with tangible appcessories is capable of facilitating a learning experience for visually impaired students within the specific domain of geometry. This study’s approach illustrates how using an application in combination with a physical appcessory can provide information concerning geometry to the visually impaired. An application, called Invisible Tangible Geometry (ITG), was programmed using Android in conjunction with a 3D printed model. This thesis describes the application, the physical appcessory, as well as early stage user studies. The application enables visually impaired users to explore simple geometric forms displayed on a tablet through sound and vibrotactile feedback. A physical appcessory, that can be manipulated to adopt several forms and is dynamic, is used in addition. Its shape is sensed by the tablet adds an additional tactile layer to the application and experience. Within the thesis a methodological framework, as well as a user-centered design approach was applied. An expert interview and three user engagements with visually impaired individuals serve as early validations of the project and ideas and provide feedback that directs design and development of future work. Current avenues for the future work will include additional interaction modes in the application. For example, the ability to digitize real world forms, and improving the robustness of the tangible appcessory. The plan, for future development, is to establish an autonomous functioning application that enables the visually impaired to be able to explore, participate and interact with geometry smoothly and without the need of aid from others. The correlation of application and appcessory will allow for anything between a quick glance, through feeling the model, and gaining detailed information, by using the application. The application enhances provided information through the use of a model and enriched digital feedback.

This thesis focuses on the application of the tangible user interface and spatial augmented reality principals for playing board games. For this purpose, a system called interactive table was developed. It is both hardware and software solution. The hardware part solves the installation of a depth camera and a projector located above the table. The software solution deals with calibration of the depth camera and projector system using known procedures for camera calibration on the one hand, on the other hand it solves tasks from the field of computer vision. This perceptional part is the core of the whole thesis and for the purposes of playing board games it provides information about the location of the physical game object, physical game board and the calculations of mask for masking distracting objects. An educational application was developed for the purposes of demonstration of the system options. The interactive table offers new possibilities for playing board games in a real-world environment by the combination of the augmented reality elements with real-world objects and the related new user experience.

This paper explores interaction with lighting through a tangible user interface (TUI). In a TUI the physical object and space around it are part of the interface. A subset of tangible interaction called spatial interaction is the main focus of this paper. Spatial interaction refers to translation, rotation or location of objects or people within a space. The aim of this paper is to explore the relation between spatial inputs and lighting outputs based on different design properties. A user test is set up to explore the effect that design properties of a TUI have on the lighting output that participants map to spatial inputs. The results of the conducted user test indicate that communicating affordances to the user is an important factor when designing couplings between spatial inputs and lighting outputs. The results further show that the shape of the interface plays a central role in communicating those affordances and that the overlap of input and output space of the interface improves the clarity of the coupling. / Den här studien utforskar gripbar (tangible) interaktionsdesign med fokus på ljus och belysning. Vid användning av ett gripbart (tangible) gränssnitt används den fysiska miljön som gränssnitt. Detta skiljer sig till stor del från interaktion med ett grafiskt användargränssnitt, där alla interaktioner sker och begränsas av en skärms egenskaper. Denna studie fokuserar på rumslig (spatial) interaktionsdesign, vilket är en del av gripbar interaktionsdesign. Rumslig interaktion refererar till översättning, rotation eller plats av objekt eller människor i ett utrymme. Ett användartest har utförts för att testa vad för effekt olika rumsliga indata och designegenskaper har på förväntad utdata för ljus och belysning. Resultatet från användartestet visar att starka affordances och begränsningar, tillsammans med överlappningen av rumslig indata och utdata för ljus och belysning, är de viktigaste egenskaperna för att designa tydliga övergångar.

This thesis presents a new 3-dimensional (3D) user interface system for a Cave Automated Virtual Environment (CAVE) application, based on Virtual Reality (VR), Augmented Reality (AR), and Tangible User Interface (TUI). We explore fundamental 3D interaction tasks with our user interface for the CAVE system. User interface (UI) is comprised of a specific set of components, including input/output devices and interaction techniques. Our approach is based on TUIs using ARToolKit, which is currently the most popular toolkit for use in AR projects. Physical objects (props) are used as input devices instead of any tethered electromagnetic trackers. An off-the-shelf webcam is used to get tracking input data. A unique pattern marker is attached to the prop, which is easily and simply tracked by ARToolKit. Our interface system is developed on CAVE infrastructure, which is a semi-immersive environment. All virtual objects are directly manipulated with props, each of which corresponds to a certain virtual object. To navigate, the user can move the background itself, while virtual objects remain in place. The user can actually feel the prop's movement through the virtual space. Thus, fundamental 3D interaction tasks such as object selection, object manipulation, and navigation are performed with our interface. To feel immersion, the user is allowed to wear stereoscopic glasses with a head tracker. This is the only tethered device for our work. Since our interface is based on tangible input tools, seamless transition between one and two-handed operation is provided. We went through three design phases to achieve better task performance. In the first phase, we conducted the pilot study, focusing on the question whether or not this approach is applicable to 3D immersive environments. After the pilot study, we redesigned props and developed ARBox. ARBox is used for as interaction space while the CAVE system is only used for display space. In this phase, we also developed interaction techniques for fundamental 3D interaction tasks. Our summative user evaluation was conducted with ARDesk, which is redesigned after our formative user evaluation. Two user studies aim to get user feedback and to improve interaction techniques as well as interface tools' design. The results from our user studies show that our interface can be intuitively and naturally applied to 3D immersive environments even though there are still some issues with our system design. This thesis shows that effective interactions in a CAVE system can be generated using AR technique and tangible objects. / Master of Science

A inclusão de crianças com deficiência em escolas regulares, ocorrida seguindo a Lei 13.146 de 06 de julho de 2015, que institui a Lei Brasileira de Inclusão da Pessoa com Deficiência, exige que as atividades escolares sejam acessíveis a todas as crianças. Entre as atividades escolares, as atividades de programação têm se espalhado nas escolas devido aos benefícios gerados nas habilidades dos alunos, como criatividade e pensamento lógico. Atualmente, essas atividades utilizam principalmente ambientes de programação em blocos, como o Scratch, que focam em aspectos visuais para interação, contando com cores, formatos e utilização do mouse. Nesse contexto, e de grande importância o estudo de interfaces de programação para que crianças com deficiência visual possam ser incluídas e participem em conjunto com as outras crianças. Este projeto busca investigar este tema, bem como propor e avaliar um sistema para atividades de introdução à programação para crianças cegas e videntes. Foi proposto um sistema formado por peças tangíveis, em que os blocos digitais foram substituídos por peças físicas com formas para reconhecimento tátil e respostas auditivas. Foi adotado um modelo cíclico para o desenvolvimento do protótipo que garantiu duas etapas de testes com usuários. Na primeira etapa foram 4 participantes videntes, sendo que três participaram vendados, e a partir das observações foram gerados novos requisitos e modificações no protótipo. Na segunda etapa participaram 2 crianças cegas e os resultados destes testes geraram requisitos específicos para a utilização do sistema por crianças cegas. Este trabalho traz como contribuição final um conjunto de recomendações para o desenvolvimento de sistemas que permitam a crianças cegas e videntes brincarem juntas em atividades de programação. / The inclusion of children with disabilities in regular schools, following Law 13,146 of July 6, 2015, which establishes the Brazilian Law on the Inclusion of Persons with Disabilities, requires that school activities be accessible to all children. Among school activities, programming activities have spread in schools because of the benefits generated in students\' skills such as creativity and logical thinking. Currently, these activities mainly use blocks programming environments, such as Scratch, that focus on visual aspects for interaction, counting on colors, shapes and mouse usage. In this context, it is of great importance to study programming interfaces so that children with visual impairment can be included and participate together with other children. This project seeks to investigate this theme as well as to propose and evaluate a system for introductory programming activities for blind and sighted children. It was proposed a system formed by tangible pieces in which the digital blocks were replaced by physical pieces with forms for tactile recognition and auditory responses. It was adopted a cyclical model for the development of the prototype that guaranteed two stages of testing with users. In the first stage, four sighted participants, three were blindfolded among them, and and from the first observations were generated new requirements and modifications in the prototype. The second stage involved 2 blind children and the results of these tests generated specific requirements for the use of the system by blind children. This work brings as final contribution a set of recommendations for the development of systems that allow blind and sighted children to play together in programming activities.

A inclusão de crianças com deficiência em escolas regulares, ocorrida seguindo a Lei 13.146 de 06 de julho de 2015, que institui a Lei Brasileira de Inclusão da Pessoa com Deficiência, exige que as atividades escolares sejam acessíveis a todas as crianças. Entre as atividades escolares, as atividades de programação têm se espalhado nas escolas devido aos benefícios gerados nas habilidades dos alunos, como criatividade e pensamento lógico. Atualmente, essas atividades utilizam principalmente ambientes de programação em blocos, como o Scratch, que focam em aspectos visuais para interação, contando com cores, formatos e utilização do mouse. Nesse contexto, e de grande importância o estudo de interfaces de programação para que crianças com deficiência visual possam ser incluídas e participem em conjunto com as outras crianças. Este projeto busca investigar este tema, bem como propor e avaliar um sistema para atividades de introdução à programação para crianças cegas e videntes. Foi proposto um sistema formado por peças tangíveis, em que os blocos digitais foram substituídos por peças físicas com formas para reconhecimento tátil e respostas auditivas. Foi adotado um modelo cíclico para o desenvolvimento do protótipo que garantiu duas etapas de testes com usuários. Na primeira etapa foram 4 participantes videntes, sendo que três participaram vendados, e a partir das observações foram gerados novos requisitos e modificações no protótipo. Na segunda etapa participaram 2 crianças cegas e os resultados destes testes geraram requisitos específicos para a utilização do sistema por crianças cegas. Este trabalho traz como contribuição final um conjunto de recomendações para o desenvolvimento de sistemas que permitam a crianças cegas e videntes brincarem juntas em atividades de programação. / The inclusion of children with disabilities in regular schools, following Law 13,146 of July 6, 2015, which establishes the Brazilian Law on the Inclusion of Persons with Disabilities, requires that school activities be accessible to all children. Among school activities, programming activities have spread in schools because of the benefits generated in students\' skills such as creativity and logical thinking. Currently, these activities mainly use blocks programming environments, such as Scratch, that focus on visual aspects for interaction, counting on colors, shapes and mouse usage. In this context, it is of great importance to study programming interfaces so that children with visual impairment can be included and participate together with other children. This project seeks to investigate this theme as well as to propose and evaluate a system for introductory programming activities for blind and sighted children. It was proposed a system formed by tangible pieces in which the digital blocks were replaced by physical pieces with forms for tactile recognition and auditory responses. It was adopted a cyclical model for the development of the prototype that guaranteed two stages of testing with users. In the first stage, four sighted participants, three were blindfolded among them, and and from the first observations were generated new requirements and modifications in the prototype. The second stage involved 2 blind children and the results of these tests generated specific requirements for the use of the system by blind children. This work brings as final contribution a set of recommendations for the development of systems that allow blind and sighted children to play together in programming activities.