Developing head-mounted displays (HMD) that offer uncompromised optical pathways to both digital and physical worlds without encumbrance and discomfort confronts many grand challenges, both from technological perspectives and human factors. Among the many challenges, minimizing visual discomfort is one of the key obstacles. One of the key contributing factors to visual discomfort is the lack of the ability to render proper focus cues in HMDs to stimulate natural eye accommodation responses, which leads to the well-known accommodation-convergence cue discrepancy problem. In this paper, I will provide a summary on the various optical methods approaches toward enabling focus cues in HMDs for both virtual reality (VR) and augmented reality (AR).

User attitude and their perceptions are increasingly being explored by a variation of methods. This thesis addresses the perception that one might have for employing smart glasses as a potential online educational tool. Furthermore, it explores the challenges that are associated with designing educational apps for smart glasses as a medium for e-learning in general. For addressing and identifying these challenges and exploring user attitude, this thesis employs two different approaches. Firstly, by identifying the current challenges associated with e-learning in literature-related studies and secondly, based on the related literature surrounding the topic of e-learning and augmented reality, this thesis conducts a field study using semi-structured interviews. This study proposes the final conclusion based on the field study and by reviewing identified challenges in literature.

This Master Thesis analyzes how augmented reality (AR) can be used as assistance for a warehouse truck driver in order to make the driver more safe and efficient. The working environment is observed in an everyday warehouse and solutions are developed for situations based on observations. The AR solutions for the situations will be developed and evaluated. The software will be made for a pair of android see-through AR-glasses. Based on user tests and internal evaluation, the solutions will be evaluated for usage in the industry today or in the future.

This thesis evaluates how a head mounted display (HMD) can be used to increase usability compared to existing computer programs that are used during maintenance work on vehicles. Problems identified during a case study in a vehicle workshop are first described. As an attempt to solve some of the identified problems a prototype application using a HMD was developed. The prototype application aids the user during troubleshooting of systems on the vehicle by leading the mechanic with textual information and augmented reality (AR). Assessment of the prototype application was done by comparing it to the existing computer program and measuring error rate and time to completion for a predefined task. Usability was also measured using the System Usability Scale. The assessment showed that HMDs can provide higher usability in terms of efficiency and satisfaction. Furthermore, the thesis describes and discusses other possibilities and limitations that usage of HMDs and AR can lead to that were identified both from theory and during implementation.

Sjukvården är ett område som man ständigt försöker förbättra med ny teknik för att kunna ge bättre vård och rädda fler liv. En teknik som på senaste åren hamnat allt mer i fokus inom sjukvården är Augmented Reality. Det här arbetet har utförts med målet att utveckla en heuristisk utvärderingsmetod som ska kunna appliceras på Augmented Reality-teknik inom prehospital vård. För att nå målet så utvecklades en Augmented Reality-prototyp som till plattformen Google Glass. Med hjälp av resultat från användartester av prototypen som genomförts av sjukvårdare så utvecklades en lista bestående av 11 stycken heuristiker. Heuristikerna har använts för att utvärdera prototypen som utvecklades och heuristikerna var effektiva för att hitta designproblem hos prototypen.

Die vorliegende Arbeit untersucht das Potenzial von Augmented Reality zur Verbesserung von Image Retrieval Prozessen. Herausforderungen in Design und Gebrauchstauglichkeit wurden für beide Forschungsbereiche dargelegt und genutzt, um Designziele für Konzepte zu entwerfen. Eine Taxonomie für Image Retrieval in Augmented Reality wurde basierend auf der Forschungsarbeit entworfen und eingesetzt, um verwandte Arbeiten und generelle Ideen für Interaktionsmöglichkeiten zu strukturieren. Basierend auf der Taxonomie wurden Anwendungsszenarien als weitere Anforderungen für Konzepte formuliert. Mit Hilfe der generellen Ideen und Anforderungen wurden zwei umfassende Konzepte für Image Retrieval in Augmented Reality ausgearbeitet. Eins der Konzepte wurde auf einer Microsoft HoloLens umgesetzt und in einer Nutzerstudie evaluiert. Die Studie zeigt, dass das Konzept grundsätzlich positiv aufgenommen wurde und bietet Erkenntnisse über unterschiedliches Verhalten im Raum und verschiedene Suchstrategien bei der Durchführung von Image Retrieval in der erweiterten Realität. / The present work investigates the potential of augmented reality for improving the image retrieval process. Design and usability challenges were identified for both fields of research in order to formulate design goals for the development of concepts. A taxonomy for image retrieval within augmented reality was elaborated based on research work and used to structure related work and basic ideas for interaction. Based on the taxonomy, application scenarios were formulated as further requirements for concepts. Using the basic interaction ideas and the requirements, two comprehensive concepts for image retrieval within augmented reality were elaborated. One of the concepts was implemented using a Microsoft HoloLens and evaluated in a user study. The study showed that the concept was rated generally positive by the users and provided insight in different spatial behavior and search strategies when practicing image retrieval in augmented reality.

Abstract Traditional telepresence systems are comprised of a person remotely controlling a robot in a hostile environment while receiving visual feedback from a camera mounted on the robot. While useful for a number of applications, this model is not particularly useful for everyday work applications. The size of the robot is intrusive, the robot needs to be designed for specific interactions and only one person can use the robot at any one time. This work seeks to address this problem by replacing the physical proxy with a virtual proxy. The purpose of this virtual proxy is to enhance the system by providing improved support for multiple users, interaction and navigation in the remote environment. This enhanced, or improved, version of telepresence is termed TeleReality as it combines elements of virtual reality with traditional telepresence technologies. To achieve this goal, the basic building blocks, or constructs, of traditional telepresence systems need to be changed. This thesis identifies and evaluates the base constructs needed to build any TeleReality system. These constructs include the need to support navigation of the remote environment and this is achieved by using a network of cameras and image processing software to calculate the various perspective viewpoints of the users. These constructs govern the means in which this collection of cameras are organised and connected. Each user receives a common set of video images from which they calculate their own perspective viewpoints, and consequently supporting a multi-user system. Interaction within the remote environment is promoted using ad-hoc networks and augmented reality technologies. Constructs also cover security and privacy issues that arise from using multiple cameras by adopting both an organisational and technological viewpoint. The focus is on establishing trust within the system by divesting control to the user. An example of these constructs is given by the implementation of a TeleReality model called a 'Visual Cell' system. The conclusion of this work identifies the constructs that are needed to support a telepresence system using a virtual proxy where the primary interaction framework is informational exchange, although physical interaction can also be supported depending upon the environmental support. This work also identifies the technical issues that require additional research for the implementation of a TeleReality system, from the need for improved image processing, video codec's, broadcast and ad-hoc security protocols, software architecture, registration and the availability of suitable head mounted displays.

Motivation: Today’s sustainability challenges are increasingly being addressed by Product Service Systems to satisfy customers needs while lowering their overall environment impact. These systems are increasingly complex containing diverse artifacts and interactions. To provide a holistic solution centered on the human experience element, design of product-service systems are best driven by data gathered from design thinking methods.     Problem: When considering innovation challenges, such as the deployment of autonomous electric machines on future construction sites, data driven design can suffer from a lack of available tangible user feedback upon which to make design decisions.   Approach: In the case of this study, the development of a scaled down construction site structured around generally applicable operations was built as a prototype for involving various users in early phase development of a HMI for interacting with prototype machines built by Volvo CE called the HX01. Qualitative data acquisition methods were derived from Design Thinking approaches to needfinding including: a questionnaire, unstructured interviews and observations.   Results: The prototype scale site became a 5 meter x 5 meter semi-portable site with 1:11 scale ratio machines including: excavators, wheeled loaders and autonomous haulers. The product tested with the site was an augmented reality interface to provide a communication platform between workers and the autonomous haulers designed at building trust to enable collaboration. Test users and observers provided feedback confirming the effectiveness of the scale site scenario to convey the necessary context of a realistic interaction experience. Beyond HMI testing, the site served as a tangible artifact to instigate conversations across domain boundaries.   Conclusions: The tangible experiential scenario platform developed displayed the capability to go beyond one-way concept communication of concepts to customers, by including customers as integral participants in the testing of new products/services. For design teams, the site can facilitate deeper learnings and validation via a shared contextualization of user feedback. The further implications may also include: the ability to increase rationale at design decision gate’s assessment of risk in new products and enable the identification of emergent issues in complex future scenarios.

Abstract Old age brings several physical and cognitive challenges for elderly people, which complicates the utilization of modern information and communication technology (ICT) for daily task assistance and for caretakers and family support. One factor hindering the adoption of ICT is that most existing user interfaces (UIs) require prior knowledge of use metaphors that many elderly people cannot learn to master. Research on developing assistive technology exists, such as phones for the elderly, but these often have UIs that require prior knowledge and use experience. Recent research has introduced Ambient Assisted Living (AAL) concepts for users’ homes, for example projecting guidance into the environment. However, only a few empirical studies have attempted to define the type of projection-based UIs that would be intuitive for the elderly, and the system design processes that would help in developing such AAL have not been researched thoroughly. This work presents three design iterations and their empirical evaluations. From these, a body of knowledge was produced for designing and developing AALs with projected Augmented Reality (AR) UIs. The first iteration had a sentence-building UI implemented for a wearable Projector-Camera (ProCam) system, which had limits in technical suitability for the elderly. The second iteration changed the use metaphor to a simple icon-based menu, and produced a requirement guideline for UIs in AAL. In the final iteration, the wearable was replaced with a fixed ProCam, allowing the elderly to make menu selections effectively. This iteration supported sequential tasks, such as taking medicine, with visual guides. The suitability of the new UI was tested with computer literate young adults and elderly users, many of the latter having memory and motor skill limitations. The comparison showed that the two groups performed similarly; however, the elderly needed a slower and more direct interaction technique adapted to their preferences in the UI. Assistance for the sequential tasks was found feasible. This work produced a set of UI-related and technical factors that AAL designers should take into account when developing projector-based AR systems for the elderly with memory problems. In addition, this work offers suggestions on how to conduct UI testing sessions with this user group to reduce the amount of work and improve the success of the iterative development process. / Tiivistelmä Ikääntyminen tuo useita fyysisiä ja kognitiivisia haasteita teknologian käytölle mikä puolestaan mutkistaa modernin informaatioteknologian käyttöä hoivatyöntekijöiden ja omaisten tukemana päivittäisten askareiden tukemisessa. Yksi este käytölle on käyttöliittyminen hallitsemiseen tarvittava osaaminen mitä vanhuksilla on haastavaa oppia. Avustavan teknologian tutkimusta on olemassa laitteille kuten vanhusten käyttöön suunnitellut matkapuhelimet jotka tarvitsevat tietämystä ja aiempia käyttökokemuksia. Uusimmat tutkimukset esittävät tietotekniikka-avusteisen asuminen mahdollisuuksia käyttäjien koteihin esimerkiksi projisoitujen opastuksien muodossa, mutta vain muutamia empiirisiä tutkimuksia on tehty määrittelemään kuinka projektiopohjaiset käyttöliittymät voisivat olla intuitiivisia vanhuksille, ja tutkimuksia kuinka näiden systeemien suunnitteluprosessit voisivat avustaa tietotekniikka-avusteisen asumisen suunnittelijoille ei ole tuotettu tarpeeksi. Tämä työ esittelee kolmen iteroinnin ja empiirisen arvioinnin luoman tietämysperustan kautta ratkaisuja systeemien suunnittelun ja luonnin tarpeisiin projektiopohjaisen lisätyn todellisuuden käyttöliittymien luomiseksi. Ensimmäisen iteroinnin tulos on lauserakenteeseen pohjautuva käyttöliittymä päälle puettavalle projektiojärjestelmälle, jonka todettiin omaavan teknisiä puutteita vanhuskäyttöön. Toinen iterointi esittelee ikonipohjaisen käyttöliittymän ja tuottaa vaatimusmäärittelyohjeistuksia käyttöliittymille. Viimeisessä iteroinnissa korvataan päälle puettava kiinteästi asennetulla järjestelmällä, joka mahdollistaa vanhuksille tehokkaamman valintamenetelmän valikoille, sekä tukee sarjamuotoisten tehtävien suorittamista visuaalisia ohjeistuksia käyttäen esimerkiksi lääkkeen annostelun tukemisessa. Käytön soveltuvuutta vertailtiin tehokäyttäjien ja vanhusten, joilla on usein motoriikan ja kognition ongelmia, kesken, ja vaikka nämä kaksi ryhmää ovat hyvin samankaltaisia on vanhuksille sopivampi menetelmä hitaampi ja perustuu suoraan interaktioon. Myös sarjamuotoisen tehtävän suorituksen tukeminen osoittautui saavutettavaksi. Tämä työ tuotti käyttöliittymien ja teknisten toteutusten suunnitteluun tarkoitettuja ohjeistuksia joita tietotekniikka-avusteisen asumisen suunnittelijoiden tulisi ottaa huomioon projektiopohjaisten lisätyn todellisuuden järjestelmien kehittämisessä muistihäiriöisten vanhusten tarpeisiin. Lisäksi suosituksia käyttäjätestien luomiseen tämän käyttäjäryhmän kesken ehdotetaan jolla voidaan vähentää työmäärää sekä parantaa oikein iteratiivista prosessia.

The goal of this thesis is to develop a smartphone application for augmented reality view; it is an initial attempt to realize a driver assistance functionality using just a smartphone and an external lens. Initially it depicts a brief analysis about the most feasible development technologies for mobile application development, selecting a proper lens and positioning of the smartphone in the car. Later, it discusses the strategies for real-time object detection using OpenCV; the video frames are processed using the strategies to find patterns in the videos. Different techniques like Hough-line transform, watershed, contour detection, color segmentation, color thresholding and HAAR cascades are implemented and compared in terms of real time detection of the desired objects. Then a unified algorithm is implemented for the given scenario which overcomes the challenges faced during the conceptualization phase. Finally, the results are depicted with the snapshots of the real time detection done from the smartphone and then evaluated against the vision of the application and the achieved tasks. This thesis is concluded by stating the prospects of this mobile application in the future.