The need to be economically successful is the key driver for companies to be innovative and implement new technologies with increasing efficiency and effectiveness. Uncertainty about whether to use new technologies and missing knowledge about their advantages lead to staggering and withholding from fast diffusion of innovations. Focusing on the industry of logistics and the technology Mixed Reality, this research project developed a methodical approach for evaluating the fitness of an innovative technology and a specific process of application. A mixed methods approach was derived, based on interviews and experiments. The main methodologies used, were semi-structured interviews with decision makers in logistics companies to elaborate triggering criteria in the investment process and laboratory experiments for the evaluation of competing technologies. These methods were framed by an initial field experiment and feedback interviews after the analysis for the validation of the approach. The research proved the competitively viable applicability of Mixed Reality and its specific strengths and weaknesses in manual order picking. This set the foundation for possible further development and implementation of the technology. The developed methodological approach proved to be a valid and reliable assessment of the intersection between a technology and specified process of application. This can greatly enhance the speed of implementing new innovations and gaining competitive advantages for companies.

This thesis addresses the subject of converging real and virtual environments to a combined entity that can facilitate physiologically complying interfaces for the purpose of training. Based on the mobility and physiological demands of dismounted soldiers, the base assumption is that greater immersion means better learning and potentially higher training transfer. As the user can interface with the system in a natural way, more focus and energy can be used for training rather than for control itself. Identified requirements on a simulator relating to physical and psychological user aspects are support for unobtrusive and wireless use, high field of view, high performance tracking, use of authentic tools, ability to see other trainees, unrestricted movement and physical feedback. Using only commercially available systems would be prohibitively expensive whilst not providing a solution that would be fully optimized for the target group for this simulator. For this reason, most of the systems that compose the simulator are custom made to facilitate physiological human aspects as well as to bring down costs. With the use of chroma keying, a cylindrical simulator room and parallax corrected high field of view video see-though head mounted displays, the real and virtual reality are mixed. This facilitates use of real tool as well as layering and manipulation of real and virtual objects. Furthermore, a novel omnidirectional floor and thereto interface scheme is developed to allow limitless physical walking to be used for virtual translation. A physically confined real space is thereby transformed into an infinite converged environment. The omnidirectional floor regulation algorithm can also provide physical feedback through adjustment of the velocity in order to synchronize virtual obstacles with the surrounding simulator walls. As an alternative simulator target use, an omnidirectional robotic platform has been developed that can match the user movements. This can be utilized to increase situation awareness in telepresence applications.

Ce mémoire de thèse de doctorat présente l'évaluation d'un système de réalité mixte dans le cadre d'une utilisation sur le site d'opération de construction. Il s'agit notamment de déterminer la pertinence d'un tel outil mobile pour des opérateurs pour les assister dans leurs tâches quotidiennes, et notamment dans la préparation et le suivi des opérations de construction ou rénovation. Cet outil se voudrait être un outil d'aide à la décision pour les maîtres d'ouvrages et maîtres d'œuvre. Le cas d'étude porte sur la rénovation virtuelle des baies anciennes (datées du XVIIIème siècle) dans une cellule des bâtiments conventuels de Cluny (Saône et Loire, France). L'approche consiste à comparer l'efficacité, la précision et la rapidité d'opérateurs dans la réalisation de tâches identiques. Trois méthodes liées à l'utilisation des nouvelles technologies dans le domaine de l'AIC (Architecture Ingénierie et Construction) sont comparées, elles ont guidé la définition du protocole expérimental. La première méthode traditionnelle fournit à l'opérateur de la documentation papier. La seconde met en œuvre la dématérialisation des données constructives, accessibles depuis un ordinateur de bureau. La troisième méthode plus innovante ajoute à la précédente l'accès colocalisé à la base de données grâce à un terminal mobile. Une étude qui a suivi a porté sur la visualisation et l'interprétation de résultats de simulation thermique, en réalité virtuelle. La comparaison des trois premières méthodes a donné lieu à une première expérimentation dont les résultats ont montré la légère prédominance du second scénario (travail sur ordinateur de bureau). Cependant, au-delà des aspects d'ergonomie et d'interface utilisateur, des investigations complémentaires doivent être menées pour étudier l'opportunité du développement du BIM in situ, c'est-à-dire l'utilisation du modèle de données du bâtiment (BIM- Building Information Model) sur le chantier. / This dissertation presents the evaluation of an onsite augmented reality tool and its relevance for helping construction agents to prepare and monitor the progress of a building's construction or renovation through a mobile device. The case study focuses on virtual renovation works regarding an ancient window –dated eighteenth century- in a room of the Cluny (Saone et Loire, France) abbey buildings. The study aims at comparing the efficiency and the precision of users' behavior in four situations while performing identical sets of tasks. Three methods related to the ICT uses of onsite AEC (Architecture, Engineering and Construction) guided the experiment: the first method focuses on paper-based content; the second method provides a digital model of the project on a workstation. The third method consists in using a full digital model with colocation access to the database on a mobile device. The fourth method considers working in an immersive room to interpret thermal simulation data. The result of this work is dedicated mainly as a decision-aid tool for project owners and constructors. The comparison between these methods led to a first experiment whose results favor the second method, which implies working on a desktop workstation. However, beyond the aspect of ergonomics and user interface, further investigations are necessary to study the propriety of using the Building Information Model (BIM) on the construction site.

Dieser Beitrag stellt die Mixed-Reality-in-the-Loop Simulation (MRiLS) zur Schulung technischer Fachkräfte im Maschinen- und Anlagenbau vor. Die MRiLS koppelt die aus dem Engineering bereits vorhandenen Modelle der Hardware-in-the-Loop Simulation (HiLS) mit Visualisierungs- und Interaktionsmethoden der Mixed Reality (MR) und integriert dadurch den Nutzenden und dessen Verhalten sowie die reale Umgebung vollständig in den Simulationskreislauf. Der Beitrag thematisiert neben der notwendigen Middleware zur Kopplung der HiLS mit der MR-Umgebung auch die Steuerungsbelastung durch Multiuser-Zugriffe. Die Funktionsfähigkeit des vorgestellten Konzepts wird anhand eines ausgewählten beispielhaften Automatisierungssystems belegt. Für das Automatisierungssystem wird der Aufbau der MRiLS sowie das Konzept für den Ablauf einer Schulung mittels MRiLS vorgestellt.