In virtual worlds, designers often consider "real walking" to be the gold standard when it comes to locomotion, as shown by attempts to incorporate walking techniques within tasks. When real walking is not conceivable due to several different limitations of virtual interactions (space, hardware, tracking, etc.) a walking simulation technique is sometimes used. We call these moderate interaction fidelity techniques and based upon literature, we can speculate that they will often provide an inferior experience if compared to a technique of high or low fidelity. We believe that there is an uncanny valley which is formed if a diagram is created using interaction fidelity and user effectiveness. Finding more points on this graph would help to support claims we have made with our hypothesis. There are several studies done previously in the field of virtual reality, however a vast majority of them considered interaction fidelity as a single construct. We argue that interaction fidelity is more complex involving independent components, with each of those components having an effect of the actual effectiveness of an interface. In addition, the intention of the designer can also have influence on how effective an interface can be. In this study we are going to be doing a deeper look into devices which attempt to overcome the limitations of physical space which we will call semi-natural interfaces. Semi-natural interfaces are sometimes difficult to use at first due to mismatch of cues or possibly due to a lack of fidelity, but training has been shown to be beneficial to overcome this difficulty. As of today, designers have not yet found a fully general solution to walking in large virtual environments. / Master of Science

Esta dissertação investiga os efeitos da imersão física em jogos sérios com propósitos de aprendizado perceptivo. O principal objetivo é identificar um conjunto de orientações de design para ajudar desenvolvedores a escolher o nível apropriado de imersão a ser usado em jogos sérios a fim de assegurar que o jogo seja efetivo e confortável para os usuários. A hipótese principal é que altos níveis de imersão melhoram os resultados dos jogos sérios, mas níveis de imersão moderados também podem ser adequados com a vantagem de que causa menos mal-estar nos usuários. Nós organizamos uma revisão da literatura para melhor entender como a imersão física está sendo usada atualmente em jogos sérios, como a efetividade tem sido avaliada, e como a imersão afeta os resultados do jogo e a usabilidade. Então, nós conduzimos dois estudos de usuário empíricos para investigar os efeitos da fidelidade de display, interação e locomoção na percepção dos usuários e retenção de conhecimento. Para os experimentos, nós adaptamos um jogo sério previamente desenvolvido para análise de percepção de riscos, e desenvolvemos um novo jogo para educar trabalhadores sobre procedimentos de segurança que precisam ser seguidos durante instalações elétricas na linha de manutenção elétrica. Os resultados mostraram que, em geral, a fidelidade de display tem impacto na percepção de riscos quando procurando por riscos que não são óbvios. Alta fidelidade de display tem melhor desempenho na identificação de riscos complexos. A fidelidade de locomoção e interação não apresentou diferenças significantes no aprendizado perceptivo. Alta fidelidade também apresentou maior workload, mas nas mesmas condições a corretividade das tarefas foi maior e os participantes lembraram dos procedimentos tanto no pós-teste quanto no teste de retenção. Portanto, a retenção de conhecimento não foi afetada pelo workload introduzido pela técnica interativa. A partir destes experimentos, nós elaboramos e discutimos um conjunto de orientações de design que podem ser considerados para a escolha do nível apropriado de imersão física para ser usado no desenvolvimento de novos jogos sérios. / Nowadays, several application areas are adopting serious games as an ethical, safe and low-cost alternative to performing dangerous tasks, such as training of firefighters, and for medical surgeries. The employment of Virtual Reality in serious games helps to provide virtual environments much more realistic and better immersive experiences to the user. However, some VR systems can still cause sickness symptoms, such as nausea and headaches, and some of them can be expensive, such as CAVEs. This thesis investigates the effects of physical immersion on serious games with perceptual learning purposes. Its main goal is to identify a set of design guidelines to help developers on choosing the appropriate level of immersion to be used in serious games in order to assure it is effective and comfortable for users. The main hypothesis is that higher levels of immersion improve serious games outcomes, but moderate immersion may be also adequate with the advantage of causing less simulation sickness on users. We organized a survey of the literature to better understand how physical immersion is being currently used on serious games, how its effectiveness has been assessed, and how immersion impacts on the game outcomes and usability. Then, we conducted two empirical user studies looking for investigating the effects of the display, interaction and locomotion fidelity on users’ perception and knowledge retention. For the experiments, we adapted a serious game previously developed for risk assessment and developed a new one to educate workers in electricity-line maintenance on safety procedures that need to be followed during electric installations. Results showed that, in general, display fidelity has an effect on risk perception when searching for non-obvious risks. Higher display fidelity has better performance on complex risks identification. Interaction and locomotion fidelity did not show a significant difference in perceptual learning. Naturalness also presented higher workload, but in the same conditions the correctness of tasks was high and subjects recall the procedures in both post- and retention-test. Therefore, knowledge retention is not impacted by the workload imposed by the interactive technique. From these experiments, we elaborated and discussed a set of design guidelines that can be considered for the choice of the appropriate physical immersion to be used on the development of new serious games.

Esta dissertação investiga os efeitos da imersão física em jogos sérios com propósitos de aprendizado perceptivo. O principal objetivo é identificar um conjunto de orientações de design para ajudar desenvolvedores a escolher o nível apropriado de imersão a ser usado em jogos sérios a fim de assegurar que o jogo seja efetivo e confortável para os usuários. A hipótese principal é que altos níveis de imersão melhoram os resultados dos jogos sérios, mas níveis de imersão moderados também podem ser adequados com a vantagem de que causa menos mal-estar nos usuários. Nós organizamos uma revisão da literatura para melhor entender como a imersão física está sendo usada atualmente em jogos sérios, como a efetividade tem sido avaliada, e como a imersão afeta os resultados do jogo e a usabilidade. Então, nós conduzimos dois estudos de usuário empíricos para investigar os efeitos da fidelidade de display, interação e locomoção na percepção dos usuários e retenção de conhecimento. Para os experimentos, nós adaptamos um jogo sério previamente desenvolvido para análise de percepção de riscos, e desenvolvemos um novo jogo para educar trabalhadores sobre procedimentos de segurança que precisam ser seguidos durante instalações elétricas na linha de manutenção elétrica. Os resultados mostraram que, em geral, a fidelidade de display tem impacto na percepção de riscos quando procurando por riscos que não são óbvios. Alta fidelidade de display tem melhor desempenho na identificação de riscos complexos. A fidelidade de locomoção e interação não apresentou diferenças significantes no aprendizado perceptivo. Alta fidelidade também apresentou maior workload, mas nas mesmas condições a corretividade das tarefas foi maior e os participantes lembraram dos procedimentos tanto no pós-teste quanto no teste de retenção. Portanto, a retenção de conhecimento não foi afetada pelo workload introduzido pela técnica interativa. A partir destes experimentos, nós elaboramos e discutimos um conjunto de orientações de design que podem ser considerados para a escolha do nível apropriado de imersão física para ser usado no desenvolvimento de novos jogos sérios. / Nowadays, several application areas are adopting serious games as an ethical, safe and low-cost alternative to performing dangerous tasks, such as training of firefighters, and for medical surgeries. The employment of Virtual Reality in serious games helps to provide virtual environments much more realistic and better immersive experiences to the user. However, some VR systems can still cause sickness symptoms, such as nausea and headaches, and some of them can be expensive, such as CAVEs. This thesis investigates the effects of physical immersion on serious games with perceptual learning purposes. Its main goal is to identify a set of design guidelines to help developers on choosing the appropriate level of immersion to be used in serious games in order to assure it is effective and comfortable for users. The main hypothesis is that higher levels of immersion improve serious games outcomes, but moderate immersion may be also adequate with the advantage of causing less simulation sickness on users. We organized a survey of the literature to better understand how physical immersion is being currently used on serious games, how its effectiveness has been assessed, and how immersion impacts on the game outcomes and usability. Then, we conducted two empirical user studies looking for investigating the effects of the display, interaction and locomotion fidelity on users’ perception and knowledge retention. For the experiments, we adapted a serious game previously developed for risk assessment and developed a new one to educate workers in electricity-line maintenance on safety procedures that need to be followed during electric installations. Results showed that, in general, display fidelity has an effect on risk perception when searching for non-obvious risks. Higher display fidelity has better performance on complex risks identification. Interaction and locomotion fidelity did not show a significant difference in perceptual learning. Naturalness also presented higher workload, but in the same conditions the correctness of tasks was high and subjects recall the procedures in both post- and retention-test. Therefore, knowledge retention is not impacted by the workload imposed by the interactive technique. From these experiments, we elaborated and discussed a set of design guidelines that can be considered for the choice of the appropriate physical immersion to be used on the development of new serious games.

Esta dissertação investiga os efeitos da imersão física em jogos sérios com propósitos de aprendizado perceptivo. O principal objetivo é identificar um conjunto de orientações de design para ajudar desenvolvedores a escolher o nível apropriado de imersão a ser usado em jogos sérios a fim de assegurar que o jogo seja efetivo e confortável para os usuários. A hipótese principal é que altos níveis de imersão melhoram os resultados dos jogos sérios, mas níveis de imersão moderados também podem ser adequados com a vantagem de que causa menos mal-estar nos usuários. Nós organizamos uma revisão da literatura para melhor entender como a imersão física está sendo usada atualmente em jogos sérios, como a efetividade tem sido avaliada, e como a imersão afeta os resultados do jogo e a usabilidade. Então, nós conduzimos dois estudos de usuário empíricos para investigar os efeitos da fidelidade de display, interação e locomoção na percepção dos usuários e retenção de conhecimento. Para os experimentos, nós adaptamos um jogo sério previamente desenvolvido para análise de percepção de riscos, e desenvolvemos um novo jogo para educar trabalhadores sobre procedimentos de segurança que precisam ser seguidos durante instalações elétricas na linha de manutenção elétrica. Os resultados mostraram que, em geral, a fidelidade de display tem impacto na percepção de riscos quando procurando por riscos que não são óbvios. Alta fidelidade de display tem melhor desempenho na identificação de riscos complexos. A fidelidade de locomoção e interação não apresentou diferenças significantes no aprendizado perceptivo. Alta fidelidade também apresentou maior workload, mas nas mesmas condições a corretividade das tarefas foi maior e os participantes lembraram dos procedimentos tanto no pós-teste quanto no teste de retenção. Portanto, a retenção de conhecimento não foi afetada pelo workload introduzido pela técnica interativa. A partir destes experimentos, nós elaboramos e discutimos um conjunto de orientações de design que podem ser considerados para a escolha do nível apropriado de imersão física para ser usado no desenvolvimento de novos jogos sérios. / Nowadays, several application areas are adopting serious games as an ethical, safe and low-cost alternative to performing dangerous tasks, such as training of firefighters, and for medical surgeries. The employment of Virtual Reality in serious games helps to provide virtual environments much more realistic and better immersive experiences to the user. However, some VR systems can still cause sickness symptoms, such as nausea and headaches, and some of them can be expensive, such as CAVEs. This thesis investigates the effects of physical immersion on serious games with perceptual learning purposes. Its main goal is to identify a set of design guidelines to help developers on choosing the appropriate level of immersion to be used in serious games in order to assure it is effective and comfortable for users. The main hypothesis is that higher levels of immersion improve serious games outcomes, but moderate immersion may be also adequate with the advantage of causing less simulation sickness on users. We organized a survey of the literature to better understand how physical immersion is being currently used on serious games, how its effectiveness has been assessed, and how immersion impacts on the game outcomes and usability. Then, we conducted two empirical user studies looking for investigating the effects of the display, interaction and locomotion fidelity on users’ perception and knowledge retention. For the experiments, we adapted a serious game previously developed for risk assessment and developed a new one to educate workers in electricity-line maintenance on safety procedures that need to be followed during electric installations. Results showed that, in general, display fidelity has an effect on risk perception when searching for non-obvious risks. Higher display fidelity has better performance on complex risks identification. Interaction and locomotion fidelity did not show a significant difference in perceptual learning. Naturalness also presented higher workload, but in the same conditions the correctness of tasks was high and subjects recall the procedures in both post- and retention-test. Therefore, knowledge retention is not impacted by the workload imposed by the interactive technique. From these experiments, we elaborated and discussed a set of design guidelines that can be considered for the choice of the appropriate physical immersion to be used on the development of new serious games.

In recent years, consumers have witnessed a technological revolution that has delivered more-realistic experiences in their own homes. Expanding technologies have provided larger displays with higher resolutions, faster refresh rates, and stereoscopic capabilities. These advances have increased the level of display fidelity—the objective degree of exactness with which real-world sensory stimuli are reproduced by a display system. Similarly, the latest generation of video game systems (e.g., Nintendo Wii and Xbox Kinect) with their natural, gesture-based interactions have delivered increased levels of interaction fidelity—the objective degree of exactness with which real-world interactions can be reproduced in an interactive system. Though this technological revolution has provided more realistic experiences, it is not completely clear how increased display fidelity and interaction fidelity impact the user experience because the effects of increasing fidelity to the real world have not been empirically established. The goal of this dissertation is to provide a better understanding of the effects of both display fidelity and interaction fidelity on the user experience. For the context of our research, we chose virtual reality (VR) games because immersive VR allows for high levels of fidelity to be achieved while games usually involve complex, performance-intensive tasks. In regard to the user experience, we were concerned with objective performance metrics and subjective responses such as presence, engagement, perceived usability, and overall preferences. We conducted five systematically controlled studies that evaluated display and interaction fidelity at contrasting levels in order to gain a better understanding of their effects. In our first study, which involved a 3D object manipulation game within a three-sided CAVE, we found that stereoscopy and the total size of the visual field surrounding the user (i.e., field of regard or FOR) did not have a significant effect on manipulation times but two high-fidelity interaction techniques based on six degrees-of-freedom (DOF) input outperformed a low-fidelity technique based on keyboard and mouse input. In our second study, which involved a racing game on a commercial game console, we solely investigated interaction fidelity and found that two low-fidelity steering techniques based on 2D joystick input outperformed two high-fidelity steering techniques based on 3D accelerometer data in terms of lap times and driving errors. Our final three studies involved a first-person shooter (FPS) game implemented within a six-sided CAVE. In the first of these FPS studies, we evaluated display fidelity and interaction fidelity independently, at extremely high and low levels, and found that both significantly affected strategy, performance, presence, engagement, and perceived usability. In particular, performance results were strongly in favor of two conditions: low-display, low-interaction fidelity (representative of desktop FPS games) and high-display, high-interaction fidelity (similar to the real world). In the second FPS study, we investigated the effects of FOR and pointing fidelity on the subtasks of searching, aiming, and firing. We found that increased FOR affords faster searching and that high-fidelity pointing based on 6-DOF input provided faster aiming than low-fidelity mouse pointing and a mid-fidelity mouse technique based on the heading of the user. In the third FPS study, we investigated the effects of FOR and locomotion fidelity on the subtasks of long-distance navigation and maneuvering. Our results indicated that increased FOR increased perceived usability but had no significant effect on actual performance while low-fidelity keyboard-based locomotion outperformed our high-fidelity locomotion technique developed for our original FPS study. The results of our five studies show that increasing display fidelity tends to have a positive correlation to user performance, especially for some components such as FOR. Contrastingly, our results have indicated that interaction fidelity has a non-linear correlation to user performance with users performing better with "traditionalThe results of our five studies show that increasing display fidelity tends to have a positive correlation to user performance, especially for some components such as FOR. Contrastingly, our results have indicated that interaction fidelity has a non-linear correlation to user performance with users performing better with "traditional", extremely low-fidelity techniques and "natural", extremely high-fidelity techniques while performing worse with mid-fidelity interaction techniques. These correlations demonstrate that the display fidelity and interaction fidelity continua appear to have differing effects on the user experience for VR games. In addition to learning more about the effects of display fidelity and interaction fidelity, we have also developed the Framework for Interaction Fidelity Analysis (FIFA) for comparing interaction techniques to their real-world counterparts. There are three primary factors of concern within FIFA: biomechanical symmetry, control symmetry, and system appropriateness. Biomechanical symmetry involves the comparison of the kinematic, kinetic, and anthropometric aspects of two interactions. Control symmetry compares the dimensional, transfer function, and termination characteristics of two interactions. System appropriateness is concerned with how well a VR system matches the interaction space and objects of the real-world task (e.g., a driving simulator is more appropriate than a 2D joystick for a steering task). Although consumers have witnessed a technological revolution geared towards more realistic experiences in recent years, we have demonstrated with this research that there is still much to be learned about the effects of increasing a system's fidelity to the real world. The results of our studies show that the levels of display and interaction fidelity are significant factors in determining performance, presence, engagement, and usability. / Ph. D.