The objects with which the hand interacts with may significantly change the dynamics of the arm. How does the brain adapt control of arm movements to this new dynamic? We show that adaptation is via composition of a model of the task's dynamics. By exploring generalization capabilities of this adaptation we infer some of the properties of the computational elements with which the brain formed this model: the elements have broad receptive fields and encode the learned dynamics as a map structured in an intrinsic coordinate system closely related to the geometry of the skeletomusculature. The low--level nature of these elements suggests that they may represent asset of primitives with which a movement is represented in the CNS.

As mobile devices still have limited battery life, processing power, memory, and display size, they cannot yet execute gaming applications with the same fidelity and quality as their PC counterparts. In response, researchers have recently performed research with the goal of the real-time delivery of game content specifically to fit within mobile devices’ limitations. In this thesis, we present a novel approach to tackling the streaming of objects to mobile devices. Our goal is to reduce the number of objects subject to streaming from the server to the target devices, while not violating the user-defined limitations through an efficient, context-aware 3D object selection and prioritization scheme. We take advantage of the game context to stream only the most relevant objects. Our evaluations have shown that this technique not only leads to better performance in general, but also increases the gameplay experience by helping the player to achieve a higher score.

As mobile devices still have limited battery life, processing power, memory, and display size, they cannot yet execute gaming applications with the same fidelity and quality as their PC counterparts. In response, researchers have recently performed research with the goal of the real-time delivery of game content specifically to fit within mobile devices’ limitations. In this thesis, we present a novel approach to tackling the streaming of objects to mobile devices. Our goal is to reduce the number of objects subject to streaming from the server to the target devices, while not violating the user-defined limitations through an efficient, context-aware 3D object selection and prioritization scheme. We take advantage of the game context to stream only the most relevant objects. Our evaluations have shown that this technique not only leads to better performance in general, but also increases the gameplay experience by helping the player to achieve a higher score.

Within Virtual Reality Environments (VREs), spatial relationships among objects convey fundamental knowledge about the environment, namely direction ("left", "right", "front of"), distance ("near", "far"), topology ("inside", "disjoint"), and projection ("between", "surrounded by"). Modelling spatial relationships is critical in a variety of applications of VREs, such as human learning environments, virtual museums, or navigation-aids systems. However, spatial relationships have been considered as abstract information and thus, difficult to specify. Addressing this issue, this thesis proposes an approach to model spatial relationships among virtual objects in VREs. First, we formalise a formal model of spatial relationships dedicated to VREs. Second, we provide a language and a framework to specify spatial relationships at a conceptual level. Finally, we apply our model to specify spatial relations in two real applications: Virtual Physics Laboratory -- a VRE for learning physics, and BrestCoz -- an application for visiting Brest harbour in the 18th century. We claim that the proposed language is a relevant basis to specify spatial constraints related to activities of agents and users within VREs.

Interactive narratives are marked by two characteristics: 1) a space of player interactions, some subset of which are specified as aesthetic goals for the system; and 2) the affordance for players to express self-agency and have meaningful interactions. As a result, players are (often unknowing) participants in the creation of the experience. They cannot be assumed to be cooperative, nor adversarial. Thus, we must provide paradigms to designers that enable them to work with players to co-create experiences without transferring the system's goals (specified by authors) to players and without systems having a model of players' behaviors. This dissertation formalizes compact representations and efficient algorithms that enable computer systems to represent, reason about, and shape player experiences in interactive narratives. Early work on interactive narratives relied heavily on "script-and-trigger" systems, requiring sizable engineering efforts from designers to provide concrete instructions for when and how systems can modify an environment to provide a narrative experience for players. While there have been advances in techniques for representing and reasoning about narratives at an abstract level that automate the trigger side of script-and-trigger systems, few techniques have reduced the need for scripting system adaptations or reconfigurations---one of the contributions of this dissertation. We first describe a decomposition of the design process for interactive narrative into three technical problems: goal selection, action/plan selection/generation, and action/plan refinement. This decomposition allows techniques to be developed for reasoning about the complete implementation of an interactive narrative. We then describe representational and algorithmic solutions to these problems: a Markov Decision Process-based formalism for goal selection, a schema-based planning architecture using theories of influence from social psychology for action/plan selection/generation, and a natural language-based template system for action/plan refinement. To evaluate these techniques, we conduct simulation experiments and human subjects experiments in an interactive story. Using these techniques realizes the following three goals: 1) efficient algorithmic support for authoring interactive narratives; 2) design a paradigm for AI systems to reason and act to shape player experiences based on author-specified aesthetic goals; and 3) accomplish (1) and (2) with players feeling more engaged and without perceiving a decrease in self-agency.

<p>This thesis is concerned with shared virtual environmentsfor collaborative work. An important aspect of shared virtualenvironments is the avatar, the representation of the user inthe virtual world. The proper design of the avatar has been thesubject of considerable research, aimed at allowing the avatarsto express as much as possible of human non-verbalcommunication and, as it were, tie the user closer to thevirtual world.</p><p>I will go through the historical development of sharedvirtual environments and how the design principles for avatarshave followed the available technology over time. I describeearlier research on extending avatars and environments in orderto better support collaboration in virtual spaces. I will thendescribe a user study where pairs of subjects cooperated on aconstruction task, and the implications for design ofcollaborative applications in VEs that can be drawn from thisstudy. In particular I show how the subjects used the availableresources in the environment to negotiate a sharedunderstanding of the environment and the task. Some of thesubjects had no visible avatars, but still solved the task byusing the environment itself to orient themselves and drawattention to important features of the environment.</p><p>Following this, I and co-workers have designed virtualenvironments which have had no explicit avatars, nor have usedtraditional methods for navigation in 3D space, but ratherrelied on task-oriented features of the space, such asagglomerations of other users or interesting objects in orderto present a relevant view of the environment. A view positionmay be shared by several users, or be“unoccupied”,merely representing a potential site for interaction.</p><p>Based on these experiences, I make the claim that atraditional anthropomorphic avatar is neither necessary norsuffcient for successful collaboration in virtual spaces, butthe design of navigation and user representation is contingenton the specific application, some reasonable applications notutilising a user representation at all.</p>

Video-mediated communication (VMC) is currently the prevalent mode of telecommunication for applications such as remote collaboration, teleconferencing, and distance learning. It is generally assumed that transmitting real-time talking-head videos of participants in addition to their audio is beneficial and desirable, enabling remote conferencing to feel almost the same as face-to-face collaboration. However, compared to being face-to-face, VMC still feels distant, artificial, cumbersome, and detached. One limitation of standard video-collaboration that contributes to this feeling is that the 3D context between people and their shared workspace given in face-to-face collaboration is lost. It is therefore not possible for participants to tell from the video what others are looking at, what they are working on, or who they are talking to. Video Collaborative Virtual Environments (video-CVEs) are novel VMC interfaces which address these problems by re-introducing a virtual 3D context into which distant users are mentally "transported" to be together and interact with the environment and with each other, represented by their spatially controllable video-avatars. To date, research efforts following this approach have primarily focused on the demonstration of working prototypes. However, maturation of these systems requires a deeper understanding of human factors that emerge during mediated collaborative processes. This thesis contributes to a deeper understanding of human factors. It investigates the hypothesis that video-CVEs can effectively support face-to-face aspects of collaboration which are absent in standard video-collaboration. This hypothesis is tested in four related comparative user studies involving teams of participants collaborating in video-CVEs, through standard video-conferencing systems, and being face-to-face. The experiments apply and extend methods from the research fields of human-computer interaction, computer-supported cooperative work, and presence. Empirical findings indicate benefits of video-CVEs for user experience dimensions such as social presence and copresence, but also highlight challenges for awareness and usability that need to be overcome to unlock the full potential of this type of interface.

The process of forest harvesting is highly mechanized in most industrialized countries, with felling and processing of trees performed by technologically advanced forestry machines. However, the maneuvering of the vehicles through the forest as well as the control of the on-board hydraulic boom crane is currently performed through continuous manual operation. This complicates the introduction of further incremental productivity improvements to the machines, as the operator becomes a bottleneck in the process. A suggested solution strategy is to enhance the production capacity by increasing the level of automation. At the same time, the working environment for the operator can be improved by a reduced workload, provided that the human-machine interaction is adapted to the new automated functionality. The objectives of this thesis are 1) to describe and analyze the current logging process and to locate areas of improvements that can be implemented in current machines, and 2) to investigate future methods and concepts that possibly require changes in work methods as well as in the machine design and technology. The thesis describes the development and integration of several algorithmic methods and the implementation of corresponding software solutions, adapted to the forestry machine context. Following data recording and analysis of the current work tasks of machine operators, trajectory planning and execution for a specific category of forwarder crane motions has been identified as an important first step for short term automation. Using the method of path-constrained trajectory planning, automated crane motions were demonstrated to potentially provide a substantial improvement from motions performed by experienced human operators. An extension of this method was developed to automate some selected motions even for existing sensorless machines. Evaluation suggests that this method is feasible for a reasonable deviation of initial conditions. Another important aspect of partial automation is the human-machine interaction. For this specific application a simple and intuitive interaction method for accessing automated crane motions was suggested, based on head tracking of the operator. A preliminary interaction model derived from user experiments yielded promising results for forming the basis of a target selection method, particularly when combined with some traded control strategy. Further, a modular software platform was implemented, integrating several important components into a framework for designing and testing future interaction concepts. Specifically, this system was used to investigate concepts of teleoperation and virtual environment feedback. Results from user tests show that visual information provided by a virtual environment can be advantageous compared to traditional video feedback with regards to both objective and subjective evaluation criteria.

As mobile devices still have limited battery life, processing power, memory, and display size, they cannot yet execute gaming applications with the same fidelity and quality as their PC counterparts. In response, researchers have recently performed research with the goal of the real-time delivery of game content specifically to fit within mobile devices’ limitations. In this thesis, we present a novel approach to tackling the streaming of objects to mobile devices. Our goal is to reduce the number of objects subject to streaming from the server to the target devices, while not violating the user-defined limitations through an efficient, context-aware 3D object selection and prioritization scheme. We take advantage of the game context to stream only the most relevant objects. Our evaluations have shown that this technique not only leads to better performance in general, but also increases the gameplay experience by helping the player to achieve a higher score.

Thesis (Ph. D.)--University of Washington, 2007. / Vita. Includes bibliographical references (leaves 114-118).