This research examines mixed reality meetings, a context where individuals attend to both face-to-face group members while multitasking with technology. In these meetings, members engage simultaneously with those physically present and those outside of the meeting (virtual communication partners). Technology multitasking in meetings has a dual effect: it not only impacts the individual user, it has the potential to transform how collocated groups communicate and work together since attention becomes fragmented across multiple competing tasks. Qualitative and quantitative methods were used to investigate mixed reality meetings across four themes: (1) the factors contributing to the likelihood to multitask based on meeting type, polychronicity (one’s preference for multitasking), and cohesion beliefs, (2) behavior during mixed reality assessed by copresence management, (3) attitudes toward technology multitasking, and (4) subjective outcomes measured by perceived productivity and meeting satisfaction. The qualitative data set consists of fieldwork from a global software company and interviews with 8 information workers. The quantitative data are comprised of survey results from the fieldwork site (n=156) and an online panel of information workers (n=110). Results indicate that information workers perceive distinct meeting types that are associated with implicit norms for appropriate technology multitasking. These norms varied based on the relevance of a meeting segment and if a power figure was present. A higher preference score for multitasking (high polychronicity) was significantly correlated with increased technology multitasking and perceived productivity. Members of cohesive teams exhibited the most technology multitasking and perceived their teammates multitasking as appropriate. However, outsiders who exhibited the same behaviors were viewed as rude and distracting. Overall, information workers who multitasked during meetings did so with electronic communication tasks (e-mail and instant messaging) as opposed to other computing tasks (e.g. writing documents, researching information). These findings are discussed in relation to psychological studies on multitasking, computer-supported cooperative work, and social constructionist views of technology use. This dissertation is a contribution to the assessment of technology use in social settings, particularly in organizations where tasks are often interrupted and a reliance on electronic communication tools impacts how people manage and accomplish work. / text

Zugl.: Saarbrücken, Univ., Diss., 2006

Techn. Universiẗat, Diss., 2006--Darmstadt.

A manutenção industrial é um dos grandes desafios na área de automação e manufatura da indústria. Este desafio tem se apresentado, em âmbito nacional, pela adoção da prática “predizer e prevenir” ao invés de “falhar e consertar”. Enquanto o Brasil caminha para uma mudança de paradigma de manutenção, o cenário internacional se volta para soluções em manufatura sustentável que atendam aos requisitos “eco and green”. E a manutenção é parte crucial deste novo contexto de produção. Entretanto, somente nos anos noventa, a indústria européia começa a delinear estratégias de manutenção. A complexidade e multidisciplinaridade deste tema tem sido o principal obstáculo para melhoras substanciais na disciplina de manutenção. São nas estratégias de manutenção, aliadas ao crescente avanço em Tecnologias da Informação e Comunicação (TIC), que aparecem as possibilidades de superar as limitações e os desafios desta área de pesquisa. A Manutenção Inteligente (MI) é uma dessas estratégias e utiliza o paradigma baseado em condição (Condition-based maintenance) para aplicação da técnica “predizer e prevenir”. Contudo, uma das principais barreiras na adoção de MI é a sua transferência efetiva para o operador em chão de fábrica. O conhecimento gerado pelos sistemas MI deve ser transformado em informações inteligíveis e úteis para o operador. Entretanto, o acesso, o entendimento e o uso destes dados, durante a atividade de manutenção, não é um processo trivial, devido à sobrecarga de informações e sistemas envolvidos nestes processos. Surge, então, como alternativa para contornar este problema, o uso de técnicas de realidade mista como meio de potencializar a interface homem-máquina. A escolha, neste trabalho, por interfaces mistas, objetiva, não apenas a visualização, mas a integração e o gerenciamento da informação. A fim de alcançar estes objetivos, é desenvolvida uma abordagem baseada em modelo. A primeira etapa consiste na definição de um modelo conceitual que integre os diferentes domínios envolvidos na solução proposta. Nesta fase, foram identificadas três áreas da manutenção em que a realidade mista pode permitir um ganho significativo: diagnóstico, planejamento e segurança. A segunda etapa consiste na descrição formal de um modelo de dados para integrar e gerenciar informações de diversos formatos. Finalmente, é implementado um sistema de visualização para validar o modelo de dados em um conjunto de estudos de caso da indústria. Objetiva-se, com esta abordagem: (i) facilitar a identificação de quais componentes apresentam problemas, o que auxilia no processo de tomada de decisão nas tarefas de manutenção; (ii) a inclusão do human in the loop, com o sistema MI, em que o operador poderá solicitar dados e medições adicionais durante a atividade de manutenção; (iii) fornecer um modelo que integre dados de formatos distintos, que viabilize uma maneira fácil e flexível de configurar o ambiente virtual. A visualização mista, utilizada pelo operador de manutenção em chão de fábrica, pode representar uma vantagem competitiva para indústria, além de prover uma maior flexibilidade e segurança para o operador durante a atividade de manutenção. / Industrial maintenance is one of the major challenges in industrial automation and manufacturing area. This challenge presents itself on the national context by the transformation to "predict and prevent" rather than "fail and fix ". While the Brazil moves toward a paradigm shift of maintenance, the international context searches manufacturing sustainable solutions that reply according to eco and green requirements and the maintenance is crucial part of this new production environment. However, it was only in the nineties that European industry started discusses maintenance strategies. The maintenance complexity and the multidisciplinary have been the main limitations for substantial improvements in the maintenance discipline. There are maintenance strategies coupled with the advances in Information and Communication Technologies (ICT) that arise the possibilities to overcome the limitations and challenges of this research area. The intelligent maintenance (IM) is one of these strategies and it uses the Condition-Based Maintenance paradigm (CBM). On the other hand one of the obstacles about the IM adoption is its effective transfer to the operator on the factory floor. The knowledge from IM systems must be transformed in understandable information and useful to the operator. However, the access, the understanding and the use of such information during the maintenance activity are not a trivial activity due the data and systems overload involved in these processes. Thus, arises as an alternative to solve this problem, the using mixed reality techniques to human-computer interface. The use of mixed interfaces in this thesis will aim not only to visualization but the integration and management of information. To achieve these goals was developed a model-based approach. The first step consisted in defining a conceptual model that address the domains involved in the solution proposed. At this stage were identified three main areas where the mixed reality could allow a significant change to maintenance activities: diagnosis, planning and security. The second step consisted in the formal description of a data model for integrating and management of information from multiple formats. Finally a visualization system was implemented to validate the data model in a set of case studies of industry. The goals of this thesis are: (i) to facilitate the identification of which components present problems in order to help in the decision making process of the maintenance tasks; (ii) the inclusion of the "human in the loop" into intelligent maintenance system, where the operator can request measurements and additional information during the maintenance process; (iii) to supply a model to integrate data of different formats making available an easy and flexible tool for configuring the virtual environment. The mixed reality, used by the maintenance operator on factory floor, may represent a competitive advantage for industry and provide greater flexibility and safety for operator during maintenance activity.

abstract: Stroke is a leading cause of disability with varying effects across stroke survivors necessitating comprehensive approaches to rehabilitation. Interactive neurorehabilitation (INR) systems represent promising technological solutions that can provide an array of sensing, feedback and analysis tools which hold the potential to maximize clinical therapy as well as extend therapy to the home. Currently, there are a variety of approaches to INR design, which coupled with minimal large-scale clinical data, has led to a lack of cohesion in INR design. INR design presents an inherently complex space as these systems have multiple users including stroke survivors, therapists and designers, each with their own user experience needs. This dissertation proposes that comprehensive INR design, which can address this complex user space, requires and benefits from the application of interdisciplinary research that spans motor learning and interactive learning. A methodology for integrated and iterative design approaches to INR task experience, assessment, hardware, software and interactive training protocol design is proposed within the comprehensive example of design and implementation of a mixed reality rehabilitation system for minimally supervised environments. This system was tested with eight stroke survivors who showed promising results in both functional and movement quality improvement. The results of testing the system with stroke survivors as well as observing user experiences will be presented along with suggested improvements to the proposed design methodology. This integrative design methodology is proposed to have benefit for not only comprehensive INR design but also complex interactive system design in general. / Dissertation/Thesis / Doctoral Dissertation Media Arts and Sciences 2014

abstract: Emerging information and communication technology (ICT) has had an enormous effect on the building architecture, engineering, construction and operation (AECO) fields in recent decades. The effects have resonated in several disciplines, such as project information flow, design representation and communication, and Building Information Modeling (BIM) approaches. However, these effects can potentially impact communication and coordination of the virtual design contents in both design and construction phases. Therefore, and with the great potential for emerging technologies in construction projects, it is essential to understand how these technologies influence virtual design information within the organizations as well as individuals’ behaviors. This research focusses on understanding current emerging technologies and its impacts on projects virtual design information and communication among projects stakeholders within the AECO organizations. / Dissertation/Thesis / Doctoral Dissertation Civil and Environmental Engineering 2017

abstract: Virtual Reality (hereafter VR) and Mixed Reality (hereafter MR) have opened a new line of applications and possibilities. Amidst a vast network of potential applications, little research has been done to provide real time collaboration capability between users of VR and MR. The idea of this thesis study is to develop and test a real time collaboration system between VR and MR. The system works similar to a Google document where two or more users can see what others are doing i.e. writing, modifying, viewing, etc. Similarly, the system developed during this study will enable users in VR and MR to collaborate in real time. The study of developing a real-time cross-platform collaboration system between VR and MR takes into consideration a scenario in which multiple device users are connected to a multiplayer network where they are guided to perform various tasks concurrently. Usability testing was conducted to evaluate participant perceptions of the system. Users were required to assemble a chair in alternating turns; thereafter users were required to fill a survey and give an audio interview. Results collected from the participants showed positive feedback towards using VR and MR for collaboration. However, there are several limitations with the current generation of devices that hinder mass adoption. Devices with better performance factors will lead to wider adoption. / Dissertation/Thesis / Final Output / Keynote / Thesis Demo / Masters Thesis Computer Science 2017

A manutenção industrial é um dos grandes desafios na área de automação e manufatura da indústria. Este desafio tem se apresentado, em âmbito nacional, pela adoção da prática “predizer e prevenir” ao invés de “falhar e consertar”. Enquanto o Brasil caminha para uma mudança de paradigma de manutenção, o cenário internacional se volta para soluções em manufatura sustentável que atendam aos requisitos “eco and green”. E a manutenção é parte crucial deste novo contexto de produção. Entretanto, somente nos anos noventa, a indústria européia começa a delinear estratégias de manutenção. A complexidade e multidisciplinaridade deste tema tem sido o principal obstáculo para melhoras substanciais na disciplina de manutenção. São nas estratégias de manutenção, aliadas ao crescente avanço em Tecnologias da Informação e Comunicação (TIC), que aparecem as possibilidades de superar as limitações e os desafios desta área de pesquisa. A Manutenção Inteligente (MI) é uma dessas estratégias e utiliza o paradigma baseado em condição (Condition-based maintenance) para aplicação da técnica “predizer e prevenir”. Contudo, uma das principais barreiras na adoção de MI é a sua transferência efetiva para o operador em chão de fábrica. O conhecimento gerado pelos sistemas MI deve ser transformado em informações inteligíveis e úteis para o operador. Entretanto, o acesso, o entendimento e o uso destes dados, durante a atividade de manutenção, não é um processo trivial, devido à sobrecarga de informações e sistemas envolvidos nestes processos. Surge, então, como alternativa para contornar este problema, o uso de técnicas de realidade mista como meio de potencializar a interface homem-máquina. A escolha, neste trabalho, por interfaces mistas, objetiva, não apenas a visualização, mas a integração e o gerenciamento da informação. A fim de alcançar estes objetivos, é desenvolvida uma abordagem baseada em modelo. A primeira etapa consiste na definição de um modelo conceitual que integre os diferentes domínios envolvidos na solução proposta. Nesta fase, foram identificadas três áreas da manutenção em que a realidade mista pode permitir um ganho significativo: diagnóstico, planejamento e segurança. A segunda etapa consiste na descrição formal de um modelo de dados para integrar e gerenciar informações de diversos formatos. Finalmente, é implementado um sistema de visualização para validar o modelo de dados em um conjunto de estudos de caso da indústria. Objetiva-se, com esta abordagem: (i) facilitar a identificação de quais componentes apresentam problemas, o que auxilia no processo de tomada de decisão nas tarefas de manutenção; (ii) a inclusão do human in the loop, com o sistema MI, em que o operador poderá solicitar dados e medições adicionais durante a atividade de manutenção; (iii) fornecer um modelo que integre dados de formatos distintos, que viabilize uma maneira fácil e flexível de configurar o ambiente virtual. A visualização mista, utilizada pelo operador de manutenção em chão de fábrica, pode representar uma vantagem competitiva para indústria, além de prover uma maior flexibilidade e segurança para o operador durante a atividade de manutenção. / Industrial maintenance is one of the major challenges in industrial automation and manufacturing area. This challenge presents itself on the national context by the transformation to "predict and prevent" rather than "fail and fix ". While the Brazil moves toward a paradigm shift of maintenance, the international context searches manufacturing sustainable solutions that reply according to eco and green requirements and the maintenance is crucial part of this new production environment. However, it was only in the nineties that European industry started discusses maintenance strategies. The maintenance complexity and the multidisciplinary have been the main limitations for substantial improvements in the maintenance discipline. There are maintenance strategies coupled with the advances in Information and Communication Technologies (ICT) that arise the possibilities to overcome the limitations and challenges of this research area. The intelligent maintenance (IM) is one of these strategies and it uses the Condition-Based Maintenance paradigm (CBM). On the other hand one of the obstacles about the IM adoption is its effective transfer to the operator on the factory floor. The knowledge from IM systems must be transformed in understandable information and useful to the operator. However, the access, the understanding and the use of such information during the maintenance activity are not a trivial activity due the data and systems overload involved in these processes. Thus, arises as an alternative to solve this problem, the using mixed reality techniques to human-computer interface. The use of mixed interfaces in this thesis will aim not only to visualization but the integration and management of information. To achieve these goals was developed a model-based approach. The first step consisted in defining a conceptual model that address the domains involved in the solution proposed. At this stage were identified three main areas where the mixed reality could allow a significant change to maintenance activities: diagnosis, planning and security. The second step consisted in the formal description of a data model for integrating and management of information from multiple formats. Finally a visualization system was implemented to validate the data model in a set of case studies of industry. The goals of this thesis are: (i) to facilitate the identification of which components present problems in order to help in the decision making process of the maintenance tasks; (ii) the inclusion of the "human in the loop" into intelligent maintenance system, where the operator can request measurements and additional information during the maintenance process; (iii) to supply a model to integrate data of different formats making available an easy and flexible tool for configuring the virtual environment. The mixed reality, used by the maintenance operator on factory floor, may represent a competitive advantage for industry and provide greater flexibility and safety for operator during maintenance activity.

abstract: Millions of Americans live with motor impairments resulting from a stroke and the best way to administer rehabilitative therapy to achieve recovery is not well understood. Adaptive mixed reality rehabilitation (AMRR) is a novel integration of motion capture technology and high-level media computing that provides precise kinematic measurements and engaging multimodal feedback for self-assessment during a therapeutic task. The AMRR system was evaluated in a small (N=3) cohort of stroke survivors to determine best practices for administering adaptive, media-based therapy. A proof of concept study followed, examining changes in clinical scale and kinematic performances among a group of stroke survivors who received either a month of AMRR therapy (N = 11) or matched dosing of traditional repetitive task therapy (N = 10). Both groups demonstrated statistically significant improvements in Wolf Motor Function Test and upper-extremity Fugl-Meyer Assessment scores, indicating increased function after the therapy. However, only participants who received AMRR therapy showed a consistent improvement in their kinematic measurements, including those measured in the trained reaching task (reaching to grasp a cone) and in an untrained reaching task (reaching to push a lighted button). These results suggest that that the AMRR system can be used as a therapy tool to enhance both functionality and reaching kinematics that quantify movement quality. Additionally, the AMRR concepts are currently being transitioned to a home-based training application. An inexpensive, easy-to-use, toolkit of tangible objects has been developed to sense, assess and provide feedback on hand function during different functional activities. These objects have been shown to accurately and consistently track hand function in people with unimpaired movements and will be tested with stroke survivors in the future. / Dissertation/Thesis / Ph.D. Bioengineering 2012

A manutenção industrial é um dos grandes desafios na área de automação e manufatura da indústria. Este desafio tem se apresentado, em âmbito nacional, pela adoção da prática “predizer e prevenir” ao invés de “falhar e consertar”. Enquanto o Brasil caminha para uma mudança de paradigma de manutenção, o cenário internacional se volta para soluções em manufatura sustentável que atendam aos requisitos “eco and green”. E a manutenção é parte crucial deste novo contexto de produção. Entretanto, somente nos anos noventa, a indústria européia começa a delinear estratégias de manutenção. A complexidade e multidisciplinaridade deste tema tem sido o principal obstáculo para melhoras substanciais na disciplina de manutenção. São nas estratégias de manutenção, aliadas ao crescente avanço em Tecnologias da Informação e Comunicação (TIC), que aparecem as possibilidades de superar as limitações e os desafios desta área de pesquisa. A Manutenção Inteligente (MI) é uma dessas estratégias e utiliza o paradigma baseado em condição (Condition-based maintenance) para aplicação da técnica “predizer e prevenir”. Contudo, uma das principais barreiras na adoção de MI é a sua transferência efetiva para o operador em chão de fábrica. O conhecimento gerado pelos sistemas MI deve ser transformado em informações inteligíveis e úteis para o operador. Entretanto, o acesso, o entendimento e o uso destes dados, durante a atividade de manutenção, não é um processo trivial, devido à sobrecarga de informações e sistemas envolvidos nestes processos. Surge, então, como alternativa para contornar este problema, o uso de técnicas de realidade mista como meio de potencializar a interface homem-máquina. A escolha, neste trabalho, por interfaces mistas, objetiva, não apenas a visualização, mas a integração e o gerenciamento da informação. A fim de alcançar estes objetivos, é desenvolvida uma abordagem baseada em modelo. A primeira etapa consiste na definição de um modelo conceitual que integre os diferentes domínios envolvidos na solução proposta. Nesta fase, foram identificadas três áreas da manutenção em que a realidade mista pode permitir um ganho significativo: diagnóstico, planejamento e segurança. A segunda etapa consiste na descrição formal de um modelo de dados para integrar e gerenciar informações de diversos formatos. Finalmente, é implementado um sistema de visualização para validar o modelo de dados em um conjunto de estudos de caso da indústria. Objetiva-se, com esta abordagem: (i) facilitar a identificação de quais componentes apresentam problemas, o que auxilia no processo de tomada de decisão nas tarefas de manutenção; (ii) a inclusão do human in the loop, com o sistema MI, em que o operador poderá solicitar dados e medições adicionais durante a atividade de manutenção; (iii) fornecer um modelo que integre dados de formatos distintos, que viabilize uma maneira fácil e flexível de configurar o ambiente virtual. A visualização mista, utilizada pelo operador de manutenção em chão de fábrica, pode representar uma vantagem competitiva para indústria, além de prover uma maior flexibilidade e segurança para o operador durante a atividade de manutenção. / Industrial maintenance is one of the major challenges in industrial automation and manufacturing area. This challenge presents itself on the national context by the transformation to "predict and prevent" rather than "fail and fix ". While the Brazil moves toward a paradigm shift of maintenance, the international context searches manufacturing sustainable solutions that reply according to eco and green requirements and the maintenance is crucial part of this new production environment. However, it was only in the nineties that European industry started discusses maintenance strategies. The maintenance complexity and the multidisciplinary have been the main limitations for substantial improvements in the maintenance discipline. There are maintenance strategies coupled with the advances in Information and Communication Technologies (ICT) that arise the possibilities to overcome the limitations and challenges of this research area. The intelligent maintenance (IM) is one of these strategies and it uses the Condition-Based Maintenance paradigm (CBM). On the other hand one of the obstacles about the IM adoption is its effective transfer to the operator on the factory floor. The knowledge from IM systems must be transformed in understandable information and useful to the operator. However, the access, the understanding and the use of such information during the maintenance activity are not a trivial activity due the data and systems overload involved in these processes. Thus, arises as an alternative to solve this problem, the using mixed reality techniques to human-computer interface. The use of mixed interfaces in this thesis will aim not only to visualization but the integration and management of information. To achieve these goals was developed a model-based approach. The first step consisted in defining a conceptual model that address the domains involved in the solution proposed. At this stage were identified three main areas where the mixed reality could allow a significant change to maintenance activities: diagnosis, planning and security. The second step consisted in the formal description of a data model for integrating and management of information from multiple formats. Finally a visualization system was implemented to validate the data model in a set of case studies of industry. The goals of this thesis are: (i) to facilitate the identification of which components present problems in order to help in the decision making process of the maintenance tasks; (ii) the inclusion of the "human in the loop" into intelligent maintenance system, where the operator can request measurements and additional information during the maintenance process; (iii) to supply a model to integrate data of different formats making available an easy and flexible tool for configuring the virtual environment. The mixed reality, used by the maintenance operator on factory floor, may represent a competitive advantage for industry and provide greater flexibility and safety for operator during maintenance activity.