In order to produce an Interactive MultiMedia Application (IMMA), the developer of that application needs a set of tools for such tasks as capturing, modifying, editing, sequencing, synchronizing, archiving, versioning, and backing up. The heart of this set of tools is an Integrator which can be used by the developer to assemble various multimedia objects into an IMMA and provide the end-user with ways of interacting with that IMMA. This work focuses on that essential tool - the multimedia Integrator. The Integrator uses a graphical interface that exploits a notation like that of a musical score. The IMMA produced by the Integrator is inherently parallel and includes elements required to define the asynchronous nature of applications, along with a standard set of multimedia objects. The timing and synchronization representation used by the Integrator is based on the model presented by the HyTime standard group. We also have explored the representation of our objects and their attributes according to the Multimedia Hypermedia Expert Group (MHEG) standard model as defined by the MHEG committee. This work formalizes the design of the Integrator and its constructs using the HyTime Draft International Standard (ISO/IEC DIS 10744). Multimedia application objects and their attributes are described, timing and synchronization aspects of the Integrator and some examples of IMMAs are explained, and several of these examples using the HyTime document structuring language are given. / Master of Science

This thesis presents an approach to rapid prototyping called behavioral demonstration that allows a system to be demonstrated at any point during its development. This approach is based on the operational specification approach to software design and uses a new, automation based life-cycle paradigm. This work describes a tool that supports behavioral demonstration called the behavioral demonstrator that collects and manages information typically lost during software system design but critically needed during maintenance. The tool also supports project-personnel management and software complexity and cost estimation. The research takes place in the context of a dialogue management system and software design methodology that features the logical and physical separation of the input, processing, and output components of interactive systems. / M.S.

Permission from the author to release this work as open access is pending. Please contact the ICS library if you would like to view this work.

Wong Ka Ho. / Thesis submitted in: October 2005. / Thesis (M.Phil.)--Chinese University of Hong Kong, 2006. / Includes bibliographical references (leaves 163-170). / Abstracts in English and Chinese. / Abstract --- p.2 / Acknowledgements --- p.5 / Chapter 1 --- Introduction --- p.10 / Chapter 1.1 --- Multi-modal and Multi-media --- p.10 / Chapter 1.2 --- Overview --- p.11 / Chapter 1.3 --- Thesis Goal --- p.13 / Chapter 1.4 --- Thesis Outline --- p.15 / Chapter 2 --- Background --- p.16 / Chapter 2.1 --- Multi-modal Fission --- p.17 / Chapter 2.2 --- Multi-modal Data collection --- p.21 / Chapter 2.2.1 --- Collection Time --- p.21 / Chapter 2.2.2 --- Annotation and Tools --- p.21 / Chapter 2.2.3 --- Knowledge of Multi-modal Using --- p.21 / Chapter 2.3 --- Text-to-audiovisual Speech System --- p.22 / Chapter 2.3.1 --- Different. Approaches to Generate a Talking Heading --- p.23 / Chapter 2.3.2 --- Sub-tasks in Animating a Talking Head --- p.25 / Chapter 2.4 --- Modality Selection --- p.27 / Chapter 2.4.1 --- Rules-based approach --- p.27 / Chapter 2.4.2 --- Plan-based approach --- p.28 / Chapter 2.4.3 --- Feature-based approach --- p.29 / Chapter 2.4.4 --- Corpus-based approach --- p.30 / Chapter 2.5 --- Summary --- p.30 / Chapter 3 --- Information Domain --- p.31 / Chapter 3.1 --- Multi-media Information --- p.31 / Chapter 3.2 --- "Task Goals, Dialog Acts, Concepts and Information Type" --- p.32 / Chapter 3.2.1 --- Task Goals and Dialog Acts --- p.32 / Chapter 3.2.2 --- Concepts and Information Type --- p.36 / Chapter 3.3 --- User's Task and Scenario --- p.37 / Chapter 3.4 --- Chapter Summary --- p.38 / Chapter 4 --- Multi-modal Response Data Collection --- p.41 / Chapter 4.1 --- Data Collection Setup --- p.42 / Chapter 4.1.1 --- Multi-modal Input Setup --- p.43 / Chapter 4.1.2 --- Multi-modal Output Setup --- p.43 / Chapter 4.2 --- Procedure --- p.45 / Chapter 4.2.1 --- Precaution --- p.45 / Chapter 4.2.2 --- Recording --- p.50 / Chapter 4.2.3 --- Data Size and Type --- p.50 / Chapter 4.3 --- Annotation --- p.52 / Chapter 4.3.1 --- Extensible Multi-Modal Markup Language --- p.52 / Chapter 4.3.2 --- "Mobile, Multi-biometric and Multi-modal Annotation" --- p.53 / Chapter 4.4 --- Problems in the Wizard-of-Oz Setup --- p.56 / Chapter 4.4.1 --- Lack of Knowledge --- p.57 / Chapter 4.4.2 --- Time Deficiency --- p.57 / Chapter 4.4.3 --- Information Availability --- p.58 / Chapter 4.4.4 --- Operation Delay --- p.59 / Chapter 4.4.5 --- Lack of Modalities --- p.59 / Chapter 4.5 --- Data Optimization --- p.61 / Chapter 4.5.1 --- Precaution --- p.61 / Chapter 4.5.2 --- Procedures --- p.61 / Chapter 4.5.3 --- Data Size in Expert Design Responses --- p.63 / Chapter 4.6 --- Analysis and Discussion --- p.65 / Chapter 4.6.1 --- Multi-modal Usage --- p.67 / Chapter 4.6.2 --- Modality Combination --- p.67 / Chapter 4.6.3 --- Deictic term --- p.68 / Chapter 4.6.4 --- Task Goal and Dialog Acts --- p.71 / Chapter 4.6.5 --- Information Type --- p.72 / Chapter 4.7 --- Chapter Summary --- p.74 / Chapter 5 --- Text-to-Audiovisual Speech System --- p.76 / Chapter 5.1 --- Phonemes and Visemes --- p.77 / Chapter 5.2 --- Three-dimensional Facial Animation --- p.82 / Chapter 5.2.1 --- Three-dimensional (3D) Face Model --- p.82 / Chapter 5.2.2 --- The Blending Process for Animation --- p.84 / Chapter 5.2.3 --- Connectivity between Visemes --- p.85 / Chapter 5.3 --- User Perception Experiments --- p.87 / Chapter 5.4 --- Applications and Extension --- p.89 / Chapter 5.4.1 --- Multilingual Extension and Potential Applications --- p.89 / Chapter 5.5 --- Talking Head in Multi-modal Dialogue System --- p.90 / Chapter 5.5.1 --- Prosody --- p.93 / Chapter 5.5.2 --- Body Gesture --- p.94 / Chapter 5.6 --- Chapter Summary --- p.94 / Chapter 6 --- Modality Selection and Implementation --- p.98 / Chapter 6.1 --- Multi-modal Response Examples --- p.98 / Chapter 6.1.1 --- Single Concept-value Example --- p.99 / Chapter 6.1.2 --- Two Concept-values with Different Information Types --- p.102 / Chapter 6.1.3 --- Multiple Concept-values with Same Information Types Example --- p.103 / Chapter 6.2 --- Heuristic Rules for Modality Selection --- p.105 / Chapter 6.2.1 --- General Principles --- p.106 / Chapter 6.2.2 --- Heuristic rules --- p.107 / Chapter 6.2.3 --- Temporal Coordination for Synchronization --- p.109 / Chapter 6.2.4 --- Physical Layout --- p.110 / Chapter 6.2.5 --- Deictic Term --- p.111 / Chapter 6.2.6 --- Example --- p.111 / Chapter 6.3 --- Spoken Content Generation --- p.113 / Chapter 6.4 --- Chapter Summary --- p.115 / Chapter 7 --- Conclusions and Future Work --- p.117 / Chapter 7.1 --- Summary --- p.117 / Chapter 7.2 --- Contributions --- p.118 / Chapter 7.3 --- Future work --- p.119 / Chapter A --- XML Schema for M3 Markup Language --- p.123 / Chapter B --- M3ML Examples --- p.128 / Chapter C --- Domain-Specific Task Goals in the Hong Kong Tourism Do- main --- p.131 / Chapter D --- Dialog Acts for User Request in the Hong Kong Tourism Do- main --- p.133 / Chapter E --- Dialog Acts for System Response in the Hong Kong Tourism Domain --- p.137 / Chapter F --- Information Type and Concepts --- p.141 / Chapter G --- Concepts --- p.143 / Bibliography --- p.149

Thesis (M.S.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1982. / MICROFICHE COPY AVAILABLE IN ARCHIVES AND ENGINEERING / Bibliography: leaves 101-103. / by Sriram K. Atreya. / M.S.

Thesis (M.S.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1982. / MICROFICHE COPY AVAILABLE IN ARCHIVES AND ENGINEERING / Bibliography: leaves 90-91. / by Brij Mohan Masand. / M.S.

Thesis (M.S.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1980. / MICROFICHE COPY AVAILABLE IN ARCHIVES AND ENGINEERING. / Vita. / Bibliography: leaves 98-102. / by Brad Allen Myers. / M.S.

Digitized by Kansas Correctional Industries

Submitted by Filipe dos Santos (fsantos@pucsp.br) on 2017-12-05T13:17:55Z No. of bitstreams: 1 Leonardo Antonio Lins.pdf: 2767772 bytes, checksum: 2bba9ae19e56f8b81a46bab33a681412 (MD5) / Made available in DSpace on 2017-12-05T13:17:55Z (GMT). No. of bitstreams: 1 Leonardo Antonio Lins.pdf: 2767772 bytes, checksum: 2bba9ae19e56f8b81a46bab33a681412 (MD5) Previous issue date: 2017-11-10 / Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - CAPES / This work investigates information technologies applied to objects and seeks to comprehend how computer distribution in domestic environments can affect an interacting individual attention to objects that offer computational capabilities earlier applied only to computers. The research is set off from the presentation of a technological panorama where the possibility of pulverization of small computers integrated in domestic objects is enabled by the application of the concept of Internet of Things through the possibility of a wireless connection and the use of sensors and actuators. Based on the contribution of authors such as Marc Weiser, Amber Case and Claire Rowland, the concepts of computing dispersed through a domestic environment are analysed. Later on, the study fundamentals where attention is explored are presented, as well as the impact of technological changes expressed during industrialization, period when the attention issue is manifested in Jonathan Crary’s text. After discussions on attention matters, Weiser’s formulation regarding rudiments of a Calm Technology that is capable of offering interactions without demanding the constant of the individual’s attention is presented. Finally, with the intent of raising from interaction design and interface fundamentals, elements that constitute the approach of user’s experience are studied, in order to facilitate the presentation and discussion of examples of connected and interactive objects from an interaction between individuals and connected objects perspective. The application of concepts from interaction design with distributed technology is contemporary and still experimental, enabled by technological development, however, the discussion of these applications exposes the need for comprehension that objects become interactive, as well as computers and mobile devices / O presente trabalho investiga as tecnologias da informação aplicadas a objetos e busca compreender como a distribuição da computação em ambientes domésticos pode afetar a atenção de indivíduos de interação com objetos que oferecem capacidades computacionais antes aplicadas somente aos computadores. A pesquisa parte da apresentação de um panorama tecnológico onde a possibilidade da pulverização de pequenos computadores integrados em objetos domésticos se torna capaz pela aplicação do conceito da internet das coisas através das capacidades de conexão a uma rede sem fio e uso de sensores e atuadores. Fundamentando-se nas contribuições de autores como Marc Weiser, Amber Case e Claire Rowland, os conceitos de uma computação distribuída em um ambiente doméstico são analisados. Em momento posterior, os fundamentos de estudos, onde a atenção é explorada, são apresentados, assim como o impacto das mudanças tecnológicas, manifestado durante a industrialização, momento em que o problema da atenção se manifesta no texto de Jonathan Crary. Após discussão sobre questões da atenção, a formulação de Weiser sobre os rudimentos de uma Tecnologia Calma, que seja capaz de oferecer interações sem exigir a constante da atenção do indivíduo, é apresentada. Por fim, com a intenção de levantar os fundamentos do design de interação e interface, elementos que constituem a abordagem da experiência do usuário são estudados, assim, a apresentação e discussão de exemplos de objetos conectados e interativos se torna possível do ponto de vista da interação entre indivíduo e objetos conectados. A aplicação de conceitos do design de interação com a tecnologia distribuída é algo contemporâneo e ainda experimental, sendo possível pelo desenvolvimento tecnológico, mas, a discussão dessas aplicações expõe a necessidade da compreensão que objetos se tornam interativos, bem como computadores e dispositivos móveis

Throughout a typical day, people complete myriad tasks and activities such as locking the front door as they run errands around the neighborhood, preparing meals and drinks, taking care of family, pets, plants, and so on. In managing the progress of these everyday activities, people may nd themselves needing to recall what they have already done. In this research, I explored how to design an unobtrusive memory aid that reduces the cost of distraction and general multitasking by fluidly supporting memory recall of repetitive actions. I built the Cook's Collage as one example system that captures close-range photographs of ingredient additions during everyday home cooking to display as an ongoing visual summary of the open-ended activity. I contribute this augmentative technology as a memory aid in contrast to more directive, obtrusive, and yet constrained systems that seek to remove human error through automation and scripted guidance. I explored how to evaluate memory augmentation by simulating real-life situations of multitasking and interruptions that distracted cooks participating in my experimental study. From examining their behavior and attitudes with and without the Cook's Collage, I demonstrated that 1) Visually summarizing activities by capturing items used within the activity in the same physical surroundings can provide sufficient context in recalling memory for actions, 2) User interaction with accurate memory support that complements and supplements rather than interferes with memory practices, activity constraints, and environmental surroundings can effectively augment memory recall, and 3) Barriers to using provided memory support can include unawareness of memory need and predilection to own memory ability and routine.