Modern sonar systems have greatly improved their sensor technology and processing techniques, but little effort has been put into display design for sonar data. The enormous amount of acoustic data presented by the traditional frequency versus time display can be overwhelming for a sonar operator to monitor and analyze. The recent emphasis placed on networked underwater warfare also requires the operator to create and maintain awareness of the overall tactical picture in order to improve overall effectiveness in communication and sharing of critical data. In addition to regular sonar tasks, sonobuoy system operators must manage the deployment of sonobuoys and ensure proper functioning of deployed sonobuoys. This thesis examines an application of the Ecological Interface Design framework in the interface design of a sonobuoy system on board a maritime patrol aircraft. Background research for this thesis includes a literature review, interviews with subject matter experts, and an analysis of the decision making process of sonar operators from an information processing perspective. A work domain analysis was carried out, which yielded a dual domain model: the domain of sonobuoy management and the domain of tactical situation awareness address the two different aspects of the operator's work. Information requirements were drawn from the two models, which provided a basis for the generation of various unique interface concepts. These concepts covered both the needs to build a good tactical picture and manage sonobuoys as physical resources. The later requirement has generally been overlooked by previous sonobuoy interface designs. A number of interface concepts were further developed into an integrated display prototype for user testing. Demos created with the same prototype were also delivered to subject matter experts for their feedback. While the evaluation means are subjective and limited in their ability to draw solid comparisons with existing sonobuoy displays, positive results from both user testing and subject matter feedback indicated that the concepts developed here are intuitive to use and effective in communicating critical data and supporting the user’s awareness of the tactical events simulated. Subject matter experts also acknowledged the potential for these concepts to be included in future research and development for sonobuoy systems. This project was funded by the Industrial Postgraduate Scholarships (IPS) from Natural Science and Engineering Research Council of Canada (NSERC) and the sponsorship of Humansystems Inc. at Guelph, Ontario.

Modern sonar systems have greatly improved their sensor technology and processing techniques, but little effort has been put into display design for sonar data. The enormous amount of acoustic data presented by the traditional frequency versus time display can be overwhelming for a sonar operator to monitor and analyze. The recent emphasis placed on networked underwater warfare also requires the operator to create and maintain awareness of the overall tactical picture in order to improve overall effectiveness in communication and sharing of critical data. In addition to regular sonar tasks, sonobuoy system operators must manage the deployment of sonobuoys and ensure proper functioning of deployed sonobuoys. This thesis examines an application of the Ecological Interface Design framework in the interface design of a sonobuoy system on board a maritime patrol aircraft. Background research for this thesis includes a literature review, interviews with subject matter experts, and an analysis of the decision making process of sonar operators from an information processing perspective. A work domain analysis was carried out, which yielded a dual domain model: the domain of sonobuoy management and the domain of tactical situation awareness address the two different aspects of the operator's work. Information requirements were drawn from the two models, which provided a basis for the generation of various unique interface concepts. These concepts covered both the needs to build a good tactical picture and manage sonobuoys as physical resources. The later requirement has generally been overlooked by previous sonobuoy interface designs. A number of interface concepts were further developed into an integrated display prototype for user testing. Demos created with the same prototype were also delivered to subject matter experts for their feedback. While the evaluation means are subjective and limited in their ability to draw solid comparisons with existing sonobuoy displays, positive results from both user testing and subject matter feedback indicated that the concepts developed here are intuitive to use and effective in communicating critical data and supporting the user’s awareness of the tactical events simulated. Subject matter experts also acknowledged the potential for these concepts to be included in future research and development for sonobuoy systems. This project was funded by the Industrial Postgraduate Scholarships (IPS) from Natural Science and Engineering Research Council of Canada (NSERC) and the sponsorship of Humansystems Inc. at Guelph, Ontario.

Computer simulations are increasingly recognized as educational tools that facilitate students' learning in a safe environment. However, the way in which the simulations are used can have considerable impact on learning outcomes. Some have argued that exploratory learning is an effective strategy for learning new materials; but others have expressed concern that allowing free exploration may result in less efficient, or even inaccurate, learning and therefore encourage more guided exploration. The purpose of this research is to compare learning outcomes of nursing students in a critical care course when using an interactive computer simulation designed to teach fundamentals of oxygenation management under two exploratory learning methods (free versus guided exploration). The conceptual framework for the study was derived from the Informatics Research Organizing Model. The experimental study used a pretest-posttest design. Students in an existing or just finished critical care course were invited to participate in the study. Following a pretest that included a paper and pencil assessment of students' oxygenation management knowledge and two computer-generated clinical scenarios, students were encouraged to learn about the simulation using either guided or free exploration. The Guided Exploration group was given tasks to achieve, while the Free Exploration group was asked to learn about the instructional oxygenation management simulation without any specific tasks. Students then completed a posttest that was identical to the pretest with the addition of one novel clinical scenario to assess knowledge transfer. The results of data analysis using paired t-tests showed no significant differences in learning in the post test for the total group. The independent t-test showed no differences in the mean score between the Free and Guided Exploration groups.

The Nursing Coordinators (NCs) at the University of Ottawa Heart Institute (UOHI) fields phone calls from patients who have been discharged and are undergoing home care procedures at a daily basis. The project described in this thesis aims to provide tools for the Personal Digital Assistant (PDA) that the NCs can use during the phone calls. The Cognitive Work Analysis (CWA) and Ecological Interface Design (EID) approach are used to identify the information requirements to design the system. Major challenges of the telephone consultation process that are additionally identified by literature review and interviewing the NCs included visibility of patients, individual differences, and lack of standardized procedures. A combination of decision trees and visualization techniques is proposed to aid the process. Implementation of decision trees would help unload mental workload especially accesses to "knowledge in the head" as well as facilitate expert knowledge transfer to less experienced nurses. Visualization tools display integration of multiple-cues from patients in an abstract nature and can be accessed by users at any point of decision process. <br /><br /> Preliminary experiment with static images showed that visualization tools helped the decision makers more when the judgement tasks were more complex. The effects of different types of decision support on the cardiac nurses in simulated telephone consultation processes were examined. The system improved the performance of the decision makers and induced different types of strategic behaviours: a standardized checklist, OLDCAR, induced more through assessment, the decision algorithms induced efficient and more detailed recommendation, and the semantic network symptom map induced information gathering more relevant to diagnosis. <br /><br /> The research also explored methodologies to examine multi-layered decision process, where many decision makers with varying expertise are involved in modeling the strategic behaviours. This type of process can be applicable when the primary decision makers do not monitor the work domain, but can be alerted when something goes wrong.

Investigations into past accidents at nuclear power generating facilities such as that of Three Mile Island have identified human factors as one of the foremost critical aspects in plant safety. Errors resulting from limitations in human information processing are of particular concern for human-machine interfaces (HMI) in plant control rooms. This project examines the application of Ecological Interface Design (EID) in HMI information displays and the effects on operator situation awareness (SA) for turbine secondary systems based on the Swedish Forsmark 3 boiling-water reactor nuclear power plant. A work domain analysis was performed on the turbine secondary systems yielding part-whole decomposition and abstraction hierarchy models. Information display requirements were subsequently extracted from the models. The resulting EID information displays were implemented in a full-scope simulator and evaluated with six licensed operating crews from the Forsmark 3 plant. Three measures were used to examine SA: self-rated bias, Halden Open Probe Elicitation (HOPE), and Situation Awareness Control Room Inventory (SACRI). The data analysis revealed that operators achieved moderate to good SA; operators unfamiliar with EID information displays were able to develop and maintain comparable levels of SA to operators using traditional forms of single sensor-single indicator (SS-SI) information displays. With sufficient training and experience, operator SA is expected to benefit from the knowledge-based visual elements in the EID information displays. This project was researched in conjunction with the Cognitive Engineering Laboratory at the University of Toronto and the Institute for Energy Technology (IFE) in Halden, Norway.

The Nursing Coordinators (NCs) at the University of Ottawa Heart Institute (UOHI) fields phone calls from patients who have been discharged and are undergoing home care procedures at a daily basis. The project described in this thesis aims to provide tools for the Personal Digital Assistant (PDA) that the NCs can use during the phone calls. The Cognitive Work Analysis (CWA) and Ecological Interface Design (EID) approach are used to identify the information requirements to design the system. Major challenges of the telephone consultation process that are additionally identified by literature review and interviewing the NCs included visibility of patients, individual differences, and lack of standardized procedures. A combination of decision trees and visualization techniques is proposed to aid the process. Implementation of decision trees would help unload mental workload especially accesses to "knowledge in the head" as well as facilitate expert knowledge transfer to less experienced nurses. Visualization tools display integration of multiple-cues from patients in an abstract nature and can be accessed by users at any point of decision process. <br /><br /> Preliminary experiment with static images showed that visualization tools helped the decision makers more when the judgement tasks were more complex. The effects of different types of decision support on the cardiac nurses in simulated telephone consultation processes were examined. The system improved the performance of the decision makers and induced different types of strategic behaviours: a standardized checklist, OLDCAR, induced more through assessment, the decision algorithms induced efficient and more detailed recommendation, and the semantic network symptom map induced information gathering more relevant to diagnosis. <br /><br /> The research also explored methodologies to examine multi-layered decision process, where many decision makers with varying expertise are involved in modeling the strategic behaviours. This type of process can be applicable when the primary decision makers do not monitor the work domain, but can be alerted when something goes wrong.

Current multimodal interfaces for complex systems, such as those designed using the Ecological Interface Design (EID) methodology, have largely focused on effective design of interfaces that treat each sensory modality as either an independent channel of information or as a way to provide redundant information. However, there are many times when operationally related information is presented in different sensory modalities. There is very little research that has examined how this information in different modalities can be linked at a perceptual level. When related information is presented through multiple sensory modalities, interface designers will require perceptual methods for linking relevant information together across modalities. This thesis examines one possible crossmodal perceptual relationship, temporal synchrony, and evaluates whether the relationship is useful in the design of multimodal interfaces for complex systems. Two possible metrics for the evaluation of crossmodal perceptual relationships were proposed: resistance to changes in workload, and stream monitoring awareness. Two experiments were used to evaluate these metrics. The results of the first experiment showed that temporal rate synchrony was not resistant to changes in workload, manipulated through a secondary visual task. The results of the second experiment showed that participants who used crossmodal temporal rate synchrony to link information in a multimodal interface did not achieve better performance in the monitoring of the two streams of information being presented over equivalent unimodal interfaces. Taken together, these findings suggest that temporal rate synchrony may not be an effective method for linking information across modalities. Crossmodal perceptual relationships may be very different from intra-modal perceptual relationships. However, methods for linking information across sensory modalities are still an important goal for interface designers, and a key feature of future multimodal interface design for complex systems.

Investigations into past accidents at nuclear power generating facilities such as that of Three Mile Island have identified human factors as one of the foremost critical aspects in plant safety. Errors resulting from limitations in human information processing are of particular concern for human-machine interfaces (HMI) in plant control rooms. This project examines the application of Ecological Interface Design (EID) in HMI information displays and the effects on operator situation awareness (SA) for turbine secondary systems based on the Swedish Forsmark 3 boiling-water reactor nuclear power plant. A work domain analysis was performed on the turbine secondary systems yielding part-whole decomposition and abstraction hierarchy models. Information display requirements were subsequently extracted from the models. The resulting EID information displays were implemented in a full-scope simulator and evaluated with six licensed operating crews from the Forsmark 3 plant. Three measures were used to examine SA: self-rated bias, Halden Open Probe Elicitation (HOPE), and Situation Awareness Control Room Inventory (SACRI). The data analysis revealed that operators achieved moderate to good SA; operators unfamiliar with EID information displays were able to develop and maintain comparable levels of SA to operators using traditional forms of single sensor-single indicator (SS-SI) information displays. With sufficient training and experience, operator SA is expected to benefit from the knowledge-based visual elements in the EID information displays. This project was researched in conjunction with the Cognitive Engineering Laboratory at the University of Toronto and the Institute for Energy Technology (IFE) in Halden, Norway.

In response to growing concerns over the susceptibility of water distribution systems to contamination, this thesis presents the design and evaluation of an ecological display for an intelligent water monitoring system. Work Domain Analysis and Control Task Analysis were used to uncover the information requirements of the display. The work domain model in this thesis is one of a limited number of such models to include a representation of the automation. The resulting ecological display was evaluated in a comparative usability study against an alternative display based on a competitor’s product. Nine certified water operators participated. The displays were compared across three categories of usability measures: effectiveness, efficiency, and satisfaction. No significant differences were observed. The results, however, helped identify design changes for the display. The implications for the design of intelligent automation displays, and the challenge of designing displays in parallel with early development of automation systems, are discussed.

In response to growing concerns over the susceptibility of water distribution systems to contamination, this thesis presents the design and evaluation of an ecological display for an intelligent water monitoring system. Work Domain Analysis and Control Task Analysis were used to uncover the information requirements of the display. The work domain model in this thesis is one of a limited number of such models to include a representation of the automation. The resulting ecological display was evaluated in a comparative usability study against an alternative display based on a competitor’s product. Nine certified water operators participated. The displays were compared across three categories of usability measures: effectiveness, efficiency, and satisfaction. No significant differences were observed. The results, however, helped identify design changes for the display. The implications for the design of intelligent automation displays, and the challenge of designing displays in parallel with early development of automation systems, are discussed.