No description available.

Effective Scenario-Based Training (SBT) is sequenced in an efficient trajectory from novice to mastery and is well-grounded in pedagogically sound instructional strategies and learning theory. Adaptive, automated SBT attempts to sequence scenarios according to the performance of the student and implement the sequence without human agency. The source of these scenarios may take the form of a matrix constructed by Instructional Systems Designers (ISD), software engineers or trainers. The domain being instructed may contain procedures or concepts that are easily differentiated thus allowing quick and accurate determination of difficulty. In this instance, the sequencing of the SBT is relatively simple. However, in complex, domain-integrated instructional environments accurate and efficient sequencing may be extremely difficult as ISD, software engineers and trainers, without an objective means to calculate a scenario*s complexity must rely on subjectivity. In the Military, where time, fiscal and manpower constraints may lead to ineffective, inefficient and, perhaps, negative training SBT is a growing alternative to live training due to the significant cost avoidance demonstrated by such systems as the United States Marine Corps* (USMC) Abrams Main Battle Tank (M1A1) Advanced Gunnery Training System (AGTS). Even as the practice of simulation training grows, leadership such as the Government Accountability Office asserts that little has been done to demonstrate simulator impact on trainee proficiency. The M1A1 AGTS instructional sub system, the Improved Crew Training Program (ICTP), employs an automated matrix intended to increase Tank Commander (TC) and Gunner (GNR) team proficiency. This matrix is intended to guide the team along a trajectory of ever-increasing scenario difficulty. However, as designed, the sequencing of the matrix is based on subjective evaluation of difficulty, not on empirical or objective calculations of complexity. Without effective, automated SBT that adapts to the performance of the trainee, gaps in combat readiness and fiscal responsibility could grow large. In 2010, the author developed an algorithm intended to computationally define scenario complexity (Dunne, Schatz, Fiore, Martin & Nicholson, 2010) and conducted a proof of concept study to determine the algorithm*s effectiveness (Dunne, Schatz, Fiore, Nicholson & Fowlkes, 2010). Based on results of that study, and follow-on analysis, revisions were made to that Scenario Complexity (SC) algorithm. The purpose of this research was to examine the efficacy of the revised SC algorithm to enable Educators and Trainers, ISDs, and software engineers to objectively and computationally define SC. The research process included a period of instruction for Subject Matter Experts (SME) to receive instruction on how to identify the base variables that comprise SC. Using this knowledge SMEs then determined the values of the scenarios base variables. Once calculated, these values were ranked and compared to the ICTP matrix sequence. Results indicate that the SMEs were very consistent in their ratings of the items across scenario base variables. Due to the highly proceduralized process underlying advanced gunnery skills, this high degree of agreement was expected. However, the significant lack of correlation to the matrix sequencing is alarming and while a recent study has shown the AGTS to increase TC and GNR team proficiency (PM TRASYS, 2014a), this research*s findings suggests that redesign of the ICTP matrix is in order.

As habilidades não técnicas (HNT) complementam as habilidades técnicas, contribuindo para que o trabalho seja desempenhado de forma eficiente e segura. Sob a perspectiva da engenharia de resiliência (ER), o exercício das HNT não depende apenas da capacitação dos indivíduos, mas também do contexto organizacional. Esse trabalho aborda a capacitação baseada em cenários (CBC) como alternativa para a capacitação em HNT. A CBC apresenta cenários com problemas a serem solucionados pelos participantes, a partir de um contexto fidedigno ao encontrado na prática. Esta dissertação tem como objetivo principal identificar habilidades não técnicas e fatores para composição de cenários de treinamentos e como objetivos específicos: (a) identificar contribuições da organização do trabalho para o exercício das HNT; (b) identificar adaptações realizadas pelos eletricistas; (c) propor um programa de capacitação baseada em cenários com enfoque em habilidades não técnicas (HNT) de eletricistas que atuam em redes aéreas de distribuição. A aplicação prática do programa é ilustrada por meio de um estudo de caso em uma distribuidora de energia elétrica. O programa proposto é constituído por sete etapas: (0) Identificação das HNT; (1) Definição dos objetivos da capacitação; (2) Definição dos cenários de capacitação; (3) Definição do sistema de avaliação; (4) Refinamento da proposta para o programa de capacitação; (5) Capacitação dos instrutores; (6) Projeto Piloto; (7) Implantação da capacitação. / The non-technical skills (HNT) complement the technical skills, contributing to the work to be performed efficiently and safely. From the perspective of resilience engineering (RE), the exercise of HNT not only depends on the training of individuals, but also the organizational context. One of the methods used for such training is scenario-based training (CBC). The CBC presents scenarios with challenges to be addressed by participants, from a real context. This study has as main objective to identify electricians non technical skilss and to identify factores to composse the training scenarios. This studies also aim: (a) to identify organizational contributions for the non technical skills exercise; (b) to identify work adaptations; (c) to propose a scenario-based training program focusing non-technical skills. The practical implementation of the program is illustrated through a case study in an electricity distribution company. Seven steps compose the program: (0) Non-technical skills identification; (1) Definition of the training objectives; (2) Definition of training scenarios; (3) Definition of the evaluation system; (4) Refinement of the proposal for the training program;; (5) Trainer’s training; (6) Pilot Study; (7) Implementation.

As habilidades não técnicas (HNT) complementam as habilidades técnicas, contribuindo para que o trabalho seja desempenhado de forma eficiente e segura. Sob a perspectiva da engenharia de resiliência (ER), o exercício das HNT não depende apenas da capacitação dos indivíduos, mas também do contexto organizacional. Esse trabalho aborda a capacitação baseada em cenários (CBC) como alternativa para a capacitação em HNT. A CBC apresenta cenários com problemas a serem solucionados pelos participantes, a partir de um contexto fidedigno ao encontrado na prática. Esta dissertação tem como objetivo principal identificar habilidades não técnicas e fatores para composição de cenários de treinamentos e como objetivos específicos: (a) identificar contribuições da organização do trabalho para o exercício das HNT; (b) identificar adaptações realizadas pelos eletricistas; (c) propor um programa de capacitação baseada em cenários com enfoque em habilidades não técnicas (HNT) de eletricistas que atuam em redes aéreas de distribuição. A aplicação prática do programa é ilustrada por meio de um estudo de caso em uma distribuidora de energia elétrica. O programa proposto é constituído por sete etapas: (0) Identificação das HNT; (1) Definição dos objetivos da capacitação; (2) Definição dos cenários de capacitação; (3) Definição do sistema de avaliação; (4) Refinamento da proposta para o programa de capacitação; (5) Capacitação dos instrutores; (6) Projeto Piloto; (7) Implantação da capacitação. / The non-technical skills (HNT) complement the technical skills, contributing to the work to be performed efficiently and safely. From the perspective of resilience engineering (RE), the exercise of HNT not only depends on the training of individuals, but also the organizational context. One of the methods used for such training is scenario-based training (CBC). The CBC presents scenarios with challenges to be addressed by participants, from a real context. This study has as main objective to identify electricians non technical skilss and to identify factores to composse the training scenarios. This studies also aim: (a) to identify organizational contributions for the non technical skills exercise; (b) to identify work adaptations; (c) to propose a scenario-based training program focusing non-technical skills. The practical implementation of the program is illustrated through a case study in an electricity distribution company. Seven steps compose the program: (0) Non-technical skills identification; (1) Definition of the training objectives; (2) Definition of training scenarios; (3) Definition of the evaluation system; (4) Refinement of the proposal for the training program;; (5) Trainer’s training; (6) Pilot Study; (7) Implementation.

As habilidades não técnicas (HNT) complementam as habilidades técnicas, contribuindo para que o trabalho seja desempenhado de forma eficiente e segura. Sob a perspectiva da engenharia de resiliência (ER), o exercício das HNT não depende apenas da capacitação dos indivíduos, mas também do contexto organizacional. Esse trabalho aborda a capacitação baseada em cenários (CBC) como alternativa para a capacitação em HNT. A CBC apresenta cenários com problemas a serem solucionados pelos participantes, a partir de um contexto fidedigno ao encontrado na prática. Esta dissertação tem como objetivo principal identificar habilidades não técnicas e fatores para composição de cenários de treinamentos e como objetivos específicos: (a) identificar contribuições da organização do trabalho para o exercício das HNT; (b) identificar adaptações realizadas pelos eletricistas; (c) propor um programa de capacitação baseada em cenários com enfoque em habilidades não técnicas (HNT) de eletricistas que atuam em redes aéreas de distribuição. A aplicação prática do programa é ilustrada por meio de um estudo de caso em uma distribuidora de energia elétrica. O programa proposto é constituído por sete etapas: (0) Identificação das HNT; (1) Definição dos objetivos da capacitação; (2) Definição dos cenários de capacitação; (3) Definição do sistema de avaliação; (4) Refinamento da proposta para o programa de capacitação; (5) Capacitação dos instrutores; (6) Projeto Piloto; (7) Implantação da capacitação. / The non-technical skills (HNT) complement the technical skills, contributing to the work to be performed efficiently and safely. From the perspective of resilience engineering (RE), the exercise of HNT not only depends on the training of individuals, but also the organizational context. One of the methods used for such training is scenario-based training (CBC). The CBC presents scenarios with challenges to be addressed by participants, from a real context. This study has as main objective to identify electricians non technical skilss and to identify factores to composse the training scenarios. This studies also aim: (a) to identify organizational contributions for the non technical skills exercise; (b) to identify work adaptations; (c) to propose a scenario-based training program focusing non-technical skills. The practical implementation of the program is illustrated through a case study in an electricity distribution company. Seven steps compose the program: (0) Non-technical skills identification; (1) Definition of the training objectives; (2) Definition of training scenarios; (3) Definition of the evaluation system; (4) Refinement of the proposal for the training program;; (5) Trainer’s training; (6) Pilot Study; (7) Implementation.

The U.S. Army desires to improve safety during Intelligence, Surveillance, Reconnaissance (ISR) operations by removing Warfighters from direct line-of-fire by enhancing ISR operational capabilities with unmanned systems, also known as Robot-Aided ISR (RAISR) (DOD, 2013). Additionally, RAISR presents an opportunity to fulfill ISR capability requirements of modern combat environments including: detection of High-Value Individuals (HVI) from safer distances, identification of baseline behavior, and interpretation of adversarial intent (U.S. Army, 2008). Along with the demand and projected acquisition of RAISR technology, there is the added need to design training requirements for system operation and task execution instruction. While documentation identifying specific training standards and objectives for ISR tasks utilizing unmanned systems is limited (DOD, 2013), simulation-based training has been identified as a critical training medium for RAISR (U.S. Army, 2008). ISR analysts will primarily conduct RAISR tasks via Indirect Vision Displays (IVD) which transition well into multimodal simulations (Salcedo, Lackey, & Maraj, 2014). However, simulation alone may not fulfill the complex training needs of RAISR tasks, therefore, incorporating instructional support may improve the effectiveness of training (Oser, Gualtieri, Cannon-Bowers, & Salas, 1999). One method to accomplish this is to utilize a Scenario-Based Training (SBT) framework enhanced with instructional strategies to target specific training objectives. The purpose for the present experiment was to assess the effectiveness of SBT enhanced with selected instructional strategies for a PC-based RAISR training simulation. The specific task type was the identification of HVIs within a group through behavior cue analysis. The instructional strategies assessed in this experiment, Highlighting and Massed Exposure, have shown to improve attentional weighting, visual search, and pattern recognition skills, which are critical for successful behavior cue analysis. Training effectiveness was evaluated by analyzing the impact of the instructional strategies on performance outcomes, including detection accuracy, classification accuracy, and median response time, and perceptions of the level of engagement, immersion, and presence during training exercises. Performance results revealed that the Massed Exposure strategy produced significantly faster response times for one subtle and one familiar target behavior cue. Perception results indicated that Highlighting was the least challenging instructional strategy and the Control offered the preferred level of challenge. The relationships between performance and perception measures revealed that higher levels of engagement, immersion, and presence were associated with better performance in the Control, but this trend did not always hold for Massed Exposure and Highlighting. Furthermore, presence emerged as the primary predictor of performance for select target behavior cues in the Control and Massed Exposure conditions, while immersion and engagement predicted performance of select cues in the Highlighting condition. The findings of the present experiment point to the potential benefit of SBT instructional strategies to improve effectiveness of simulation-based training for behavior cue analysis during RAISR operations. Specifically, the findings suggest that the Massed Exposure strategy has the potential to improve response time when detecting both familiar and novel targets. The results also highlight directions for future research to investigate methods to alter instructional strategy design and delivery in order to improve trainee perceptions of the instruction.

In the aviation industry, digitally produced and presented flight, navigation, and aircraft information is commonly referred to as glass flight decks. Glass flight decks are driven by computer-based subsystems and have long been a part of military and commercial aviation sectors. Over the past 15 years, the General Aviation (GA) sector of the aviation industry has become a recent beneficiary of the rapid advancement of computer-based glass flight deck (GFD) systems. While providing the GA pilot considerable enhancements in the quality of information about the status and operations of the aircraft, training pilots on the use of glass flight decks is often delivered with traditional methods (e.g. textbooks, PowerPoint presentations, user manuals, and limited computer-based training modules). These training methods have been reported as less than desirable in learning to use the glass flight deck interface. Difficulties in achieving a complete understanding of functional and operational characteristics of the GFD systems, acquiring a full understanding of the interrelationships of the varied subsystems, and handling the wealth of flight information provided have been reported. Documented pilot concerns of poor user experience and satisfaction, and problems with the learning the complex and sophisticated interface of the GFD are additional issues with current pilot training approaches. A case study was executed to explore ways to improve training using GFD systems at a Midwestern aviation university. The researcher investigated if variations in instructional systems design and training methods for learning glass flight deck technology would affect the perceptions and attitudes of pilots of the learnability (an attribute of usability) of the glass flight deck interface. Specifically, this study investigated the effectiveness of scenario-based training (SBT) methods to potentially improve pilot knowledge and understanding of a GFD system, and overall pilot user experience and satisfaction. Participants overwhelmingly reported positive learning experiences from scenario-based GFD systems flight training, noting that learning and knowledge construction were improved over other training received in the past. In contrast, participants rated the usability and learnability of the GFD training systems low, reporting various problems with the systems’ interface, and the learnability (first-time use) of the complex GFD system. However, issues with usability of the GFD training systems did not reduce or change participant attitudes towards learning and mastering GFD systems; to the contrary, all participants requested additional coursework opportunities to train on GFD systems with the scenario-based flight training format.