Thesis (M.S. in Human Systems Integration)--Naval Postgraduate School, June 2009. / Thesis Advisor(s): O'Connor, Paul E. "June 2009." Description based on title screen as viewed on July 10, 2009. DTIC Identifiers: CRM (Crew Resource Management), training evaluation, aviation mishaps, cockpit resource management, training effectiveness evaluation, human error. Author(s) subject terms: Crew Resource Management, CRM, Naval Aviation, Training Evaluation, Cockpit Resource Management, Safety, Aviation Mishaps, Training Effectiveness Evaluation. Includes bibliographical references (p.99-106). Also available in print.

Traditional use of the multiple-choice question rewards a student for guessing. This technique encourages rote memorization of questions to pass a lengthy exam, and does not promote comprehensive understanding or subject correlation. This begs the question; do we really want question memorizers to operate the machinery of our industrialized society? In an effort to identify guessing on answers during an exam within a safety-critical aviation pilot training course, a qualitative research study was undertaken that introduced a confidence-based element to the end-of-ground-school exam followed by flight simulator sessions. The research goals were twofold, to clearly identify correct guesses and also provide an evidence-based snapshot of aircraft systems knowledge to be used as a formative study aid for the remainder of the course. Pilot and instructor interviews were conducted to gather perceptions and opinions about the effectiveness of the confidence-based assessment tool. The finding of overall positive interview comments confirmed that the pilots and flight instructors successfully used the confidence-based assessments as intended to identify weak knowledge areas and as aids, or plans, for their remaining study time. The study found that if properly trained and administered—especially through a computer-based medium—a robust confidence-based assessment tool would be minimally-burdensome while offering worthwhile benefits.

No description available.

This research investigates the Training Effectiveness of a low-cost, PC-based training system when compared with two modes (motion and no motion) of a cab training system with large screen for various aviation flying tasks. While much research on this topic has been done in the past, advances in technology have significantly altered what is considered a "low-cost" "simulator." The technology advances have in effect increased the ability of a "low-cost" "simulator" to deliver desired experiences to the user. These "simulators" often are nothing more than PC training system, with only notional representations of the actual aircraft. This research considers the use of such training systems in training for a highly complex and dynamic task situation, that task being a search and rescue mission. A search and rescue mission is far more complex task than those studied for possible "low-cost" simulation substitution in the past. To address that aspect, one mode of the cab involves motion in two degrees of freedom. The results of this research advances the body of literature on the capability of "low-cost" simulation to deliver the experiences necessary to learn highly complex tasks associated with search and rescue as well as further clarify the extent to which a motion platform aides in flight training. This research utilizes available platforms provided by the US Army Research, Development and Engineering Command Simulation and Training Technology Center. Additionally, all the participants in the research are in training to be helicopter pilots. Participants were randomly assigned to one of three training configurations: a) Cab with motion turned ON, b) Cab with motion turned OFF and c) PC-based simulator. Training effectiveness is evaluated using measures for learning, task performance, and human factors. Statistically significant results are shown for the Cab with Motion and the Cab with No Motion configurations.

The Traffic alert and Collision Avoidance System (TCAS) is an aircraft collision avoidance system designed to prevent mid-air collisions. During an advisory, danger is imminent, and TCAS is assumed to have better, more up-to-date information than the ground operated air traffic control (ATC) facility. Following a TCAS RA is generally the safe course of action during an advisory. However, pilot compliance with RAs is surprisingly low. Results from a TCAS monitoring study show pilots are not complying with many TCAS advisories. As revealed by pilot-submitted Aviation Safety Reporting System (ASRS) reports, this noncompliance could be attributed, in part, to pilot confusion to TCAS operation as well as misunderstandings of the appropriate response to a TCAS issued advisory. This thesis details the development and evaluation of a TCAS training program intended to improve pilots' understanding of TCAS use for collision avoidance in a range of traffic situations. The training program integrated Demonstration Based and Event Based Training techniques. Its efficacy was analyzed in an integrated ATC-cockpit simulator study in which eighteen commercial airline pilots were asked to complete the TCAS training program and afterwards experienced twelve experimental traffic events. The trained pilots' performance was compared to the performance of 16 baseline pilots who did not receive the modified training. Overall, the training program did have a significant impact on the pilots' behavior and response to TCAS advisories. The measure Time Pilots First Achieved Compliance decreased with the trained pilots, as did the measure Autopilot Disconnect Time After RA Initiation. Trained pilots exhibited less aggressive performance in response to a TCAS RA (including a decrease in the measures Altitude Deviation Over Duration Of RA, Average Vertical Rate Difference, Maximum Vertical Rate Difference, and Maximum Vertical Rate). The measure Percent Compliance did not significantly vary between trained and baseline pilots, although trained pilots had a more consistent response in the traffic event with conflicting ATC guidance. Finally, on the post-experiment questionnaires, pilots commented on their increase in understanding of TCAS as well as an increase in their trust in the advisory system. Results of this research inform TCAS training objectives provided by the FAA as well as the design of TCAS training. Additionally, conclusions extend more broadly to improved training techniques for other similar complex, time-critical situations.