This study is based on Kirkpatrick's (1996) four level evaluation model. The study assessed the correlation between and among three levels of data that resulted from evaluation processes used in the U.S. Air Force technical training. The three levels of evaluation included trainee reaction (Level 1), test scores (Level 2), and job performance (Level 3). Level 1 data was obtained from the results of a 20 item survey that employed a 5-point Likert scale rating. Written test scores were used for Level 2 data. The Level 3 data was collected from supervisors of new graduates using a 5-point Likert scale survey. The study was conducted on an existing database of Air Force technical training graduates. The subjects were trainees that graduated since the process of collecting and storing Levels 1 and 2 data in computerized database began. All subjects for this study graduated between March 1997 and January 1999. A total of 188 graduates from five Air Force specialties were included. Thirty-four cases were from a single course in the aircrew protection specialty area; 12 were from a single course in the munitions and weapons specialty area; and 142 were from three separate courses in the manned aerospace maintenance specialty area. Pearson product moment correlation coefficients were computed to determine the correlation coefficients between Levels 1 and 2; Level 1 and 3; Level 2 and 3 for each subject course. Multiple linear regression was used to determine the relationship between the composite of Levels 1 and 2 and Level 3. There were significant correlation coefficients between Levels 1 and 2 and Levels 2 and 3 for only one of the five courses. The linear regression analysis revealed no significant correlation using the composite of Levels 1 and 2 as a predictor of Level 3.
| Identifer | oai:union.ndltd.org:unt.edu/info:ark/67531/metadc2259 |
| Date | 12 1900 |
| Creators | Boyd, Steven W. |
| Contributors | Allen, Jeff M., Young, Jon I., Wircenski, Jerry L. |
| Publisher | University of North Texas |
| Source Sets | University of North Texas |
| Language | English |
| Detected Language | English |
| Type | Thesis or Dissertation |
| Format | Text |
| Rights | Public, Copyright, Boyd, Steven W., Copyright is held by the author, unless otherwise noted. All rights reserved. |
Page generated in 0.0012 seconds