The current study is a significant portion of a content validation study conducted to evaluate new selection tools developed by an organization. In it I assessed the content validity of a structured interview through the following steps: conducting a literature review to establish best practices, reviewing the data gathering process, conducting data analyses, recommending item weights, evaluating the validity of the interview, suggesting standardized materials, creating a plan for training for interview use, and ensuring documentation is kept as required by law.
The data were collected internally by the organization and were provided for analyses. Analyses included one-way ANOVAs, and the calculation of r*wg for the Subject Matter Expert (SME) importance ratings. Results indicated that the SME ratings exhibited acceptable interrater agreement and that all competencies were important. Therefore, the interview based on these ratings has acceptable content validity. Recommendations were provided to the organization regarding possible alternatives and the impact that the decisions made would have on the resulting validity.
| Identifer | oai:union.ndltd.org:WKU/oai:digitalcommons.wku.edu:theses-1151 |
| Date | 01 May 2010 |
| Creators | Heighway, Michael |
| Publisher | TopSCHOLAR® |
| Source Sets | Western Kentucky University Theses |
| Detected Language | English |
| Type | text |
| Format | application/pdf |
| Source | Masters Theses & Specialist Projects |
Page generated in 0.0016 seconds