In this study, we analyzed the validity and reliability of the Infant-Toddler Meaningful Auditory Integration Scales (IT-MAIS; Zimmerman-Phillips, Osberger, & Robbins, 2001), an assessment designed to measure listening skills in children ages 0-3 years. The IT-MAIS is a caregiver report tool used by speech-language pathologists and audiologists to assess listening skills in children with sensorineural hearing loss (SNHL) pre- and post-cochlear implant (CI). The IT-MAIS is widely used; however, it has not undergone thorough psychometric analysis.
Using longitudinal data collected by the University of Iowa Childrens Cochlear Implant Program, we analyzed the psychometric properties of the IT-MAIS via Rasch analysis, a 1-parameter (1-PL) model of Item Response Theory (IRT; Lord & Novick, 1968). Pre- and post- CI assessments from 23 CI users aged 10 to 36 months were evaluated.
IRT is a form of psychometric analysis that is emerging in the behavioral sciences as a viable alternative to Classical Test Theory for test development and analysis. IRT results are similar, but not identical to classically derived concepts of validity and reliability. Specifically, we analyzed the content and construct validity of the IT-MAIS. We found that 2 out of 10 items exceeded misfit criteria, meaning participants did not respond predictably to these 2 items. We also found that the item-difficulty range did not capture the full range of participant ability, especially the higher range of participant ability. Therefore, the IT-MAIS may not be assessing higher-level listening skills, particularly in children post-CI. Rasch analysis also revealed that 1 of the 5 rating scale categories was not used predictably, indicating that the rating scale was not used as the test developers (Zimmerman-Phillips, Osberger, & Robbins) intended. To analyze item order relative to sequential development of listening skills, we established an a priori item rank order and compared it to item difficulty order established by Rasch analysis. Overall, our results indicated the IT-MAIS did not demonstrate ideal item-level psychometric properties according to Rasch analysis and item order did not reflect sequential development of listening skills. We concluded that the IT-MAIS should not be used to assess listening development from pre- to post-CI.
| Identifer | oai:union.ndltd.org:LSU/oai:etd.lsu.edu:etd-04092013-200636 |
| Date | 29 April 2013 |
| Creators | Schubert, Anne Denise |
| Contributors | Donovan, Neila, Barker, Brittan, Hoffman, Paul |
| Publisher | LSU |
| Source Sets | Louisiana State University |
| Language | English |
| Detected Language | English |
| Type | text |
| Format | application/pdf |
| Source | http://etd.lsu.edu/docs/available/etd-04092013-200636/ |
| Rights | unrestricted, I hereby certify that, if appropriate, I have obtained and attached herein a written permission statement from the owner(s) of each third party copyrighted matter to be included in my thesis, dissertation, or project report, allowing distribution as specified below. I certify that the version I submitted is the same as that approved by my advisory committee. I hereby grant to LSU or its agents the non-exclusive license to archive and make accessible, under the conditions specified below and in appropriate University policies, my thesis, dissertation, or project report in whole or in part in all forms of media, now or hereafter known. I retain all other ownership rights to the copyright of the thesis, dissertation or project report. I also retain the right to use in future works (such as articles or books) all or part of this thesis, dissertation, or project report. |
Page generated in 0.0102 seconds