Return to search

A Simulation Study to Compare the Sensitivity of Goodness of Fit Indices in Testing Measurement Invariance

In conducting a cross-cultural study with a quantitative method, the researchers need to effectively address the cultural and linguistic influence on the operation of the instrument (or scale) across population groups. Measurement invariance (MI) provides valuable information to this concern and is the key to many psychological and developmental research studies. It is tested by evaluating how well the specified model fits the observed data. Researchers had developed effective fit indices to evaluate MI. Most scholars utilized the chi-square test with some alternative fit indices (such as root mean square error of approximation (RMSEA), standardized root-mean-square residual (SRMR), comparative fit index (CFI), and others) to report MI. Researchers argue about the sensitivity of these fit indices, and whether these fit indices accurately reflect the MI level. The current study followed Khojasteh and Lo (2015)'s study to test the sensitivities of a series of fit indices, including ΔCFI, ΔRMSEA, ΔSRMR, ΔGamma, and Δχ2, under specified conditions with Monte Carlo simulation data. Experimental conditions included test length, number of factors, sample sizes, factor loadings, and the percentage of noninvariant items. Results showed that the ΔCFI and ΔGamma are most powerful in testing invariance and are less sensitive to the sample size and non-invariance (or lack of invariance, LOI) situations. There was inflation in Type I error in the 2 factors 8 variable models. ΔSRMR and ΔRMSEA are more powerful only when the sample size is 1,000. ΔSRMR is sensitive to sample size and level of LOI; hence, it is not recommended. The results are compared with previous simulation studies and provide significant implications to researchers who are applying measurement invariance procedures about what fit indices to adopt in their studies.

Identiferoai:union.ndltd.org:ucf.edu/oai:stars.library.ucf.edu:etd2020-2201
Date01 January 2022
CreatorsGao, Xueying
PublisherSTARS
Source SetsUniversity of Central Florida
LanguageEnglish
Detected LanguageEnglish
Typetext
Formatapplication/pdf
SourceElectronic Theses and Dissertations, 2020-

Page generated in 0.0556 seconds