Return to search

The stability of item-parameter estimates across time: A comparison of item response models and selected estimation procedures

This study examined the stability of item parameter estimates across time using (a) different item response models and (b) different estimation procedures. These stabilities were examined in the context of item banking. According to Item Response Theory, the item parameter estimates should not differ from administration to administration. Any differences in the item parameter estimates, among other factors, may be attributed to changes in emphasis of school curricula over time, using an inappropriate model, or the error associated with estimation procedures used to estimate the item parameters. / The factors and their levels in this investigation were (a) model: one-, two-, and three-parameter models, with a common value for guessing; (b) estimation procedures for item parameters: Joint Maximum Likelihood (JML) using the LOGIST computer program, and Marginal Maximum Likelihood (MML) using the BILOG computer program. / The test used in this study was the SSAT-II Mathematics test. Data for this study were obtained from test results of the March 1985 and March 1986 test administration. This test was administered to approximately 100,000 10th grade students in Florida who had to pass this test to graduate. The Mathematics test consisted of 75 items. Of these, 49 items were common to both the 1985 and 1986 tests. The analyses were performed on four representative samples, each 1000 first-time takers. / Results showed that regardless of the model used and estimation procedures employed, the parameter estimate changes on the average between the 1985 and 1986 test administrations were significantly higher than parameter estimate changes between the two 1985 samples. However, the changes were not across most of the items. Only two items demonstrated significant change beyond what was expected from sampling fluctuation. / The one-parameter model produced significantly lower mean differences between ICCs than the two- and the modified three-parameter models. This pattern of differences was observed to be similar for both the JML and the MML estimation procedures. The MML estimation procedure produced significantly smaller mean differences than the JML estimation procedure. / Source: Dissertation Abstracts International, Volume: 49-06, Section: A, page: 1436. / Major Professor: F. J. King. / Thesis (Ph.D.)--The Florida State University, 1988.

Identiferoai:union.ndltd.org:fsu.edu/oai:fsu.digital.flvc.org:fsu_76274
ContributorsBaghi, Heibatollah., Florida State University
Source SetsFlorida State University
LanguageEnglish
Detected LanguageEnglish
TypeText
Format142 p.
RightsOn campus use only.
RelationDissertation Abstracts International

Page generated in 0.0018 seconds