{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-10922"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-10922","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Comparison of Parameter Estimation Approaches for Multi-Unidimensional Pairwise Preference Tests","abstract":"Multidimensional forced choice (MFC) testing has been proposed as a way of reducing response biases in noncognitive measurement. Although early item response theory (IRT) research focused on illustrating that trait scores with normative properties could be obtained using various MFC models and formats, more recent attention has been devoted to exploring the processes involved in test construction and how that influences MFC scores. This research compared two approaches for estimating Multi-Unidimensional Pairwise Preference model (MUPP; Stark et al., 2005) parameters based on the Generalized Graded Unfolding Model (GGUM; Roberts et al., 2000). More specifically, we compared the efficacy of statement and person parameter estimation based on a “two-step” process, developed by Stark et al. (2005) with a more recently developed “direct” estimation approach (Lee et al., 2019) in a Monte Carlo study that also manipulated test length, test dimensionality, sample size, and the correlations between generating thetas for each dimension. Results indicated that the two approaches had similar scoring accuracy, although the two-step approach had better statement parameter recovery than the direct approach. Implications, limitations, and recommendations for future MFC research and practice are discussed.","abstract_html":"Multidimensional forced choice (MFC) testing has been proposed as a way of reducing response biases in noncognitive measurement. Although early item response theory (IRT) research focused on illustrating that trait scores with normative properties could be obtained using various MFC models and formats, more recent attention has been devoted to exploring the processes involved in test construction and how that influences MFC scores. This research compared two approaches for estimating Multi-Unidimensional Pairwise Preference model (MUPP; Stark et al., 2005) parameters based on the Generalized Graded Unfolding Model (GGUM; Roberts et al., 2000). More specifically, we compared the efficacy of statement and person parameter estimation based on a “two-step” process, developed by Stark et al. (2005) with a more recently developed “direct” estimation approach (Lee et al., 2019) in a Monte Carlo study that also manipulated test length, test dimensionality, sample size, and the correlations between generating thetas for each dimension. Results indicated that the two approaches had similar scoring accuracy, although the two-step approach had better statement parameter recovery than the direct approach. Implications, limitations, and recommendations for future MFC research and practice are discussed.","abstract_has_math":false,"creators":["Tu, Naidan"],"institution":"University of South Florida","degree_name":"Master of Arts (M.A.)","degree_level":"Thesis","degree_discipline":"Psychology","degree_department":null,"school":null,"contributors":["Stephen Stark, Ph.D.","Seang-Hwane Joo, Ph.D.","Brenton M. Wiernik, Ph.D.","Marina A. Bornovalova, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-10-06T07:00:00Z","date_published":"2021-10-06T07:00:00Z","updated_at":"2026-11-19T08:48:12Z","subjects":["Markov chain Monte Carlo (MCMC)","Item Response Theory (IRT)","Generalized Graded Unfolding Model (GGUM)","Forced Choice","Psychology"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/9725","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/9725","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-10922","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Stephen Stark, Ph.D.","Seang-Hwane Joo, Ph.D.","Brenton M. Wiernik, Ph.D.","Marina A. Bornovalova, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Tu, Naidan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2021-10-06T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Psychology"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis","M.A."]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Arts (M.A.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Markov chain Monte Carlo (MCMC)","Item Response Theory (IRT)","Generalized Graded Unfolding Model (GGUM)","Forced Choice","Psychology"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/9725"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Multidimensional forced choice (MFC) testing has been proposed as a way of reducing response biases in noncognitive measurement. Although early item response theory (IRT) research focused on illustrating that trait scores with normative properties could be obtained using various MFC models and formats, more recent attention has been devoted to exploring the processes involved in test construction and how that influences MFC scores. This research compared two approaches for estimating Multi-Unidimensional Pairwise Preference model (MUPP; Stark et al., 2005) parameters based on the Generalized Graded Unfolding Model (GGUM; Roberts et al., 2000). More specifically, we compared the efficacy of statement and person parameter estimation based on a “two-step” process, developed by Stark et al. (2005) with a more recently developed “direct” estimation approach (Lee et al., 2019) in a Monte Carlo study that also manipulated test length, test dimensionality, sample size, and the correlations between generating thetas for each dimension. Results indicated that the two approaches had similar scoring accuracy, although the two-step approach had better statement parameter recovery than the direct approach. Implications, limitations, and recommendations for future MFC research and practice are discussed."]},{"key":"dc:title","label":"Title","values":["Comparison of Parameter Estimation Approaches for Multi-Unidimensional Pairwise Preference Tests"]}]}],"canonical_facts":{"dc:contributor":["Stephen Stark, Ph.D.","Seang-Hwane Joo, Ph.D.","Brenton M. Wiernik, Ph.D.","Marina A. Bornovalova, Ph.D."],"dc:creator":["Tu, Naidan"],"dc:date":["2021-10-06T07:00:00Z"],"dc:description":["Multidimensional forced choice (MFC) testing has been proposed as a way of reducing response biases in noncognitive measurement. Although early item response theory (IRT) research focused on illustrating that trait scores with normative properties could be obtained using various MFC models and formats, more recent attention has been devoted to exploring the processes involved in test construction and how that influences MFC scores. This research compared two approaches for estimating Multi-Unidimensional Pairwise Preference model (MUPP; Stark et al., 2005) parameters based on the Generalized Graded Unfolding Model (GGUM; Roberts et al., 2000). More specifically, we compared the efficacy of statement and person parameter estimation based on a “two-step” process, developed by Stark et al. (2005) with a more recently developed “direct” estimation approach (Lee et al., 2019) in a Monte Carlo study that also manipulated test length, test dimensionality, sample size, and the correlations between generating thetas for each dimension. Results indicated that the two approaches had similar scoring accuracy, although the two-step approach had better statement parameter recovery than the direct approach. Implications, limitations, and recommendations for future MFC research and practice are discussed."],"dc:identifier":["https://digitalcommons.usf.edu/etd/9725"],"dc:subject":["Markov chain Monte Carlo (MCMC)","Item Response Theory (IRT)","Generalized Graded Unfolding Model (GGUM)","Forced Choice","Psychology"],"dc:title":["Comparison of Parameter Estimation Approaches for Multi-Unidimensional Pairwise Preference Tests"],"thesis:degree_discipline":["Psychology"],"thesis:degree_level":["Thesis","M.A."],"thesis:degree_name":["Master of Arts (M.A.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:48:12Z"}