{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-12461"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-12461","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Examining Tradeoffs of Exposure Control and Collateral Information with Multidimensional Forced Choice Computerized Adaptive Testing","abstract":"Multidimensional forced choice (MFC) testing has been proposed as an alternative to single statement (SS) Likert-type measures to reduce response biases in noncognitive measurement. Research progress has been made on MFC computerized adaptive testing (CAT) to improve testing efficiency. CAT enhances efficiency by successively selecting items that are most informative at each respondent’s estimated trait score. In MFC CAT, this causes some forced choice items and the statements composing them to be frequently exposed while others are rarely used, which adversely affects test security and costs. This research develops an exposure control method for MFC CAT based on the Multi-Unidimensional Pairwise Preference model (MUPP; Stark et al., 2005). Because the method is intended to prevent the overuse of the most informative items and statements, it tends to decrease overall measurement accuracy and precision. Thus, a second purpose of this research is to examine the extent to which these losses in accuracy and precision might be offset by incorporating collateral information. The effectiveness of the exposure control method and the incorporation of collateral information in MFC CAT was investigated in a Monte Carlo study that also manipulated test length and the correlation between dimensions. A byproduct of this research is an MFC CAT algorithm that improves test security and cost-effectiveness, while simultaneously maintaining measurement accuracy and precision.","abstract_html":"Multidimensional forced choice (MFC) testing has been proposed as an alternative to single statement (SS) Likert-type measures to reduce response biases in noncognitive measurement. Research progress has been made on MFC computerized adaptive testing (CAT) to improve testing efficiency. CAT enhances efficiency by successively selecting items that are most informative at each respondent’s estimated trait score. In MFC CAT, this causes some forced choice items and the statements composing them to be frequently exposed while others are rarely used, which adversely affects test security and costs. This research develops an exposure control method for MFC CAT based on the Multi-Unidimensional Pairwise Preference model (MUPP; Stark et al., 2005). Because the method is intended to prevent the overuse of the most informative items and statements, it tends to decrease overall measurement accuracy and precision. Thus, a second purpose of this research is to examine the extent to which these losses in accuracy and precision might be offset by incorporating collateral information. The effectiveness of the exposure control method and the incorporation of collateral information in MFC CAT was investigated in a Monte Carlo study that also manipulated test length and the correlation between dimensions. A byproduct of this research is an MFC CAT algorithm that improves test security and cost-effectiveness, while simultaneously maintaining measurement accuracy and precision.","abstract_has_math":false,"creators":["Tu, Naidan"],"institution":"University of South Florida","degree_name":"Doctor of Philosophy (Ph.D.)","degree_level":"Dissertation","degree_discipline":"Psychology","degree_department":null,"school":null,"contributors":["Stephen Stark, Ph.D.","Georgia Chao, Ph.D.","Daniel Griffin, Ph.D.","Marina Bornovalova, Ph.D.","Sean Joo, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-06-25T07:00:00Z","date_published":"2024-06-25T07:00:00Z","updated_at":"2026-11-19T08:51:46Z","subjects":["Faking","Item Response Theory (IRT)","Multi-Unidimensional Pairwise Preference (MUPP)","Noncognitive Assessment","Psychology"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/11158","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/11158","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-12461","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Stephen Stark, Ph.D.","Georgia Chao, Ph.D.","Daniel Griffin, Ph.D.","Marina Bornovalova, Ph.D.","Sean Joo, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Tu, Naidan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-06-25T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Psychology"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation","Ph.D."]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy (Ph.D.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Faking","Item Response Theory (IRT)","Multi-Unidimensional Pairwise Preference (MUPP)","Noncognitive Assessment","Psychology"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/11158"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Multidimensional forced choice (MFC) testing has been proposed as an alternative to single statement (SS) Likert-type measures to reduce response biases in noncognitive measurement. Research progress has been made on MFC computerized adaptive testing (CAT) to improve testing efficiency. CAT enhances efficiency by successively selecting items that are most informative at each respondent’s estimated trait score. In MFC CAT, this causes some forced choice items and the statements composing them to be frequently exposed while others are rarely used, which adversely affects test security and costs. This research develops an exposure control method for MFC CAT based on the Multi-Unidimensional Pairwise Preference model (MUPP; Stark et al., 2005). Because the method is intended to prevent the overuse of the most informative items and statements, it tends to decrease overall measurement accuracy and precision. Thus, a second purpose of this research is to examine the extent to which these losses in accuracy and precision might be offset by incorporating collateral information. The effectiveness of the exposure control method and the incorporation of collateral information in MFC CAT was investigated in a Monte Carlo study that also manipulated test length and the correlation between dimensions. A byproduct of this research is an MFC CAT algorithm that improves test security and cost-effectiveness, while simultaneously maintaining measurement accuracy and precision."]},{"key":"dc:title","label":"Title","values":["Examining Tradeoffs of Exposure Control and Collateral Information with Multidimensional Forced Choice Computerized Adaptive Testing"]}]}],"canonical_facts":{"dc:contributor":["Stephen Stark, Ph.D.","Georgia Chao, Ph.D.","Daniel Griffin, Ph.D.","Marina Bornovalova, Ph.D.","Sean Joo, Ph.D."],"dc:creator":["Tu, Naidan"],"dc:date":["2024-06-25T07:00:00Z"],"dc:description":["Multidimensional forced choice (MFC) testing has been proposed as an alternative to single statement (SS) Likert-type measures to reduce response biases in noncognitive measurement. Research progress has been made on MFC computerized adaptive testing (CAT) to improve testing efficiency. CAT enhances efficiency by successively selecting items that are most informative at each respondent’s estimated trait score. In MFC CAT, this causes some forced choice items and the statements composing them to be frequently exposed while others are rarely used, which adversely affects test security and costs. This research develops an exposure control method for MFC CAT based on the Multi-Unidimensional Pairwise Preference model (MUPP; Stark et al., 2005). Because the method is intended to prevent the overuse of the most informative items and statements, it tends to decrease overall measurement accuracy and precision. Thus, a second purpose of this research is to examine the extent to which these losses in accuracy and precision might be offset by incorporating collateral information. The effectiveness of the exposure control method and the incorporation of collateral information in MFC CAT was investigated in a Monte Carlo study that also manipulated test length and the correlation between dimensions. A byproduct of this research is an MFC CAT algorithm that improves test security and cost-effectiveness, while simultaneously maintaining measurement accuracy and precision."],"dc:identifier":["https://digitalcommons.usf.edu/etd/11158"],"dc:subject":["Faking","Item Response Theory (IRT)","Multi-Unidimensional Pairwise Preference (MUPP)","Noncognitive Assessment","Psychology"],"dc:title":["Examining Tradeoffs of Exposure Control and Collateral Information with Multidimensional Forced Choice Computerized Adaptive Testing"],"thesis:degree_discipline":["Psychology"],"thesis:degree_level":["Dissertation","Ph.D."],"thesis:degree_name":["Doctor of Philosophy (Ph.D.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:51:46Z"}