{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-3963"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-3963","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"A Dynamic Simulation Assessment of English as a Second Language Students' Academic Readiness: An Initial Validation of a University Admissions Tool","abstract":"This study investigated the measurement quality of the Content Learning Experience: Academic Readiness (CLEAR) test, a new measure for university admissions decisions regarding English as a Second Language (ESL) applicants. The CLEAR test measures ability through dynamic simulation: learning opportunities are followed by testing how well students learned the academic content, all modeled on university instructional experiences. Measured by the CLEAR is academic readiness (AR), the direct, present evidence of ability to learn academic content via the second language as demonstrated during the dynamic simulation. AR is hypothesized to comprise above-threshold academic language proficiency, personal characteristics, topical knowledge, academic skills, and academic auxiliaries (motivation, study skills, engagement, work drive, emotional stability, affective schemata, and metacognitive strategies). The participants were 36 international adults, studying pre-university academic English at intensive institutes in Florida who volunteered to take the CLEAR during the summer of 2004. Data were collected via the CLEAR multiple-choice knowledge test and essay test, teacher ratings, examinee feedback, and external measures. Results showed the CLEAR knowledge test functions well at the item level although overall scores are only moderately consistent. The essay scoring consistency was satisfactory, perhaps partly due to the purpose-built scoring tool Good support for content-related validity claims was found for the dynamic simulation overall, for the stimulus materials, for the knowledge test items, for the essay prompt, and for the essay scoring tool. The concurrent measure of teacher ratings correlated with the knowledge test, but not with the content-based essay. Concerning construct-related claims of validity, support was evinced through the literature review as well as through inter-subtest correlation. External measures suggested some discriminant evidentiary support. Examinees perceived that the CLEAR closely resembled the target environment, they judged the CLEAR quality to be a key feature, and they would recommend the CLEAR to a friend for the growth experience. In conclusion, the CLEAR dynamic simulation assessment appears to offer potential to university admissions testing for non-native English speakers, particularly regarding the utility of the learning potential measurement, the essay scoring tool, and the examinee perceptions of the test.","abstract_html":"This study investigated the measurement quality of the Content Learning Experience: Academic Readiness (CLEAR) test, a new measure for university admissions decisions regarding English as a Second Language (ESL) applicants. The CLEAR test measures ability through dynamic simulation: learning opportunities are followed by testing how well students learned the academic content, all modeled on university instructional experiences. Measured by the CLEAR is academic readiness (AR), the direct, present evidence of ability to learn academic content via the second language as demonstrated during the dynamic simulation. AR is hypothesized to comprise above-threshold academic language proficiency, personal characteristics, topical knowledge, academic skills, and academic auxiliaries (motivation, study skills, engagement, work drive, emotional stability, affective schemata, and metacognitive strategies). The participants were 36 international adults, studying pre-university academic English at intensive institutes in Florida who volunteered to take the CLEAR during the summer of 2004. Data were collected via the CLEAR multiple-choice knowledge test and essay test, teacher ratings, examinee feedback, and external measures. Results showed the CLEAR knowledge test functions well at the item level although overall scores are only moderately consistent. The essay scoring consistency was satisfactory, perhaps partly due to the purpose-built scoring tool Good support for content-related validity claims was found for the dynamic simulation overall, for the stimulus materials, for the knowledge test items, for the essay prompt, and for the essay scoring tool. The concurrent measure of teacher ratings correlated with the knowledge test, but not with the content-based essay. Concerning construct-related claims of validity, support was evinced through the literature review as well as through inter-subtest correlation. External measures suggested some discriminant evidentiary support. Examinees perceived that the CLEAR closely resembled the target environment, they judged the CLEAR quality to be a key feature, and they would recommend the CLEAR to a friend for the growth experience. In conclusion, the CLEAR dynamic simulation assessment appears to offer potential to university admissions testing for non-native English speakers, particularly regarding the utility of the learning potential measurement, the essay scoring tool, and the examinee perceptions of the test.","abstract_has_math":false,"creators":["Balizet, S. \"Sha\" G."],"institution":"University of South Florida","degree_name":null,"degree_level":"Dissertation","degree_discipline":"Secondary Education","degree_department":null,"school":null,"contributors":["Jeffra Flaitz, Ph.D.","Wei Zhu, Ph.D.","John Ferron, Ph.D.","Carine Feyten, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2005,"date_issued":"2005-01-01T08:00:00Z","date_published":"2005-01-01T08:00:00Z","updated_at":"2026-11-19T08:34:51Z","subjects":["IEP","EAP","Testing","Content-based","CALP","Academic competence","Academic achievement","American Studies","Arts and Humanities"],"languages":["EN-US"],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/2970","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/2970","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-3963","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Jeffra Flaitz, Ph.D.","Wei Zhu, Ph.D.","John Ferron, Ph.D.","Carine Feyten, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Balizet, S. \"Sha\" G."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2005-01-01T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Secondary Education"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation","Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["IEP","EAP","Testing","Content-based","CALP","Academic competence","Academic achievement","American Studies","Arts and Humanities"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["EN-US"]},{"key":"dc:rights.license","label":"Dc Rights License","values":["default"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/2970"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["This study investigated the measurement quality of the Content Learning Experience: Academic Readiness (CLEAR) test, a new measure for university admissions decisions regarding English as a Second Language (ESL) applicants. The CLEAR test measures ability through dynamic simulation: learning opportunities are followed by testing how well students learned the academic content, all modeled on university instructional experiences. Measured by the CLEAR is academic readiness (AR), the direct, present evidence of ability to learn academic content via the second language as demonstrated during the dynamic simulation. AR is hypothesized to comprise above-threshold academic language proficiency, personal characteristics, topical knowledge, academic skills, and academic auxiliaries (motivation, study skills, engagement, work drive, emotional stability, affective schemata, and metacognitive strategies). The participants were 36 international adults, studying pre-university academic English at intensive institutes in Florida who volunteered to take the CLEAR during the summer of 2004. Data were collected via the CLEAR multiple-choice knowledge test and essay test, teacher ratings, examinee feedback, and external measures. Results showed the CLEAR knowledge test functions well at the item level although overall scores are only moderately consistent. The essay scoring consistency was satisfactory, perhaps partly due to the purpose-built scoring tool Good support for content-related validity claims was found for the dynamic simulation overall, for the stimulus materials, for the knowledge test items, for the essay prompt, and for the essay scoring tool. The concurrent measure of teacher ratings correlated with the knowledge test, but not with the content-based essay. Concerning construct-related claims of validity, support was evinced through the literature review as well as through inter-subtest correlation. External measures suggested some discriminant evidentiary support. Examinees perceived that the CLEAR closely resembled the target environment, they judged the CLEAR quality to be a key feature, and they would recommend the CLEAR to a friend for the growth experience. In conclusion, the CLEAR dynamic simulation assessment appears to offer potential to university admissions testing for non-native English speakers, particularly regarding the utility of the learning potential measurement, the essay scoring tool, and the examinee perceptions of the test."]},{"key":"dc:title","label":"Title","values":["A Dynamic Simulation Assessment of English as a Second Language Students' Academic Readiness: An Initial Validation of a University Admissions Tool"]}]}],"canonical_facts":{"dc:contributor":["Jeffra Flaitz, Ph.D.","Wei Zhu, Ph.D.","John Ferron, Ph.D.","Carine Feyten, Ph.D."],"dc:creator":["Balizet, S. \"Sha\" G."],"dc:date":["2005-01-01T08:00:00Z"],"dc:description":["This study investigated the measurement quality of the Content Learning Experience: Academic Readiness (CLEAR) test, a new measure for university admissions decisions regarding English as a Second Language (ESL) applicants. The CLEAR test measures ability through dynamic simulation: learning opportunities are followed by testing how well students learned the academic content, all modeled on university instructional experiences. Measured by the CLEAR is academic readiness (AR), the direct, present evidence of ability to learn academic content via the second language as demonstrated during the dynamic simulation. AR is hypothesized to comprise above-threshold academic language proficiency, personal characteristics, topical knowledge, academic skills, and academic auxiliaries (motivation, study skills, engagement, work drive, emotional stability, affective schemata, and metacognitive strategies). The participants were 36 international adults, studying pre-university academic English at intensive institutes in Florida who volunteered to take the CLEAR during the summer of 2004. Data were collected via the CLEAR multiple-choice knowledge test and essay test, teacher ratings, examinee feedback, and external measures. Results showed the CLEAR knowledge test functions well at the item level although overall scores are only moderately consistent. The essay scoring consistency was satisfactory, perhaps partly due to the purpose-built scoring tool Good support for content-related validity claims was found for the dynamic simulation overall, for the stimulus materials, for the knowledge test items, for the essay prompt, and for the essay scoring tool. The concurrent measure of teacher ratings correlated with the knowledge test, but not with the content-based essay. Concerning construct-related claims of validity, support was evinced through the literature review as well as through inter-subtest correlation. External measures suggested some discriminant evidentiary support. Examinees perceived that the CLEAR closely resembled the target environment, they judged the CLEAR quality to be a key feature, and they would recommend the CLEAR to a friend for the growth experience. In conclusion, the CLEAR dynamic simulation assessment appears to offer potential to university admissions testing for non-native English speakers, particularly regarding the utility of the learning potential measurement, the essay scoring tool, and the examinee perceptions of the test."],"dc:identifier":["https://digitalcommons.usf.edu/etd/2970"],"dc:language":["EN-US"],"dc:rights.license":["default"],"dc:subject":["IEP","EAP","Testing","Content-based","CALP","Academic competence","Academic achievement","American Studies","Arts and Humanities"],"dc:title":["A Dynamic Simulation Assessment of English as a Second Language Students' Academic Readiness: An Initial Validation of a University Admissions Tool"],"thesis:degree_discipline":["Secondary Education"],"thesis:degree_level":["Dissertation","Ph.D."],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:34:51Z"}