{"id":{"repo_id":"birmingham","oai_identifier":"oai:etheses.bham.ac.uk:11766"},"canonical_url":"https://search.ndltd.org/etd/birmingham/oai:etheses.bham.ac.uk:11766","repository":{"repo_id":"birmingham","name":"University of Birmingham","base_url":"https://etheses.bham.ac.uk/cgi/oai2"},"display":{"title":"Validity theory (VT) and modern test theory (MTT) in assessment measurement and design","abstract":"Background: Healthcare education use assessment results (test scores) to make inferences about students’ knowledge and ability. The NMP curriculum, therefore, assumes a standard of proficiency achievement in successive student cohorts. Therefore, these assessments are high-stakes and must be valid as they may have implications for patients’ safety. Aims: This study aimed to apply Kane’s (2006) validity theory to evidence whether the assessments capture the proficiency it purports to assess and modern test theory to measure the appropriateness of the score interpretation. Method: Theory-Driven Thematic Analysis (TDTA) was used to code and content analyse the reflections; Ryle (1949), Mezirow (1981), Benner (2001) and Bloom’s (1956) theories instructed the content validity, quality and evidenced mastery of the NMP subject and theory domains. The Structured Clinical Examination (SCE) criterion was analysed using the Rasch one-parameter logistic model (1-PL) to measure relationships between the test item criteria, the student ability and test-items parameters capacity to discriminate among students with varying ability. Results: Representation of Ryle’s, Mezirow’s, Benner’s, and Bloom’s theories in the reflections were at the lower levels of achievement. The SCEs, criterion analyses showed the test item favoured students with limited ability, indicating an easy test; overall, suggesting the assessments’ validity is compromised. Conclusion: Applying validity and measurement theory to assessed work could elucidate the meaning of assessment scores and ensure that assessments are appropriate to the examinees’ level of ability.","abstract_html":"Background: Healthcare education use assessment results (test scores) to make inferences about students’ knowledge and ability. The NMP curriculum, therefore, assumes a standard of proficiency achievement in successive student cohorts. Therefore, these assessments are high-stakes and must be valid as they may have implications for patients’ safety. Aims: This study aimed to apply Kane’s (2006) validity theory to evidence whether the assessments capture the proficiency it purports to assess and modern test theory to measure the appropriateness of the score interpretation. Method: Theory-Driven Thematic Analysis (TDTA) was used to code and content analyse the reflections; Ryle (1949), Mezirow (1981), Benner (2001) and Bloom’s (1956) theories instructed the content validity, quality and evidenced mastery of the NMP subject and theory domains. The Structured Clinical Examination (SCE) criterion was analysed using the Rasch one-parameter logistic model (1-PL) to measure relationships between the test item criteria, the student ability and test-items parameters capacity to discriminate among students with varying ability. Results: Representation of Ryle’s, Mezirow’s, Benner’s, and Bloom’s theories in the reflections were at the lower levels of achievement. The SCEs, criterion analyses showed the test item favoured students with limited ability, indicating an easy test; overall, suggesting the assessments’ validity is compromised. Conclusion: Applying validity and measurement theory to assessed work could elucidate the meaning of assessment scores and ensure that assessments are appropriate to the examinees’ level of ability.","abstract_has_math":false,"creators":["Blyden, Susan"],"institution":"University of Birmingham","degree_name":"d_ed","degree_level":"d_ed","degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-12","date_published":"2021-12","updated_at":"2026-11-19T09:31:28Z","subjects":["L Education (General)","R Medicine (General)"],"languages":["eng"],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":null,"outbound_label":null,"outbound_source":null,"record_url":null,"record_label":null,"record_kind":null,"record_source":null,"download_url":"http://etheses.bham.ac.uk//id/eprint/11766/7/BlydenEdD2021_Redacted.pdf","download_label":"Download PDF","download_source":"dc:identifier.uri","access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://etheses.bham.ac.uk/cgi/oai2?verb=GetRecord&metadataPrefix=uketd_dc&identifier=oai%3Aetheses.bham.ac.uk%3A11766","prefix":"uketd_dc"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.sponsor","label":"Sponsor","values":["na"]},{"key":"dc:creator","label":"Author","values":["Blyden, Susan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2021-12-07"]},{"key":"dc:date.issued","label":"Date","values":["2021-12"]},{"key":"dc:publisher.department","label":"Dc Publisher Department","values":["College of Social Sciences","School of Education"]},{"key":"dc:publisher.institution","label":"Dc Publisher Institution","values":["University of Birmingham"]},{"key":"dc:relation.isreferencedby","label":"Dc Relation Isreferencedby","values":["http://etheses.bham.ac.uk//id/eprint/11766/"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"dc:type.qualificationlevel","label":"Dc Type Qualificationlevel","values":["d_ed"]},{"key":"dc:type.qualificationname","label":"Dc Type Qualificationname","values":["d_ed"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["L Education (General)","R Medicine (General)"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.dcterms_iso639_2","label":"Language (ISO 639-2)","values":["eng"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://etheses.bham.ac.uk//id/eprint/11766/7/BlydenEdD2021_Redacted.pdf"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Background: Healthcare education use assessment results (test scores) to make inferences about students’ knowledge and ability. The NMP curriculum, therefore, assumes a standard of proficiency achievement in successive student cohorts. Therefore, these assessments are high-stakes and must be valid as they may have implications for patients’ safety. Aims: This study aimed to apply Kane’s (2006) validity theory to evidence whether the assessments capture the proficiency it purports to assess and modern test theory to measure the appropriateness of the score interpretation. Method: Theory-Driven Thematic Analysis (TDTA) was used to code and content analyse the reflections; Ryle (1949), Mezirow (1981), Benner (2001) and Bloom’s (1956) theories instructed the content validity, quality and evidenced mastery of the NMP subject and theory domains. The Structured Clinical Examination (SCE) criterion was analysed using the Rasch one-parameter logistic model (1-PL) to measure relationships between the test item criteria, the student ability and test-items parameters capacity to discriminate among students with varying ability. Results: Representation of Ryle’s, Mezirow’s, Benner’s, and Bloom’s theories in the reflections were at the lower levels of achievement. The SCEs, criterion analyses showed the test item favoured students with limited ability, indicating an easy test; overall, suggesting the assessments’ validity is compromised. Conclusion: Applying validity and measurement theory to assessed work could elucidate the meaning of assessment scores and ensure that assessments are appropriate to the examinees’ level of ability."]},{"key":"dc:format","label":"Dc Format","values":["text"]},{"key":"dcterms:accessrights","label":"Dcterms Accessrights","values":["public"]},{"key":"dc:title","label":"Title","values":["Validity theory (VT) and modern test theory (MTT) in assessment measurement and design"]}]}],"canonical_facts":{"dc:contributor.sponsor":["na"],"dc:creator":["Blyden, Susan"],"dc:date":["2021-12-07"],"dc:date.issued":["2021-12"],"dc:description.abstract":["Background: Healthcare education use assessment results (test scores) to make inferences about students’ knowledge and ability. The NMP curriculum, therefore, assumes a standard of proficiency achievement in successive student cohorts. Therefore, these assessments are high-stakes and must be valid as they may have implications for patients’ safety. Aims: This study aimed to apply Kane’s (2006) validity theory to evidence whether the assessments capture the proficiency it purports to assess and modern test theory to measure the appropriateness of the score interpretation. Method: Theory-Driven Thematic Analysis (TDTA) was used to code and content analyse the reflections; Ryle (1949), Mezirow (1981), Benner (2001) and Bloom’s (1956) theories instructed the content validity, quality and evidenced mastery of the NMP subject and theory domains. The Structured Clinical Examination (SCE) criterion was analysed using the Rasch one-parameter logistic model (1-PL) to measure relationships between the test item criteria, the student ability and test-items parameters capacity to discriminate among students with varying ability. Results: Representation of Ryle’s, Mezirow’s, Benner’s, and Bloom’s theories in the reflections were at the lower levels of achievement. The SCEs, criterion analyses showed the test item favoured students with limited ability, indicating an easy test; overall, suggesting the assessments’ validity is compromised. Conclusion: Applying validity and measurement theory to assessed work could elucidate the meaning of assessment scores and ensure that assessments are appropriate to the examinees’ level of ability."],"dc:format":["text"],"dc:identifier.uri":["http://etheses.bham.ac.uk//id/eprint/11766/7/BlydenEdD2021_Redacted.pdf"],"dc:language.dcterms_iso639_2":["eng"],"dc:publisher.department":["College of Social Sciences","School of Education"],"dc:publisher.institution":["University of Birmingham"],"dc:relation.isreferencedby":["http://etheses.bham.ac.uk//id/eprint/11766/"],"dc:subject":["L Education (General)","R Medicine (General)"],"dcterms:accessrights":["public"],"dc:title":["Validity theory (VT) and modern test theory (MTT) in assessment measurement and design"],"dc:type":["Thesis"],"dc:type.qualificationlevel":["d_ed"],"dc:type.qualificationname":["d_ed"]},"updated_at":"2026-11-19T09:31:28Z"}