{"id":{"repo_id":"clemson","oai_identifier":"oai:open.clemson.edu:all_theses-3759"},"canonical_url":"https://search.ndltd.org/etd/clemson/oai:open.clemson.edu:all_theses-3759","repository":{"repo_id":"clemson","name":"Clemson University","base_url":"https://open.clemson.edu/do/oai/"},"display":{"title":"Nuanced Views of Pedagogical Evaluation","abstract":"Novel technologies and teaching methods are being integrated into post-secondary classrooms at unprecedented rates. Educators must be certain implemented changes provide equitable alternatives to traditional pedagogical practices, before migrating to modern paradigms. However, changes in classroom practices each introduce unique psychological inﬂuences into the classroom, which may inﬂuence traditional metrics of pedagogical success. Evaluation methods for assessing classroom changes should evolve with pedagogy, to accurately measure its effects. In this paper, we share our experience exploring the equity of replacing traditional paper-and-pencil testing with digital examinations, to demonstrate the complexity of modern educational assessment. We observed a variety of variables, many of which often go unmeasured in pedagogical evaluations, inﬂuenced our metrics of success, and altered our initial conclusions. Further, our analysis suggests classroom changes may inﬂuence demographic groups differently, and these effects may be hidden, if success is only measured within the aggregate student body. Evaluations that do not explicitly consider and identify these effects may not be able to observe them. Our experience indicates that evaluations that do not account for demographics are incomplete, at best. More importantly, our results suggest these evaluations may draw, and support, invalid conclusions. By describing the difﬁculties we encountered in evaluating the equity of digital examinations, we invite educators and education researchers to move beyond simplistic evaluations, consider the underlying factors inﬂuencing traditional metrics of success, and adopt a more nuanced view of pedagogical evaluation practices.","abstract_html":"Novel technologies and teaching methods are being integrated into post-secondary classrooms at unprecedented rates. Educators must be certain implemented changes provide equitable alternatives to traditional pedagogical practices, before migrating to modern paradigms. However, changes in classroom practices each introduce unique psychological inﬂuences into the classroom, which may inﬂuence traditional metrics of pedagogical success. Evaluation methods for assessing classroom changes should evolve with pedagogy, to accurately measure its effects. In this paper, we share our experience exploring the equity of replacing traditional paper-and-pencil testing with digital examinations, to demonstrate the complexity of modern educational assessment. We observed a variety of variables, many of which often go unmeasured in pedagogical evaluations, inﬂuenced our metrics of success, and altered our initial conclusions. Further, our analysis suggests classroom changes may inﬂuence demographic groups differently, and these effects may be hidden, if success is only measured within the aggregate student body. Evaluations that do not explicitly consider and identify these effects may not be able to observe them. Our experience indicates that evaluations that do not account for demographics are incomplete, at best. More importantly, our results suggest these evaluations may draw, and support, invalid conclusions. By describing the difﬁculties we encountered in evaluating the equity of digital examinations, we invite educators and education researchers to move beyond simplistic evaluations, consider the underlying factors inﬂuencing traditional metrics of success, and adopt a more nuanced view of pedagogical evaluation practices.","abstract_has_math":false,"creators":["Storer, Kevin M."],"institution":null,"degree_name":"Master of Science (MS)","degree_level":"Thesis","degree_discipline":"School of Computing","degree_department":null,"school":null,"contributors":["Dr. Jacob Sorber, Committee Chair","Dr. Kelly Caine","Dr. Bart Knijnenburg"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T07:16:07Z","subjects":[],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://open.clemson.edu/all_theses/2758","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://open.clemson.edu/all_theses/2758","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://open.clemson.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Aopen.clemson.edu%3Aall_theses-3759","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Dr. Jacob Sorber, Committee Chair","Dr. Kelly Caine","Dr. Bart Knijnenburg"]},{"key":"dc:creator","label":"Author","values":["Storer, Kevin M."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2017-10-11T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2017-08-01T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["School of Computing"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science (MS)"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://open.clemson.edu/all_theses/2758"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Novel technologies and teaching methods are being integrated into post-secondary classrooms at unprecedented rates. Educators must be certain implemented changes provide equitable alternatives to traditional pedagogical practices, before migrating to modern paradigms. However, changes in classroom practices each introduce unique psychological inﬂuences into the classroom, which may inﬂuence traditional metrics of pedagogical success. Evaluation methods for assessing classroom changes should evolve with pedagogy, to accurately measure its effects. In this paper, we share our experience exploring the equity of replacing traditional paper-and-pencil testing with digital examinations, to demonstrate the complexity of modern educational assessment. We observed a variety of variables, many of which often go unmeasured in pedagogical evaluations, inﬂuenced our metrics of success, and altered our initial conclusions. Further, our analysis suggests classroom changes may inﬂuence demographic groups differently, and these effects may be hidden, if success is only measured within the aggregate student body. Evaluations that do not explicitly consider and identify these effects may not be able to observe them. Our experience indicates that evaluations that do not account for demographics are incomplete, at best. More importantly, our results suggest these evaluations may draw, and support, invalid conclusions. By describing the difﬁculties we encountered in evaluating the equity of digital examinations, we invite educators and education researchers to move beyond simplistic evaluations, consider the underlying factors inﬂuencing traditional metrics of success, and adopt a more nuanced view of pedagogical evaluation practices."]},{"key":"dc:title","label":"Title","values":["Nuanced Views of Pedagogical Evaluation"]}]}],"canonical_facts":{"dc:contributor":["Dr. Jacob Sorber, Committee Chair","Dr. Kelly Caine","Dr. Bart Knijnenburg"],"dc:creator":["Storer, Kevin M."],"dc:date.available":["2017-10-11T07:00:00Z"],"dc:date.created":["2017-08-01T07:00:00Z"],"dc:description.abstract":["Novel technologies and teaching methods are being integrated into post-secondary classrooms at unprecedented rates. Educators must be certain implemented changes provide equitable alternatives to traditional pedagogical practices, before migrating to modern paradigms. However, changes in classroom practices each introduce unique psychological inﬂuences into the classroom, which may inﬂuence traditional metrics of pedagogical success. Evaluation methods for assessing classroom changes should evolve with pedagogy, to accurately measure its effects. In this paper, we share our experience exploring the equity of replacing traditional paper-and-pencil testing with digital examinations, to demonstrate the complexity of modern educational assessment. We observed a variety of variables, many of which often go unmeasured in pedagogical evaluations, inﬂuenced our metrics of success, and altered our initial conclusions. Further, our analysis suggests classroom changes may inﬂuence demographic groups differently, and these effects may be hidden, if success is only measured within the aggregate student body. Evaluations that do not explicitly consider and identify these effects may not be able to observe them. Our experience indicates that evaluations that do not account for demographics are incomplete, at best. More importantly, our results suggest these evaluations may draw, and support, invalid conclusions. By describing the difﬁculties we encountered in evaluating the equity of digital examinations, we invite educators and education researchers to move beyond simplistic evaluations, consider the underlying factors inﬂuencing traditional metrics of success, and adopt a more nuanced view of pedagogical evaluation practices."],"dc:identifier":["https://open.clemson.edu/all_theses/2758"],"dc:title":["Nuanced Views of Pedagogical Evaluation"],"thesis:degree_discipline":["School of Computing"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["Master of Science (MS)"]},"updated_at":"2026-11-19T07:16:07Z"}