{"id":{"repo_id":"mtu","oai_identifier":"oai:digitalcommons.mtu.edu:etdr-3208"},"canonical_url":"https://search.ndltd.org/etd/mtu/oai:digitalcommons.mtu.edu:etdr-3208","repository":{"repo_id":"mtu","name":"Michigan Technological University","base_url":"https://digitalcommons.mtu.edu/do/oai/"},"display":{"title":"DESIGNING WITH FORESIGHT: PREMORTEM AND HUMAN-CENTERED EVALUATION OF EMERGING TECHNOLOGIES","abstract":"Artificial intelligence is increasingly embedded in safety-critical systems, including transportation, where people must make fast decisions under uncertainty and high risk. As AI takes on a larger role in supporting human judgment, researchers and designers must evaluate more than just its technical performance, they must ask whether people can understand the system and use it effectively in high-risk settings. This dissertation presents two distinct evaluation methodologies. First, the Human-Centered Evaluation, examines how intelligent in-vehicle alert systems influence driver decision behavior across two experiments. In Experiment 1 (n=24) and Experiment 2 (n=26), participants completed a driving simulator study in which our staged intelligent alerts significantly reduced driver speeds at both Active and Passive Highway-Rail Grade Crossings (HRGCs). The second methodology, Risk Evaluation, examines how to improve people’s plan evaluations. In Experiment 3 (n=138 individuals & n=30 in groups), we found that the Premortem was more effective than other reasoning techniques in evaluating plan confidence. Experiment 4 (n=41) extended this work by testing a Structured Premortem method specifically designed for plans integrating emerging AI technologies. Together, these methodologies offer a more complete framework for evaluating AI-driven systems. The human-centered experiments test whether technology meaningfully changes behavior under realistic conditions; the risk-evaluation experiments test whether people can anticipate the broader consequences of deploying that technology. This dissertation contributes empirical evidence on how intelligent alerts shape driver decision-making and provides practical tools for proactive risk identification in emerging technologies. Ultimately, it argues that rigorous AI evaluation in safety-critical environments demands both behavioral validation and structured foresight.","abstract_html":"Artificial intelligence is increasingly embedded in safety-critical systems, including transportation, where people must make fast decisions under uncertainty and high risk. As AI takes on a larger role in supporting human judgment, researchers and designers must evaluate more than just its technical performance, they must ask whether people can understand the system and use it effectively in high-risk settings. This dissertation presents two distinct evaluation methodologies. First, the Human-Centered Evaluation, examines how intelligent in-vehicle alert systems influence driver decision behavior across two experiments. In Experiment 1 (n=24) and Experiment 2 (n=26), participants completed a driving simulator study in which our staged intelligent alerts significantly reduced driver speeds at both Active and Passive Highway-Rail Grade Crossings (HRGCs). The second methodology, Risk Evaluation, examines how to improve people’s plan evaluations. In Experiment 3 (n=138 individuals &amp; n=30 in groups), we found that the Premortem was more effective than other reasoning techniques in evaluating plan confidence. Experiment 4 (n=41) extended this work by testing a Structured Premortem method specifically designed for plans integrating emerging AI technologies. Together, these methodologies offer a more complete framework for evaluating AI-driven systems. The human-centered experiments test whether technology meaningfully changes behavior under realistic conditions; the risk-evaluation experiments test whether people can anticipate the broader consequences of deploying that technology. This dissertation contributes empirical evidence on how intelligent alerts shape driver decision-making and provides practical tools for proactive risk identification in emerging technologies. Ultimately, it argues that rigorous AI evaluation in safety-critical environments demands both behavioral validation and structured foresight.","abstract_has_math":false,"creators":["Kannan, Anusha"],"institution":null,"degree_name":"Doctor of Philosophy in Applied Cognitive Science and Human Factors (PhD)","degree_level":"Open Access Dissertation","degree_discipline":"Department of Psychology and Human Factors","degree_department":null,"school":null,"contributors":["Elizabeth S. Veinott"],"advisors":[],"committee_chairs":[],"committee_members":["Shane T. Mueller","Briana C. Bettin","Giridhar Reddy Bhojja","Pasi Lautala"],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T08:19:26Z","subjects":["Human Factors","Human-Centered Evaluation","Risk Evaluation","Driving Simulator","Premortem","Human Factors Psychology"],"languages":[],"rights":[],"rights_urls":["http://creativecommons.org/licenses/by-nc-nd/4.0/"],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.mtu.edu/etdr/2053"],"render_values":[{"text":"https://digitalcommons.mtu.edu/etdr/2053","href":"https://digitalcommons.mtu.edu/etdr/2053","code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":"https://doi.org/10.37099/mtu.dc.etdr/2053","outbound_label":"DOI","outbound_source":"dc:identifier","record_url":"https://doi.org/10.37099/mtu.dc.etdr/2053","record_label":"Repository record","record_kind":"doi","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.mtu.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.mtu.edu%3Aetdr-3208","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Elizabeth S. Veinott"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Shane T. Mueller","Briana C. Bettin","Giridhar Reddy Bhojja","Pasi Lautala"]},{"key":"dc:creator","label":"Author","values":["Kannan, Anusha"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.created","label":"Dc Date Created","values":["2026-01-01T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Department of Psychology and Human Factors"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Open Access Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy in Applied Cognitive Science and Human Factors (PhD)"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Human Factors","Human-Centered Evaluation","Risk Evaluation","Driving Simulator","Premortem","Human Factors Psychology"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights.license","label":"Dc Rights License","values":["http://creativecommons.org/licenses/by-nc-nd/4.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["10.37099/mtu.dc.etdr/2053","https://digitalcommons.mtu.edu/etdr/2053"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Artificial intelligence is increasingly embedded in safety-critical systems, including transportation, where people must make fast decisions under uncertainty and high risk. As AI takes on a larger role in supporting human judgment, researchers and designers must evaluate more than just its technical performance, they must ask whether people can understand the system and use it effectively in high-risk settings. This dissertation presents two distinct evaluation methodologies. First, the Human-Centered Evaluation, examines how intelligent in-vehicle alert systems influence driver decision behavior across two experiments. In Experiment 1 (n=24) and Experiment 2 (n=26), participants completed a driving simulator study in which our staged intelligent alerts significantly reduced driver speeds at both Active and Passive Highway-Rail Grade Crossings (HRGCs). The second methodology, Risk Evaluation, examines how to improve people’s plan evaluations. In Experiment 3 (n=138 individuals & n=30 in groups), we found that the Premortem was more effective than other reasoning techniques in evaluating plan confidence. Experiment 4 (n=41) extended this work by testing a Structured Premortem method specifically designed for plans integrating emerging AI technologies. Together, these methodologies offer a more complete framework for evaluating AI-driven systems. The human-centered experiments test whether technology meaningfully changes behavior under realistic conditions; the risk-evaluation experiments test whether people can anticipate the broader consequences of deploying that technology. This dissertation contributes empirical evidence on how intelligent alerts shape driver decision-making and provides practical tools for proactive risk identification in emerging technologies. Ultimately, it argues that rigorous AI evaluation in safety-critical environments demands both behavioral validation and structured foresight."]},{"key":"dc:title","label":"Title","values":["DESIGNING WITH FORESIGHT: PREMORTEM AND HUMAN-CENTERED EVALUATION OF EMERGING TECHNOLOGIES"]}]}],"canonical_facts":{"dc:contributor":["Elizabeth S. Veinott"],"dc:contributor.committeemember":["Shane T. Mueller","Briana C. Bettin","Giridhar Reddy Bhojja","Pasi Lautala"],"dc:creator":["Kannan, Anusha"],"dc:date.created":["2026-01-01T08:00:00Z"],"dc:description.abstract":["Artificial intelligence is increasingly embedded in safety-critical systems, including transportation, where people must make fast decisions under uncertainty and high risk. As AI takes on a larger role in supporting human judgment, researchers and designers must evaluate more than just its technical performance, they must ask whether people can understand the system and use it effectively in high-risk settings. This dissertation presents two distinct evaluation methodologies. First, the Human-Centered Evaluation, examines how intelligent in-vehicle alert systems influence driver decision behavior across two experiments. In Experiment 1 (n=24) and Experiment 2 (n=26), participants completed a driving simulator study in which our staged intelligent alerts significantly reduced driver speeds at both Active and Passive Highway-Rail Grade Crossings (HRGCs). The second methodology, Risk Evaluation, examines how to improve people’s plan evaluations. In Experiment 3 (n=138 individuals & n=30 in groups), we found that the Premortem was more effective than other reasoning techniques in evaluating plan confidence. Experiment 4 (n=41) extended this work by testing a Structured Premortem method specifically designed for plans integrating emerging AI technologies. Together, these methodologies offer a more complete framework for evaluating AI-driven systems. The human-centered experiments test whether technology meaningfully changes behavior under realistic conditions; the risk-evaluation experiments test whether people can anticipate the broader consequences of deploying that technology. This dissertation contributes empirical evidence on how intelligent alerts shape driver decision-making and provides practical tools for proactive risk identification in emerging technologies. Ultimately, it argues that rigorous AI evaluation in safety-critical environments demands both behavioral validation and structured foresight."],"dc:identifier":["10.37099/mtu.dc.etdr/2053","https://digitalcommons.mtu.edu/etdr/2053"],"dc:rights.license":["http://creativecommons.org/licenses/by-nc-nd/4.0/"],"dc:subject":["Human Factors","Human-Centered Evaluation","Risk Evaluation","Driving Simulator","Premortem","Human Factors Psychology"],"dc:title":["DESIGNING WITH FORESIGHT: PREMORTEM AND HUMAN-CENTERED EVALUATION OF EMERGING TECHNOLOGIES"],"thesis:degree_discipline":["Department of Psychology and Human Factors"],"thesis:degree_level":["Open Access Dissertation"],"thesis:degree_name":["Doctor of Philosophy in Applied Cognitive Science and Human Factors (PhD)"]},"updated_at":"2026-11-19T08:19:26Z"}