{"id":{"repo_id":"rowan","oai_identifier":"oai:rdw.rowan.edu:etd-4256"},"canonical_url":"https://search.ndltd.org/etd/rowan/oai:rdw.rowan.edu:etd-4256","repository":{"repo_id":"rowan","name":"Rowan University","base_url":"https://rdw.rowan.edu/do/oai/"},"display":{"title":"Reinforcement Learning for Robotic Tasks: Analyzing and Understanding the Learning Process Using Explainable Artificial Intelligence Methods","abstract":"As deep reinforcement learning (RL) models gain traction across more industries, there is a growing need for reliable agent-explanation techniques to understand these models. Researchers have developed explainable artificial intelligence (XAI) methods to help understand these 'black boxes'. While these models have been tested on many supervised learning tasks, there is a lack of examination of how these well these methods can explain hard reinforcement learning problems like robotic control. The sequential nature of learning RL policies and testing episodes create fundamentally different policies over time compared to more traditional supervised learning models. In this thesis, two important questions are explored: (1) How well do modern Shapley value based explanation techniques help understand the rationale behind actions made by robotic RL actors? (2) Can these explanations help demystify the RL training loop by estimating the predictive weight of different features throughout training epochs? Through extensive empirical experiments on multiple robotic environments and output analysis, we obtain the following observations: 1. Modern Shapley value explanation techniques often require a significant amount of extra data analysis to comprehend the logic behind trained policies. 2. Important, predictive features are found and ranked highly very early in mid-training epochs before the optimal policy is found.","abstract_html":"As deep reinforcement learning (RL) models gain traction across more industries, there is a growing need for reliable agent-explanation techniques to understand these models. Researchers have developed explainable artificial intelligence (XAI) methods to help understand these &#x27;black boxes&#x27;. While these models have been tested on many supervised learning tasks, there is a lack of examination of how these well these methods can explain hard reinforcement learning problems like robotic control. The sequential nature of learning RL policies and testing episodes create fundamentally different policies over time compared to more traditional supervised learning models. In this thesis, two important questions are explored: (1) How well do modern Shapley value based explanation techniques help understand the rationale behind actions made by robotic RL actors? (2) Can these explanations help demystify the RL training loop by estimating the predictive weight of different features throughout training epochs? Through extensive empirical experiments on multiple robotic environments and output analysis, we obtain the following observations: 1. Modern Shapley value explanation techniques often require a significant amount of extra data analysis to comprehend the logic behind trained policies. 2. Important, predictive features are found and ranked highly very early in mid-training epochs before the optimal policy is found.","abstract_has_math":false,"creators":["Campana, Brian J"],"institution":null,"degree_name":"Master of Science (M.S.) in Computer Science","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Shen-Shyang Ho, Ph.D.","Jennifer Kay, Ph.D.","Nancy Tinkham, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T08:59:46Z","subjects":["Explainable Artificial Intelligence; Machine Learning; Reinforcement Learning; Robotics; Shapley Value","Artificial intelligence","Artificial Intelligence and Robotics","Computer Sciences"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://rdw.rowan.edu/etd/3250","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://rdw.rowan.edu/etd/3250","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://rdw.rowan.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Ardw.rowan.edu%3Aetd-4256","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Shen-Shyang Ho, Ph.D.","Jennifer Kay, Ph.D.","Nancy Tinkham, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Campana, Brian J"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2024-06-19T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2024-06-19T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science (M.S.) in Computer Science"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Explainable Artificial Intelligence; Machine Learning; Reinforcement Learning; Robotics; Shapley Value","Artificial intelligence","Artificial Intelligence and Robotics","Computer Sciences"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://rdw.rowan.edu/etd/3250"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["As deep reinforcement learning (RL) models gain traction across more industries, there is a growing need for reliable agent-explanation techniques to understand these models. Researchers have developed explainable artificial intelligence (XAI) methods to help understand these 'black boxes'. While these models have been tested on many supervised learning tasks, there is a lack of examination of how these well these methods can explain hard reinforcement learning problems like robotic control. The sequential nature of learning RL policies and testing episodes create fundamentally different policies over time compared to more traditional supervised learning models. In this thesis, two important questions are explored: (1) How well do modern Shapley value based explanation techniques help understand the rationale behind actions made by robotic RL actors? (2) Can these explanations help demystify the RL training loop by estimating the predictive weight of different features throughout training epochs? Through extensive empirical experiments on multiple robotic environments and output analysis, we obtain the following observations: 1. Modern Shapley value explanation techniques often require a significant amount of extra data analysis to comprehend the logic behind trained policies. 2. Important, predictive features are found and ranked highly very early in mid-training epochs before the optimal policy is found."]},{"key":"dc:title","label":"Title","values":["Reinforcement Learning for Robotic Tasks: Analyzing and Understanding the Learning Process Using Explainable Artificial Intelligence Methods"]}]}],"canonical_facts":{"dc:contributor":["Shen-Shyang Ho, Ph.D.","Jennifer Kay, Ph.D.","Nancy Tinkham, Ph.D."],"dc:creator":["Campana, Brian J"],"dc:date.available":["2024-06-19T07:00:00Z"],"dc:date.created":["2024-06-19T07:00:00Z"],"dc:description.abstract":["As deep reinforcement learning (RL) models gain traction across more industries, there is a growing need for reliable agent-explanation techniques to understand these models. Researchers have developed explainable artificial intelligence (XAI) methods to help understand these 'black boxes'. While these models have been tested on many supervised learning tasks, there is a lack of examination of how these well these methods can explain hard reinforcement learning problems like robotic control. The sequential nature of learning RL policies and testing episodes create fundamentally different policies over time compared to more traditional supervised learning models. In this thesis, two important questions are explored: (1) How well do modern Shapley value based explanation techniques help understand the rationale behind actions made by robotic RL actors? (2) Can these explanations help demystify the RL training loop by estimating the predictive weight of different features throughout training epochs? Through extensive empirical experiments on multiple robotic environments and output analysis, we obtain the following observations: 1. Modern Shapley value explanation techniques often require a significant amount of extra data analysis to comprehend the logic behind trained policies. 2. Important, predictive features are found and ranked highly very early in mid-training epochs before the optimal policy is found."],"dc:identifier":["https://rdw.rowan.edu/etd/3250"],"dc:subject":["Explainable Artificial Intelligence; Machine Learning; Reinforcement Learning; Robotics; Shapley Value","Artificial intelligence","Artificial Intelligence and Robotics","Computer Sciences"],"dc:title":["Reinforcement Learning for Robotic Tasks: Analyzing and Understanding the Learning Process Using Explainable Artificial Intelligence Methods"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["Master of Science (M.S.) in Computer Science"]},"updated_at":"2026-11-19T08:59:46Z"}