{"id":{"repo_id":"rowan","oai_identifier":"oai:rdw.rowan.edu:etd-4570"},"canonical_url":"https://search.ndltd.org/etd/rowan/oai:rdw.rowan.edu:etd-4570","repository":{"repo_id":"rowan","name":"Rowan University","base_url":"https://rdw.rowan.edu/do/oai/"},"display":{"title":"OPTICAL INTEGRATED SENSING AND COMMUNICATION: DEEP REINFORCEMENT LEARNING-BASED BEAM TRACKING FOR DYNAMIC VEHICLE-TO-EVERYTHING NETWORKS","abstract":"Optical Wireless Communication (OWC) promises ultra-high bandwidth for vehicular networks but suffers from critical beam misalignment in dynamic environments. The emerging paradigm of Optical Integrated Sensing and Communication (O-ISAC) addresses this challenge by unifying the sensing and communication functions over a single shared optical aperture, enabling real-time environmental awareness to guide beam steering. However, the multi-objective, stochastic nature of this joint optimization problem renders classical closed-form controllers inadequate. This thesis proposes and evaluates a deep reinforcement learning framework for continuous beam tracking in a 2D vehicular O-ISAC scenario. We conduct a comprehensive comparative study of four state-of-the-art deep RL algorithms: Soft Actor-Critic (SAC), Proximal Policy Optimization (PPO), Trust Region Policy Optimization (TRPO), and Deep Deterministic Policy Gradient (DDPG), each trained for 5 million environment steps in a custom Gymnasium simulation. The environment incorporates log-normal atmospheric turbulence, geometric pointing loss, ray-casting blockage detection, and stochastic vehicle dynamics for both vehicle-to-everything (V2V) and vehicle-to-infrastructure (V2I) links. Our results demonstrate that SAC, through entropy-regularized maximum-entropy reinforcement learning, achieves superior and robust beam tracking performance. SAC attains a mean evaluation reward of 47,350 versus 31,200 for DDPG, 18,900 for PPO, and 12,800 for TRPO, and maintains simultaneous dual-link connectivity 78.3% of the time compared to 54.1% for the myopic greedy baseline. Temporal analysis confirms that SAC's learned policy sustains link quality 1.45 times more effectively than the reactive baseline during dynamic intersection crossing scenarios. These results establish O-ISAC as a compelling architecture for next-generation vehicular networks and deep RL as the methodology of choice for joint beam management.","abstract_html":"Optical Wireless Communication (OWC) promises ultra-high bandwidth for vehicular networks but suffers from critical beam misalignment in dynamic environments. The emerging paradigm of Optical Integrated Sensing and Communication (O-ISAC) addresses this challenge by unifying the sensing and communication functions over a single shared optical aperture, enabling real-time environmental awareness to guide beam steering. However, the multi-objective, stochastic nature of this joint optimization problem renders classical closed-form controllers inadequate. This thesis proposes and evaluates a deep reinforcement learning framework for continuous beam tracking in a 2D vehicular O-ISAC scenario. We conduct a comprehensive comparative study of four state-of-the-art deep RL algorithms: Soft Actor-Critic (SAC), Proximal Policy Optimization (PPO), Trust Region Policy Optimization (TRPO), and Deep Deterministic Policy Gradient (DDPG), each trained for 5 million environment steps in a custom Gymnasium simulation. The environment incorporates log-normal atmospheric turbulence, geometric pointing loss, ray-casting blockage detection, and stochastic vehicle dynamics for both vehicle-to-everything (V2V) and vehicle-to-infrastructure (V2I) links. Our results demonstrate that SAC, through entropy-regularized maximum-entropy reinforcement learning, achieves superior and robust beam tracking performance. SAC attains a mean evaluation reward of 47,350 versus 31,200 for DDPG, 18,900 for PPO, and 12,800 for TRPO, and maintains simultaneous dual-link connectivity 78.3% of the time compared to 54.1% for the myopic greedy baseline. Temporal analysis confirms that SAC&#x27;s learned policy sustains link quality 1.45 times more effectively than the reactive baseline during dynamic intersection crossing scenarios. These results establish O-ISAC as a compelling architecture for next-generation vehicular networks and deep RL as the methodology of choice for joint beam management.","abstract_has_math":false,"creators":["Sharan, Akshat"],"institution":null,"degree_name":"M.S. Data Science","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Huaxia Wang, Ph.D.","Ben Wu, Ph.D.","Gianesh Baliga, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T09:00:08Z","subjects":["Deep Reinforcement Learning;Integrated Sensing and Communication;Optical Wireless Communication;Vehicle-to-Everything"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://rdw.rowan.edu/etd/3564","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://rdw.rowan.edu/etd/3564","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://rdw.rowan.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Ardw.rowan.edu%3Aetd-4570","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Huaxia Wang, Ph.D.","Ben Wu, Ph.D.","Gianesh Baliga, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Sharan, Akshat"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2026-07-20T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2026-07-20T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S. Data Science"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Deep Reinforcement Learning;Integrated Sensing and Communication;Optical Wireless Communication;Vehicle-to-Everything"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://rdw.rowan.edu/etd/3564"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Optical Wireless Communication (OWC) promises ultra-high bandwidth for vehicular networks but suffers from critical beam misalignment in dynamic environments. The emerging paradigm of Optical Integrated Sensing and Communication (O-ISAC) addresses this challenge by unifying the sensing and communication functions over a single shared optical aperture, enabling real-time environmental awareness to guide beam steering. However, the multi-objective, stochastic nature of this joint optimization problem renders classical closed-form controllers inadequate. This thesis proposes and evaluates a deep reinforcement learning framework for continuous beam tracking in a 2D vehicular O-ISAC scenario. We conduct a comprehensive comparative study of four state-of-the-art deep RL algorithms: Soft Actor-Critic (SAC), Proximal Policy Optimization (PPO), Trust Region Policy Optimization (TRPO), and Deep Deterministic Policy Gradient (DDPG), each trained for 5 million environment steps in a custom Gymnasium simulation. The environment incorporates log-normal atmospheric turbulence, geometric pointing loss, ray-casting blockage detection, and stochastic vehicle dynamics for both vehicle-to-everything (V2V) and vehicle-to-infrastructure (V2I) links. Our results demonstrate that SAC, through entropy-regularized maximum-entropy reinforcement learning, achieves superior and robust beam tracking performance. SAC attains a mean evaluation reward of 47,350 versus 31,200 for DDPG, 18,900 for PPO, and 12,800 for TRPO, and maintains simultaneous dual-link connectivity 78.3% of the time compared to 54.1% for the myopic greedy baseline. Temporal analysis confirms that SAC's learned policy sustains link quality 1.45 times more effectively than the reactive baseline during dynamic intersection crossing scenarios. These results establish O-ISAC as a compelling architecture for next-generation vehicular networks and deep RL as the methodology of choice for joint beam management."]},{"key":"dc:title","label":"Title","values":["OPTICAL INTEGRATED SENSING AND COMMUNICATION: DEEP REINFORCEMENT LEARNING-BASED BEAM TRACKING FOR DYNAMIC VEHICLE-TO-EVERYTHING NETWORKS"]}]}],"canonical_facts":{"dc:contributor":["Huaxia Wang, Ph.D.","Ben Wu, Ph.D.","Gianesh Baliga, Ph.D."],"dc:creator":["Sharan, Akshat"],"dc:date.available":["2026-07-20T07:00:00Z"],"dc:date.created":["2026-07-20T07:00:00Z"],"dc:description.abstract":["Optical Wireless Communication (OWC) promises ultra-high bandwidth for vehicular networks but suffers from critical beam misalignment in dynamic environments. The emerging paradigm of Optical Integrated Sensing and Communication (O-ISAC) addresses this challenge by unifying the sensing and communication functions over a single shared optical aperture, enabling real-time environmental awareness to guide beam steering. However, the multi-objective, stochastic nature of this joint optimization problem renders classical closed-form controllers inadequate. This thesis proposes and evaluates a deep reinforcement learning framework for continuous beam tracking in a 2D vehicular O-ISAC scenario. We conduct a comprehensive comparative study of four state-of-the-art deep RL algorithms: Soft Actor-Critic (SAC), Proximal Policy Optimization (PPO), Trust Region Policy Optimization (TRPO), and Deep Deterministic Policy Gradient (DDPG), each trained for 5 million environment steps in a custom Gymnasium simulation. The environment incorporates log-normal atmospheric turbulence, geometric pointing loss, ray-casting blockage detection, and stochastic vehicle dynamics for both vehicle-to-everything (V2V) and vehicle-to-infrastructure (V2I) links. Our results demonstrate that SAC, through entropy-regularized maximum-entropy reinforcement learning, achieves superior and robust beam tracking performance. SAC attains a mean evaluation reward of 47,350 versus 31,200 for DDPG, 18,900 for PPO, and 12,800 for TRPO, and maintains simultaneous dual-link connectivity 78.3% of the time compared to 54.1% for the myopic greedy baseline. Temporal analysis confirms that SAC's learned policy sustains link quality 1.45 times more effectively than the reactive baseline during dynamic intersection crossing scenarios. These results establish O-ISAC as a compelling architecture for next-generation vehicular networks and deep RL as the methodology of choice for joint beam management."],"dc:identifier":["https://rdw.rowan.edu/etd/3564"],"dc:subject":["Deep Reinforcement Learning;Integrated Sensing and Communication;Optical Wireless Communication;Vehicle-to-Everything"],"dc:title":["OPTICAL INTEGRATED SENSING AND COMMUNICATION: DEEP REINFORCEMENT LEARNING-BASED BEAM TRACKING FOR DYNAMIC VEHICLE-TO-EVERYTHING NETWORKS"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S. Data Science"]},"updated_at":"2026-11-19T09:00:08Z"}