{"id":{"repo_id":"bu","oai_identifier":"oai:open.bu.edu:2144/52144"},"canonical_url":"https://search.ndltd.org/etd/bu/oai:open.bu.edu:2144/52144","repository":{"repo_id":"bu","name":"Boston University","base_url":"https://open.bu.edu/oai/request"},"display":{"title":"Tools and methods for learning in multi-agent maritime strategy games","abstract":"Reinforcement learning (RL) presents a powerful paradigm for learning complex robotic tasks. While many works have studied its use in solving single-agent strategic and adversarial games in simulation, its application to games played in real-world maritime multi-agent environments is lacking. This can partially be attributed to the scarcity of learning-compatible multi-agent maritime simulators with sim-to-real pipelines, and a lack of imitation and reinforcement learning methods designed for long-horizon, adversarial, multi-agent strategy games in which coordination and cooperation are required. To date, cooperative multi-agent RL methods are often evaluated on either simple tasks with finite state-spaces, or curated mini-games from a small handful of real-time strategy video games. This leaves us with a suite of methods that either cannot handle the state-space complexity, or are too domain-specialized to learn viable strategies for other multi-agent strategy games, such as maritime capture-the-flag. In this dissertation, we address this gap from the ground-up by introducing a Python-based simulator and pipeline for training and deploying policies for multi-agent maritime strategy games, testing and deploying a sample-efficient imitation learning algorithm for multi-agent maritime capture-the-flag, and developing a preference-based inverse reinforcement learning method for reward extrapolation from suboptimal demonstrations of long-horizon zero-sum games.","abstract_html":"Reinforcement learning (RL) presents a powerful paradigm for learning complex robotic tasks. While many works have studied its use in solving single-agent strategic and adversarial games in simulation, its application to games played in real-world maritime multi-agent environments is lacking. This can partially be attributed to the scarcity of learning-compatible multi-agent maritime simulators with sim-to-real pipelines, and a lack of imitation and reinforcement learning methods designed for long-horizon, adversarial, multi-agent strategy games in which coordination and cooperation are required. To date, cooperative multi-agent RL methods are often evaluated on either simple tasks with finite state-spaces, or curated mini-games from a small handful of real-time strategy video games. This leaves us with a suite of methods that either cannot handle the state-space complexity, or are too domain-specialized to learn viable strategies for other multi-agent strategy games, such as maritime capture-the-flag. In this dissertation, we address this gap from the ground-up by introducing a Python-based simulator and pipeline for training and deploying policies for multi-agent maritime strategy games, testing and deploying a sample-efficient imitation learning algorithm for multi-agent maritime capture-the-flag, and developing a preference-based inverse reinforcement learning method for reward extrapolation from suboptimal demonstrations of long-horizon zero-sum games.","abstract_has_math":false,"creators":["Crowley-Dolen, Peter"],"institution":"Boston University","degree_name":"Doctor of Philosophy","degree_level":"doctoral","degree_discipline":"Mechanical Engineering","degree_department":null,"school":null,"contributors":[],"advisors":["Belta, Calin"],"committee_chairs":[],"committee_members":[],"year":2026,"date_issued":"2026","date_published":"2026","updated_at":"2026-11-19T02:42:12Z","subjects":["Robotics","Artificial intelligence","Imitation learning","Inverse reinforcement learning","Reinforcement learning"],"languages":["en_US"],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[{"key":"dc:identifier.orcid","label":"ORCID","values":["0009-0000-1030-1315"],"render_values":[{"text":"0009-0000-1030-1315","href":"https://orcid.org/0009-0000-1030-1315","code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/2144/52144","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"https://hdl.handle.net/2144/52144","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://open.bu.edu/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Aopen.bu.edu%3A2144%2F52144","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Belta, Calin"]},{"key":"dc:creator","label":"Author","values":["Crowley-Dolen, Peter"]},{"key":"dc:identifier.orcid","label":"ORCID","values":["0009-0000-1030-1315"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2026-02-03T14:02:02Z"]},{"key":"dc:date.embargo","label":"Dc Date Embargo","values":["2027-01-29T00:00:00Z"]},{"key":"dc:date.issued","label":"Date","values":["2026"]},{"key":"dc:date.updated","label":"Dc Date Updated","values":["2026-01-29T23:03:14Z"]},{"key":"dc:type","label":"Dc Type","values":["Thesis/Dissertation"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Mechanical Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["doctoral"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Boston University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Robotics","Artificial intelligence","Imitation learning","Inverse reinforcement learning","Reinforcement learning"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_US"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/2144/52144"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["2026"]},{"key":"dc:description.abstract","label":"Abstract","values":["Reinforcement learning (RL) presents a powerful paradigm for learning complex robotic tasks. While many works have studied its use in solving single-agent strategic and adversarial games in simulation, its application to games played in real-world maritime multi-agent environments is lacking. This can partially be attributed to the scarcity of learning-compatible multi-agent maritime simulators with sim-to-real pipelines, and a lack of imitation and reinforcement learning methods designed for long-horizon, adversarial, multi-agent strategy games in which coordination and cooperation are required. To date, cooperative multi-agent RL methods are often evaluated on either simple tasks with finite state-spaces, or curated mini-games from a small handful of real-time strategy video games. This leaves us with a suite of methods that either cannot handle the state-space complexity, or are too domain-specialized to learn viable strategies for other multi-agent strategy games, such as maritime capture-the-flag. In this dissertation, we address this gap from the ground-up by introducing a Python-based simulator and pipeline for training and deploying policies for multi-agent maritime strategy games, testing and deploying a sample-efficient imitation learning algorithm for multi-agent maritime capture-the-flag, and developing a preference-based inverse reinforcement learning method for reward extrapolation from suboptimal demonstrations of long-horizon zero-sum games."]},{"key":"dc:title","label":"Title","values":["Tools and methods for learning in multi-agent maritime strategy games"]}]}],"canonical_facts":{"dc:contributor.advisor":["Belta, Calin"],"dc:creator":["Crowley-Dolen, Peter"],"dc:date.accessioned":["2026-02-03T14:02:02Z"],"dc:date.embargo":["2027-01-29T00:00:00Z"],"dc:date.issued":["2026"],"dc:date.updated":["2026-01-29T23:03:14Z"],"dc:description":["2026"],"dc:description.abstract":["Reinforcement learning (RL) presents a powerful paradigm for learning complex robotic tasks. While many works have studied its use in solving single-agent strategic and adversarial games in simulation, its application to games played in real-world maritime multi-agent environments is lacking. This can partially be attributed to the scarcity of learning-compatible multi-agent maritime simulators with sim-to-real pipelines, and a lack of imitation and reinforcement learning methods designed for long-horizon, adversarial, multi-agent strategy games in which coordination and cooperation are required. To date, cooperative multi-agent RL methods are often evaluated on either simple tasks with finite state-spaces, or curated mini-games from a small handful of real-time strategy video games. This leaves us with a suite of methods that either cannot handle the state-space complexity, or are too domain-specialized to learn viable strategies for other multi-agent strategy games, such as maritime capture-the-flag. In this dissertation, we address this gap from the ground-up by introducing a Python-based simulator and pipeline for training and deploying policies for multi-agent maritime strategy games, testing and deploying a sample-efficient imitation learning algorithm for multi-agent maritime capture-the-flag, and developing a preference-based inverse reinforcement learning method for reward extrapolation from suboptimal demonstrations of long-horizon zero-sum games."],"dc:identifier.orcid":["0009-0000-1030-1315"],"dc:identifier.uri":["https://hdl.handle.net/2144/52144"],"dc:language.iso":["en_US"],"dc:subject":["Robotics","Artificial intelligence","Imitation learning","Inverse reinforcement learning","Reinforcement learning"],"dc:title":["Tools and methods for learning in multi-agent maritime strategy games"],"dc:type":["Thesis/Dissertation"],"thesis:degree_discipline":["Mechanical Engineering"],"thesis:degree_level":["doctoral"],"thesis:degree_name":["Doctor of Philosophy"],"thesis:institution_name":["Boston University"]},"updated_at":"2026-11-19T02:42:12Z"}