{"id":{"repo_id":"gatech","oai_identifier":"oai:repository.gatech.edu:1853/78747"},"canonical_url":"https://search.ndltd.org/etd/gatech/oai:repository.gatech.edu:1853/78747","repository":{"repo_id":"gatech","name":"Georgia Tech","base_url":"https://repository.gatech.edu/server/oai/request"},"display":{"title":"Vision-Based Hazard Detection and Real-Time Safe Trajectory Optimization Using Successive Convexification for Lunar Landing","abstract":"With the renewed interest in returning to the Moon, achieving autonomous and safe lunar descent and landing is paramount for the success of future missions. Safe and autonomous descent also reduces the overhead logistics of pre-planning, surveying, and mapping lunar landing sites. During the descent phase of a lunar mission, the lander must steer away from rough terrain hazards and descend safely to the surface while constrained by fuel, maneuverability, and localization uncertainty. This thesis presents a framework for real-time state estimation, hazard detection from descent imagery, safety-constrained trajectory optimization, and tracking controller for guidance. The proposed framework navigates using dead reckoning and Kalman filter-based sensor fusion to track the descent path using accelerometer and altimetry data while leveraging U-NET image segmentation and contour detection to identify lunar hazards such as craters from cameras that are then scaled and translated for hazard avoidance optimization. A full-horizon, fixed final time, minimum control trajectory optimization problem with control and dynamic constraints is solved using successive convexification (SCvx) optimization scheme. Where the hazard regions identified from descent imagery are represented as ellipse-avoidance chance constraints enforced at the terminal state, ensuring the lander avoids hazards with high confidence despite positional uncertainty. The use of SCvx enables the decomposition of the nonlinear thrust vectoring dynamics and constraints into a series of convex subproblems, significantly enhancing computational efficiency and achieving real-time feasibility. This optimization is performed thrice during descent, allowing the lander to continuously reoptimize and adapt its descent trajectory in response to updated hazard maps generated from the imagery. A Lyapunov-based tracking controller translates the commands from the optimization into thruster and gimbal inputs to track the descent to the safe landing site at a faster update rate. The U-NET segmentation model is trained on synthetic lunar images, the Lyapunov control law is derived to ensure global asymptotic tracking, and the framework is simulated using matplotlib to generate descent imagery as synthetic images.","abstract_html":"With the renewed interest in returning to the Moon, achieving autonomous and safe lunar descent and landing is paramount for the success of future missions. Safe and autonomous descent also reduces the overhead logistics of pre-planning, surveying, and mapping lunar landing sites. During the descent phase of a lunar mission, the lander must steer away from rough terrain hazards and descend safely to the surface while constrained by fuel, maneuverability, and localization uncertainty. This thesis presents a framework for real-time state estimation, hazard detection from descent imagery, safety-constrained trajectory optimization, and tracking controller for guidance. The proposed framework navigates using dead reckoning and Kalman filter-based sensor fusion to track the descent path using accelerometer and altimetry data while leveraging U-NET image segmentation and contour detection to identify lunar hazards such as craters from cameras that are then scaled and translated for hazard avoidance optimization. A full-horizon, fixed final time, minimum control trajectory optimization problem with control and dynamic constraints is solved using successive convexification (SCvx) optimization scheme. Where the hazard regions identified from descent imagery are represented as ellipse-avoidance chance constraints enforced at the terminal state, ensuring the lander avoids hazards with high confidence despite positional uncertainty. The use of SCvx enables the decomposition of the nonlinear thrust vectoring dynamics and constraints into a series of convex subproblems, significantly enhancing computational efficiency and achieving real-time feasibility. This optimization is performed thrice during descent, allowing the lander to continuously reoptimize and adapt its descent trajectory in response to updated hazard maps generated from the imagery. A Lyapunov-based tracking controller translates the commands from the optimization into thruster and gimbal inputs to track the descent to the safe landing site at a faster update rate. The U-NET segmentation model is trained on synthetic lunar images, the Lyapunov control law is derived to ensure global asymptotic tracking, and the framework is simulated using matplotlib to generate descent imagery as synthetic images.","abstract_has_math":false,"creators":["Brown, Abinay Joel"],"institution":"Georgia Institute of Technology","degree_name":null,"degree_level":"Masters","degree_discipline":null,"degree_department":"Aerospace Engineering","school":null,"contributors":[],"advisors":["Vamvoudakis, Kyriakos G."],"committee_chairs":[],"committee_members":["Chou, Glen","Gan, Lu"],"year":2025,"date_issued":"2025-08-06","date_published":"2025-08-06","updated_at":"2026-11-19T05:17:37Z","subjects":["Successive Convexification","Lunar Landing","Vision Based Hazard Detection","Lyapunov Control","UNET","U-NET","image segmentation","Kalman Filter"],"languages":["en_US"],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1853/78747","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"https://hdl.handle.net/1853/78747","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://repository.gatech.edu/server/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Arepository.gatech.edu%3A1853%2F78747","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Vamvoudakis, Kyriakos G."]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Chou, Glen","Gan, Lu"]},{"key":"dc:contributor.department","label":"Department","values":["Aerospace Engineering"]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["College of Engineering","Daniel Guggenheim School of Aerospace Engineering"]},{"key":"dc:creator","label":"Author","values":["Brown, Abinay Joel"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2025-08-15T12:46:31Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2025-08-15T12:46:31Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2025-08"]},{"key":"dc:date.issued","label":"Date","values":["2025-08-06"]},{"key":"dc:date.submitted","label":"Dc Date Submitted","values":["August 2025"]},{"key":"dc:date.updated","label":"Dc Date Updated","values":["2025-08-15T12:46:31Z"]},{"key":"dc:publisher","label":"Institution","values":["Georgia Institute of Technology"]},{"key":"dc:relation.advisorentity","label":"Dc Relation Advisorentity","values":["f93c7dcd-17f6-4bc9-9fd1-02e5cbd46514"]},{"key":"dc:relation.orgunit","label":"Dc Relation Orgunit","values":["7c022d60-21d5-497c-b552-95e489a06569","a348b767-ea7e-4789-af1f-1f1d5925fb65"]},{"key":"dc:type","label":"Dc Type","values":["Text","Thesis"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Masters"]},{"key":"thesis:degree_program","label":"Thesis Degree Program","values":["Aerospace Engineering"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Successive Convexification","Lunar Landing","Vision Based Hazard Detection","Lyapunov Control","UNET","U-NET","image segmentation","Kalman Filter"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_US"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1853/78747"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["With the renewed interest in returning to the Moon, achieving autonomous and safe lunar descent and landing is paramount for the success of future missions. Safe and autonomous descent also reduces the overhead logistics of pre-planning, surveying, and mapping lunar landing sites. During the descent phase of a lunar mission, the lander must steer away from rough terrain hazards and descend safely to the surface while constrained by fuel, maneuverability, and localization uncertainty. This thesis presents a framework for real-time state estimation, hazard detection from descent imagery, safety-constrained trajectory optimization, and tracking controller for guidance. The proposed framework navigates using dead reckoning and Kalman filter-based sensor fusion to track the descent path using accelerometer and altimetry data while leveraging U-NET image segmentation and contour detection to identify lunar hazards such as craters from cameras that are then scaled and translated for hazard avoidance optimization. A full-horizon, fixed final time, minimum control trajectory optimization problem with control and dynamic constraints is solved using successive convexification (SCvx) optimization scheme. Where the hazard regions identified from descent imagery are represented as ellipse-avoidance chance constraints enforced at the terminal state, ensuring the lander avoids hazards with high confidence despite positional uncertainty. The use of SCvx enables the decomposition of the nonlinear thrust vectoring dynamics and constraints into a series of convex subproblems, significantly enhancing computational efficiency and achieving real-time feasibility. This optimization is performed thrice during descent, allowing the lander to continuously reoptimize and adapt its descent trajectory in response to updated hazard maps generated from the imagery. A Lyapunov-based tracking controller translates the commands from the optimization into thruster and gimbal inputs to track the descent to the safe landing site at a faster update rate. The U-NET segmentation model is trained on synthetic lunar images, the Lyapunov control law is derived to ensure global asymptotic tracking, and the framework is simulated using matplotlib to generate descent imagery as synthetic images."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["M.S."]},{"key":"dc:format.mimetype","label":"Dc Format Mimetype","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Vision-Based Hazard Detection and Real-Time Safe Trajectory Optimization Using Successive Convexification for Lunar Landing"]},{"key":"dspace:entity.type","label":"Dspace Entity Type","values":["Publication"]}]}],"canonical_facts":{"dc:contributor.advisor":["Vamvoudakis, Kyriakos G."],"dc:contributor.committeemember":["Chou, Glen","Gan, Lu"],"dc:contributor.department":["Aerospace Engineering"],"dc:contributor.other":["College of Engineering","Daniel Guggenheim School of Aerospace Engineering"],"dc:creator":["Brown, Abinay Joel"],"dc:date.accessioned":["2025-08-15T12:46:31Z"],"dc:date.available":["2025-08-15T12:46:31Z"],"dc:date.created":["2025-08"],"dc:date.issued":["2025-08-06"],"dc:date.submitted":["August 2025"],"dc:date.updated":["2025-08-15T12:46:31Z"],"dc:description.abstract":["With the renewed interest in returning to the Moon, achieving autonomous and safe lunar descent and landing is paramount for the success of future missions. Safe and autonomous descent also reduces the overhead logistics of pre-planning, surveying, and mapping lunar landing sites. During the descent phase of a lunar mission, the lander must steer away from rough terrain hazards and descend safely to the surface while constrained by fuel, maneuverability, and localization uncertainty. This thesis presents a framework for real-time state estimation, hazard detection from descent imagery, safety-constrained trajectory optimization, and tracking controller for guidance. The proposed framework navigates using dead reckoning and Kalman filter-based sensor fusion to track the descent path using accelerometer and altimetry data while leveraging U-NET image segmentation and contour detection to identify lunar hazards such as craters from cameras that are then scaled and translated for hazard avoidance optimization. A full-horizon, fixed final time, minimum control trajectory optimization problem with control and dynamic constraints is solved using successive convexification (SCvx) optimization scheme. Where the hazard regions identified from descent imagery are represented as ellipse-avoidance chance constraints enforced at the terminal state, ensuring the lander avoids hazards with high confidence despite positional uncertainty. The use of SCvx enables the decomposition of the nonlinear thrust vectoring dynamics and constraints into a series of convex subproblems, significantly enhancing computational efficiency and achieving real-time feasibility. This optimization is performed thrice during descent, allowing the lander to continuously reoptimize and adapt its descent trajectory in response to updated hazard maps generated from the imagery. A Lyapunov-based tracking controller translates the commands from the optimization into thruster and gimbal inputs to track the descent to the safe landing site at a faster update rate. The U-NET segmentation model is trained on synthetic lunar images, the Lyapunov control law is derived to ensure global asymptotic tracking, and the framework is simulated using matplotlib to generate descent imagery as synthetic images."],"dc:description.degree":["M.S."],"dc:format.mimetype":["application/pdf"],"dc:identifier.uri":["https://hdl.handle.net/1853/78747"],"dc:language.iso":["en_US"],"dc:publisher":["Georgia Institute of Technology"],"dc:relation.advisorentity":["f93c7dcd-17f6-4bc9-9fd1-02e5cbd46514"],"dc:relation.orgunit":["7c022d60-21d5-497c-b552-95e489a06569","a348b767-ea7e-4789-af1f-1f1d5925fb65"],"dc:subject":["Successive Convexification","Lunar Landing","Vision Based Hazard Detection","Lyapunov Control","UNET","U-NET","image segmentation","Kalman Filter"],"dc:title":["Vision-Based Hazard Detection and Real-Time Safe Trajectory Optimization Using Successive Convexification for Lunar Landing"],"dc:type":["Text","Thesis"],"dspace:entity.type":["Publication"],"thesis:degree_level":["Masters"],"thesis:degree_program":["Aerospace Engineering"]},"updated_at":"2026-11-19T05:17:37Z"}