Georgia Institute of Technology
Radar Spectrum Sharing with Reactive Emitters using Reinforcement Learning
Abstract
dc:description.abstractThis research develops non-collaborative spectrum sharing techniques that may be used by radars against dynamic and reactive in-band emitters. Historically, each user of RF spectrum was allocated a different frequency band, allowing for interference-free operation but inefficient use of spectrum resources, because of temporally sparse use in some allocated frequency bands. The proliferation of commercial cellular services in the mid-2000s strained spectrum resources, resulting in US government-led spectrum auctions, which changed spectrum allocation to a sharing model to more efficiently use limited spectrum resources. Spectrum sharing is a well-established field of research with a bias toward collaborative techniques intended for use by communication systems. Modern radar systems have distinct requirements and capabilities to make them candidates for non-collaborative spectrum sharing. Radars can rapidly change transmission frequency, location, direction, time, polarization, and waveform code to increase the efficiency of spectrum use while simultaneously minimizing interference. Existing non-collaborative spectrum sharing techniques use reactive sense and avoid, predictive models, and online learning. Importantly, prior non-collaborative spectrum sharing research evaluated spectrum sharing performance in the presence of time-varying emitters and has been limited in its examination of the utility of online learning. This work extends prior non-collaborative spectrum sharing by assuming that time-varying emitters react to other in-band spectrum users. Discrete and continuous Markov decision process (MDP) models are developed for radar spectrum sharing with appropriate reinforcement learning algorithms to control radar waveform selection. Radar spectrum sharing performance is assessed through simulation using the Q-Learning algorithm to make spectrum access decisions in the discrete MDP model and a linear function approximation algorithm using the deterministic policy gradient theorem is used in the continuous MDP model. Simulations for both MDP models include a variety of time-varying and reactive emitters and alternative radar spectrum access strategies for comparison. Though we use MDP models with limited attributes of the environment and the radar waveform, this initial work is proof of concept that can be extended to larger models, especially the continuous MDP model. Through simulation, this research establishes that using reinforcement learning control algorithms for radar waveform selection results in an improvement of more than 25% in average rewards and over 5 dB improvement in signal-to-interference-plus-noise ratio (SINR) over the next best performing strategy across a selection of emitter types, including both time-varying and reactive behaviors.
Degree
thesis:*- Level thesis:degree_level
- Doctoral
- Department dc:contributor.department
- Electrical and Computer Engineering
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2025
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Hayden, Brooke Elizabeth
- Advisors dc:contributor.advisor
-
- Melvin, William L.
- Willkins, Danielle
- Committee members dc:contributor.committeemember
-
- Lanterman, Aaron
- Gombolay, Matthew
- Barnes, Christopher
- Chakravarthy, Vasu
Subjects
dc:subject × 4Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/78633