Back to search

Georgia Institute of Technology

Radar Spectrum Sharing with Reactive Emitters using Reinforcement Learning

Abstract

dc:description.abstract

This research develops non-collaborative spectrum sharing techniques that may be used by radars against dynamic and reactive in-band emitters. Historically, each user of RF spectrum was allocated a different frequency band, allowing for interference-free operation but inefficient use of spectrum resources, because of temporally sparse use in some allocated frequency bands. The proliferation of commercial cellular services in the mid-2000s strained spectrum resources, resulting in US government-led spectrum auctions, which changed spectrum allocation to a sharing model to more efficiently use limited spectrum resources. Spectrum sharing is a well-established field of research with a bias toward collaborative techniques intended for use by communication systems. Modern radar systems have distinct requirements and capabilities to make them candidates for non-collaborative spectrum sharing. Radars can rapidly change transmission frequency, location, direction, time, polarization, and waveform code to increase the efficiency of spectrum use while simultaneously minimizing interference. Existing non-collaborative spectrum sharing techniques use reactive sense and avoid, predictive models, and online learning. Importantly, prior non-collaborative spectrum sharing research evaluated spectrum sharing performance in the presence of time-varying emitters and has been limited in its examination of the utility of online learning. This work extends prior non-collaborative spectrum sharing by assuming that time-varying emitters react to other in-band spectrum users. Discrete and continuous Markov decision process (MDP) models are developed for radar spectrum sharing with appropriate reinforcement learning algorithms to control radar waveform selection. Radar spectrum sharing performance is assessed through simulation using the Q-Learning algorithm to make spectrum access decisions in the discrete MDP model and a linear function approximation algorithm using the deterministic policy gradient theorem is used in the continuous MDP model. Simulations for both MDP models include a variety of time-varying and reactive emitters and alternative radar spectrum access strategies for comparison. Though we use MDP models with limited attributes of the environment and the radar waveform, this initial work is proof of concept that can be extended to larger models, especially the continuous MDP model. Through simulation, this research establishes that using reinforcement learning control algorithms for radar waveform selection results in an improvement of more than 25% in average rewards and over 5 dB improvement in signal-to-interference-plus-noise ratio (SINR) over the next best performing strategy across a selection of emitter types, including both time-varying and reactive behaviors.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Electrical and Computer Engineering
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Hayden, Brooke Elizabeth
Advisors dc:contributor.advisor
  • Melvin, William L.
  • Willkins, Danielle
Committee members dc:contributor.committeemember
  • Lanterman, Aaron
  • Gombolay, Matthew
  • Barnes, Christopher
  • Chakravarthy, Vasu

Subjects

dc:subject × 4

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/78633

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Hayden, Brooke Elizabeth. Radar Spectrum Sharing with Reactive Emitters using Reinforcement Learning. Doctoral thesis, Georgia Institute of Technology, 2025. https://hdl.handle.net/1853/78633