Back to search

Monterey, CA; Naval Postgraduate School

MACHINE LEARNING OF EXTREMELY LARGE SETS OF SIGNAL COLLECTIONS USING CLUSTER COMPUTING

Abstract

dc:description.abstract

Multitudes of signals are transmitted over the airwaves at any given moment, creating a large intelligence opportunity and reconnaissance problem. As technology advances, cluster computing methods must be explored to fill the intelligence gap caused by an increasingly large amount of data and a limited number of human analysts. In this thesis, Apache HBase, Phoenix, and Spark are employed on an AWS EMR cluster to store, query, and implement the K-means machine learning algorithm on a large-scale signals database. The signal databases tested consist of up to 100 million randomly generated signals, with nine feature columns of metadata. The signal data set is first bulk-loaded into HBase and a Phoenix layer is implemented. The data is then queried from Spark into a Dataframe for machine learning implementation. Additionally, the K-means implementations are run on multiple different computer-cluster configurations to test performance as a function of the number of computers in the cluster. This thesis demonstrates the capabilities and benefits of utilizing open-source software and cluster computing to implement large-scale machine learning on signal metadata.

Degree

thesis:*
Name thesis:degree_name
Master of Science in Electrical Engineering
Level thesis:degree_level
Masters
Discipline thesis:degree_discipline
Electrical Engineering
Department dc:contributor.department
Electrical and Computer Engineering (ECE)
Grantor dc:publisher
Monterey, CA; Naval Postgraduate School
Year dc:date.issued
2019

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Ferris, Christopher L.
Advisors dc:contributor.advisor
  • Kragh, Frank E.
  • Scrofani, James W.

Rights

dc:rights
Statement dc:rights
  • This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
  • Approved for public release; distribution is unlimited.

Identifiers

dc:identifier.*
Thesis Thesis Identifier
30541

Chain of custody

source
Harvested from
Naval Postgraduate School
Base URL
calhoun.nps.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Ferris, Christopher L.. MACHINE LEARNING OF EXTREMELY LARGE SETS OF SIGNAL COLLECTIONS USING CLUSTER COMPUTING. Masters thesis, Monterey, CA; Naval Postgraduate School, 2019. https://hdl.handle.net/10945/64153