Back to search

University of North Texas

Event Sequence Identification and Deep Learning Classification for Anomaly Detection and Predication on High-Performance Computing Systems

Abstract

dc:description

High-performance computing (HPC) systems continue growing in both scale and complexity. These large-scale, heterogeneous systems generate tens of millions of log messages every day. Effective log analysis for understanding system behaviors and identifying system anomalies and failures is highly challenging. Existing log analysis approaches use line-by-line message processing. They are not effective for discovering subtle behavior patterns and their transitions, and thus may overlook some critical anomalies. In this dissertation research, I propose a system log event block detection (SLEBD) method which can extract the log messages that belong to a component or system event into an event block (EB) accurately and automatically. At the event level, we can discover new event patterns, the evolution of system behavior, and the interaction among different system components. To find critical event sequences, existing sequence mining methods are mostly based on the a priori algorithm which is compute-intensive and runs for a long time. I develop a novel, topology-aware sequence mining (TSM) algorithm which is efficient to generate sequence patterns from the extracted event block lists. I also train a long short-term memory (LSTM) model to cluster sequences before specific events. With the generated sequence pattern and trained LSTM model, we can predict whether an event is going to occur normally or not. To accelerate such predictions, I propose a design flow by which we can convert recurrent neural network (RNN) designs into register-transfer level (RTL) implementations which are deployed on FPGAs. Due to its high parallelism and low power, FPGA achieves a greater speedup and better energy efficiency compared to CPU and GPU according to our experimental results.

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
2019

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Li, Zongze
Contributors dc:contributor
  • Fu, Song (Computer science and engineering researcher)
  • Huang, Yan
  • Yuan, Xiaohui (Computer science researcher)
  • Zhao, Hui

Subjects

dc:subject × 7

Rights

dc:rights
Statement dc:rights
  • Public
  • Li, Zongze
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights Reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: submission_1839
https://digital.library.unt.edu/ark:/67531/metadc1609172/
ark: ark:/67531/metadc1609172

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Li, Zongze. Event Sequence Identification and Deep Learning Classification for Anomaly Detection and Predication on High-Performance Computing Systems. University of North Texas, 2019. https://doi.org/10.12794/metadc1609172