Back to search

Graduate Studies

Log-based Anomaly Detection of Enterprise Software: An Empirical Study

Abstract

dc:description.abstract

With software increasing in scale and playing an important role in today’s society, application reliability has become a crucial metric. Most applications use logging as a mechanism to diagnose anomalies, but is often employed post-failure. However, since logs provide insight into current software health, they can be leveraged to detect anomalies, which could help with reducing system downtime. Anomaly detection using software execution logs has been explored in several prior studies, using both classical and deep neural network based machine learning models. In recent years, the research has largely focused in using variations of sequence-based deep neural networks (e.g., Long-Short Term Memory and Transformer-based models) for log-based anomaly detection on open-source data. However, they have not been applied in industrial datasets as often. In addition, the studied open-source datasets are typically very large in size with logging statements that do not change over time, which may not be the case with a dataset from an industrial service that is relatively new. In this thesis, we evaluate several state-of-the-art anomaly detection models on an industrial dataset from our research partner, which is much smaller and loosely structured than most open-source datasets. Results show that while all models are capable of detecting anomalies, certain models are better suited for less-structured datasets. We also see that model effectiveness changes when data leaks associated with a random train-test split is removed. A qualitative study of error types identified by the developers on the industrial dataset further shows strengths and weaknesses of the models in detecting different types of anomalies. Finally, we explore the effect of limited training data by gradually increasing the training set size, to evaluate if the model effectiveness does depend on the training set size.

Degree

thesis:*
Name thesis:degree_name
Master of Science (MSc)
Discipline thesis:degree_discipline
Engineering – Electrical & Computer
Grantor dc:publisher.institution
Graduate Studies
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Wijesinghe, Nadun
Advisor dc:contributor.advisor
  • Hemmati, Hadi
Committee members dc:contributor.committeemember
  • Krishnamurthy, Diwakar
  • Drew, Steve
  • Hemmati, Hadi
  • de Souza, Roberto Medeiros

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • University of Calgary graduate students retain copyright ownership and moral rights for their thesis. You may use this material in any way that is permitted by the Copyright Act or through licensing that has been assigned to the document. For uses that are not allowable under copyright legislation or licensing, you are required to seek permission.
Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Citation
Wijesinghe, N. (2023). Log-based anomaly detection of enterprise software: an empirical study (Master's thesis, University of Calgary, Calgary, Canada). Retrieved from https://prism.ucalgary.ca.

Chain of custody

source
Harvested from
University of Calgary
Base URL
ucalgary.scholaris.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Wijesinghe, Nadun. Log-based Anomaly Detection of Enterprise Software: An Empirical Study. Graduate Studies, 2023. http://hdl.handle.net/1880/116136