Back to search

University of Birmingham

Online data stream classification in the presence of Concept Drift and Class Imbalance

Abstract

dc:description.abstract

Online data stream learning requires to process each training example upon arrival. Machine learning algorithms designed to process data in this manner are particularly suitable for this digital era, as the volume and the incoming speed of data are growing everyday. However, the environments of most real-world applications in online data stream learning are usually non-stationary, meaning that their underlying distribution may change over time (concept drift). Also, in real-world classification task, the number of examples from different classes are unlikely to be equal (class imbalance). Existing literature of concept drift adaptation and class imbalanced learning have been well-established in the last years. Yet, there still exists little work to address the joint challenge of them. This thesis contributes to this area of study by investigating how to deal with concept drift from a memory perspective and investigating how to create synthetic examples to aid in learning the skewed class while able to adapt to concept drift in class imbalanced data streams. The main contributions of this thesis are: - A study of the impact of different memory management strategies to the predictive performance. - A novel diversity-based memory management strategy that can maximise the chance of having relevant past knowledge to exploit in dealing with concept drift. - A novel framework called Concept Drift Handling Based on Clustering in the Model Space (CDCMS), which can deal with multiple types of concept drifts in class balanced data streams by exploiting relevant past knowledge. - A set of novel memory strategies for class imbalanced learning that can maintain and recover relevant past knowledge to deal with concept drift in class imbalanced data stream. From that, a novel framework called Concept Drift Handling Based on Clustering in the Model Space for Class Imbalanced Learning (CDCMS.CIL) is proposed. - A novel approach called Synthetic Minority Oversampling based on Stream Clustering (SMOClust), which creates synthetic examples based on stream clustering to aid in learning the skewed class, while able to adapt to concept drifts.

Degree

thesis:*
Name dc:type.qualificationname
d_ph
Level dc:type.qualificationlevel
d_ph
Grantor dc:publisher.institution
University of Birmingham
Year dc:date.issued
2022

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Chiu, Chun Wai
ORCID person:identifier.orcid

Subjects

dc:subject × 1

Rights

Language dc:language.dcterms_iso639_2
eng

Identifiers

dc:identifier.*
Dc Identifier Grantnumber
Stable Prediction of Defect-Inducing Software Changes (SPDISC)

Chain of custody

source
Harvested from
University of Birmingham
Base URL
etheses.bham.ac.uk/cgi/oai2
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Chiu, Chun Wai. Online data stream classification in the presence of Concept Drift and Class Imbalance. d_ph thesis, University of Birmingham, 2022.