Back to search

McMaster University

Assessment of CNN+XGBoost Performance for Image Classification

Abstract

dc:description.abstract

In the last few years, convolutional neural network (CNN) models have provided state-of-the-art results in visual recognition tasks. Similarly to CNNs, tree-based methods, in particular, gradient tree boosting (XGBoost) provided superior results in many applications. Taking into account the superiority of both methods, the goalof this work is to implement the CNN+XGBoost combined model where learned representations extracted from the CNN part will be used as input features for the XGBoost part. It is of particular interest to investigate whether the XGBoost part improves classification accuracy of the CNN part. In this work, we use existing approaches — AlexNet, AllConvolutionalNet, WideResNet, DenseNet and CaffeNet (in transfer learning mode) — to extract features from the CNN part with different quality, which is defined by the classification accuracy of the appropriate CNN model. Then XGBoost is trained on the extracted features and the obtained final accuracy of AlexNet+XGBoost, AllConvolutionalNet+XGBoost,WideResNet+XGBoost, DenseNet+XGBoost and CaffeNet+XGBoost models are assessed. All experiments are fulfilled using the CIFAR10 image dataset. Our results show that features extracted by CNNs, which provided more than 85–88% classification accuracy, do not allow XGBoost to improve the final CNN+XGBoost classification performance.

Degree

thesis:*
Department dc:contributor.department
Mathematics and Statistics
Year dc:date.issued
2021

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Turchenko, Andrii
Advisor dc:contributor.advisor
  • McNicholas, Paul D.

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
McMaster University
Base URL
macsphere.mcmaster.ca/server/oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Turchenko, Andrii. Assessment of CNN+XGBoost Performance for Image Classification. 2021. http://hdl.handle.net/11375/28377