Back to search

Michigan Technological University

Performance Comparison of Binarized Neural Network with Convolutional Neural Network

Abstract

dc:description.abstract

Deep learning is a trending topic widely studied by researchers due to increase in the abundance of data and getting meaningful results with them. Convolutional Neural Networks (CNN) is one of the most popular architectures used in deep learning. Binarized Neural Network (BNN) is also a neural network which consists of binary weights and activations. Neural Networks has large number of parameters and overfitting is a common problem to these networks. To overcome the overfitting problem, dropout is a solution. Randomly dropping some neurons along with its connections helps to prevent co-adaptations which finally help in reducing overfitting. Many researchers have analyzed the performance of CNN and studied about the effect of dropout on CNN using datasets like MNIST and CIFAR10. The factors like Dropout rate, Dataset size, Batch Normalization layer, Filter size, and Dropout layer addition has been studied on CNN. But there is a lack of literature in the study of dropout and the various factors in Binarized Neural Network. This report will provide a brief introduction about BNN, the advantage of using dropout and the performance comparison between BNN and CNN. A detailed description of the software packages, coding environment, algorithm flow, and deep learning framework is provided. A comprehensive analysis on the performance of BNN and CNN is performed, and BNN shows near state-of-the-art results like CNN. The research demonstrates the adding of dropout layer to a BNN for MNIST and CIFAR10 datasets, and shows that it might provide improvement to the baseline BNN’s classification accuracy. Finally, the report investigates the different factors such as Dropout rate, Dataset size, Batch Normalization layer, Filter size, and Dropout layer addition on BNN.

Degree

thesis:*
Name thesis:degree_name
Master of Science in Electrical Engineering (MS)
Level thesis:degree_level
Open Access Master's Report
Discipline thesis:degree_discipline
Department of Electrical and Computer Engineering

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Baruah, Lopamudra
Committee members dc:contributor.committeemember
  • Zhaohui Wang
  • Timothy Havens
Contributors dc:contributor
  • Zhuo Feng

Subjects

dc:subject × 6

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
Michigan Technological University
Base URL
digitalcommons.mtu.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Baruah, Lopamudra. Performance Comparison of Binarized Neural Network with Convolutional Neural Network. Open Access Master's Report thesis, https://doi.org/10.37099/mtu.dc.etdr/487