Back to search

Carleton University

Performance Evaluation of Transformer-based NLP Models on Fake News Detection Datasets

Abstract

dc:description.abstract

Fake news has the potential to have catastrophic effects because it is increasingly concerning how it spreads on social media. Due to the lack of available research on the performance of various transformer models using datasets that contain data samples from a wide variety of domains, it is essential to increase the research in this field. Hence, this research investigates the performance of various suitable machine learning algorithms implementations on three fake news datasets: LIAR, FNC-1 and Balanced Dataset for Fake News Analysis. Some pre-trained transformer language models, BERT, RoBERTa, ALBERT and DistilBERT, were chosen for this research. The experiments' results indicated that RoBERTa is the best performing model across all datasets. The results also indicated that DistilBERT trains in half the time as required by the other three models. RoBERTa obtained an accuracy of 69% when trained on the LIAR dataset.

Degree

thesis:*
Name thesis:degree_name
Master of Applied Science (M.App.Sc.)
Level thesis:degree_level
Master's
Discipline thesis:degree_discipline
Engineering, Electrical and Computer
Grantor dc:publisher
Carleton University
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Narendra Babu, Raveen

Subjects

dc:subject × 3

Rights

dc:rights
Statement dc:rights
  • Copyright © 2023 the author(s). Theses may be used for non-commercial research, educational, or related academic purposes only. Such uses include personal study, research, scholarship, and teaching. Theses may only be shared by linking to Carleton University Institutional Repository and no part may be used without proper attribution to the author. No part may be used for commercial purposes directly or indirectly via a for-profit platform; no adaptation or derivative works are permitted without consent from the copyright owner.
Language dc:language.iso
en

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
Carleton University
Base URL
carleton.scholaris.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Narendra Babu, Raveen. Performance Evaluation of Transformer-based NLP Models on Fake News Detection Datasets. Master's thesis, Carleton University, 2023. https://hdl.handle.net/20.500.14718/41708