Carleton University
Performance Evaluation of Transformer-based NLP Models on Fake News Detection Datasets
Abstract
dc:description.abstractFake news has the potential to have catastrophic effects because it is increasingly concerning how it spreads on social media. Due to the lack of available research on the performance of various transformer models using datasets that contain data samples from a wide variety of domains, it is essential to increase the research in this field. Hence, this research investigates the performance of various suitable machine learning algorithms implementations on three fake news datasets: LIAR, FNC-1 and Balanced Dataset for Fake News Analysis. Some pre-trained transformer language models, BERT, RoBERTa, ALBERT and DistilBERT, were chosen for this research. The experiments' results indicated that RoBERTa is the best performing model across all datasets. The results also indicated that DistilBERT trains in half the time as required by the other three models. RoBERTa obtained an accuracy of 69% when trained on the LIAR dataset.
Degree
thesis:*- Name thesis:degree_name
- Master of Applied Science (M.App.Sc.)
- Level thesis:degree_level
- Master's
- Discipline thesis:degree_discipline
- Engineering, Electrical and Computer
- Grantor dc:publisher
- Carleton University
- Year dc:date.issued
- 2023
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Narendra Babu, Raveen
Subjects
dc:subject × 3Rights
dc:rights- Statement dc:rights
-
- Copyright © 2023 the author(s). Theses may be used for non-commercial research, educational, or related academic purposes only. Such uses include personal study, research, scholarship, and teaching. Theses may only be shared by linking to Carleton University Institutional Repository and no part may be used without proper attribution to the author. No part may be used for commercial purposes directly or indirectly via a for-profit platform; no adaptation or derivative works are permitted without consent from the copyright owner.
- Language dc:language.iso
- en