Back to search

University of South Florida

Sentiment Analysis in Peer Review

Abstract

dc:description

Sentiment analysis, a widely popular subfield of natural language processing, has recently been used in the classroom to predict student attrition or to determine the mood of students, teacher strengths and weaknesses, or student perception of internship experience. These are all helpful indicators for the enhancement of students' academic experience but none improve the information gathered from or the reliability of peer review. This is particularly important in large courses with complex assignments (e.g., essays, software projects, and presentations) where scalable grading is requisite. In this dissertation, we apply sentiment analysis not on an assignment itself, but on the meaningful content generated by a learning, peer-reviewing crowd to produce a fine-grained, quantitative score from peer review text alone. To obtain a reliable score from peer review text, we first supply an educational framework that increases the amount of critical feedback students provide. We then utilize an aspect extractor to aggregate pertinent information from student content and modify our review form in a data-driven, iterative fashion. HeLPS, our domain-specific lexicon, was mined from peer review comments and exhibits high precision on peer review text compared to other publicly-available lexicons. Our sentiment analysis algorithm, SentiSoft, leverages both the lexicon and aspect extractor to provide a fine-grained sentiment score with metrics and supporting documentation from text alone. The combination of sentiment analysis on text and an iteratively-refined review form improves our ability to understand student feedback and ultimately facilitates scalable assessment.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (Ph.D.)
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Computer Science and Engineering
Grantor
University of South Florida
Year dc:date
2020

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Beasley, Zachariah J.
Contributors dc:contributor
  • Les Piegl, Ph.D.
  • Paul Rosen, Ph.D.
  • Yao Liu, Ph.D.
  • Susana Lai-Yuen, Ph.D.
  • Alon Friedman, Ph.D.

Subjects

dc:subject × 6

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/8160

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Beasley, Zachariah J.. Sentiment Analysis in Peer Review. Dissertation thesis, University of South Florida, 2020. https://digitalcommons.usf.edu/etd/8160