Back to search

University of North Texas

Measuring Creativity in Academic Writing

Abstract

dc:description

The demand for a creative workforce has never been higher, yet schools struggle to teach and assess creativity among students predictably and efficiently. Compositions are an effective way to incorporate creativity across the curriculum; however, essays are time consuming for teachers to score for objective quality or subjective creativity. In this study, I explored a) if high creativity scores are related to high quality and sophistication in academic writing, and b) if extant text-mining tools effectively identify quality, sophistication, and creativity in academic essays. I collected 230 essays written by Grade 11 students. Four human-raters analyzed these essays for quality, sophistication, and creativity, and I used text-mining tools designed to assess creativity to analyze the same. Using correlations - including the variables semantic distance (measured against the GloVe corpus), entropy (measured with Shannon's Entropy Index), and idea density (measured with CPIDR5.1) - I assessed both human-raters' and text-mining tools' proficiency at identifying quality, sophistication, and creativity in academic essays. Quality, sophistication, and creativity were also regressed on these same text-mining variables to assess which method - human or computer – and which of the text-mining tools - best predicts these dependent variables. Human-raters' creativity scores correlated with human-raters' quality scores (r = .418) and sophistication scores (r = .321), as well as the text-mining tools MeanSim (r = -.131), OCS Originality (r = .359), Idea Density (r = .368), and Entropy (r = .388). These findings suggest text-mining tools designed for creativity can capture quality and sophistication of student essays. A comparison of human-raters' creativity scores and text-mining models revealed text-mining models can capture quality (R2 = .445) and sophistication (R2 = .373) better than human raters can capture quality (R2 = .175) and sophistication (R2 = .103).

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
2022

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Nagel, Janessa Helen Bower
Contributors dc:contributor
  • Acar, Selcuk
  • Mun, Rachel
  • Uanhoro, James
  • Barrio, Brenda
  • Kursuncu, Ugur

Subjects

dc:subject × 7

Rights

dc:rights
Statement dc:rights
  • Public
  • Nagel, Janessa Helen Bower
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights Reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: submission_3195
https://digital.library.unt.edu/ark:/67531/metadc2048679/
ark: ark:/67531/metadc2048679

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Nagel, Janessa Helen Bower. Measuring Creativity in Academic Writing. University of North Texas, 2022. https://doi.org/10.12794/metadc2048679