Abstract
dc:descriptionThe demand for a creative workforce has never been higher, yet schools struggle to teach and assess creativity among students predictably and efficiently. Compositions are an effective way to incorporate creativity across the curriculum; however, essays are time consuming for teachers to score for objective quality or subjective creativity. In this study, I explored a) if high creativity scores are related to high quality and sophistication in academic writing, and b) if extant text-mining tools effectively identify quality, sophistication, and creativity in academic essays. I collected 230 essays written by Grade 11 students. Four human-raters analyzed these essays for quality, sophistication, and creativity, and I used text-mining tools designed to assess creativity to analyze the same. Using correlations - including the variables semantic distance (measured against the GloVe corpus), entropy (measured with Shannon's Entropy Index), and idea density (measured with CPIDR5.1) - I assessed both human-raters' and text-mining tools' proficiency at identifying quality, sophistication, and creativity in academic essays. Quality, sophistication, and creativity were also regressed on these same text-mining variables to assess which method - human or computer – and which of the text-mining tools - best predicts these dependent variables. Human-raters' creativity scores correlated with human-raters' quality scores (r = .418) and sophistication scores (r = .321), as well as the text-mining tools MeanSim (r = -.131), OCS Originality (r = .359), Idea Density (r = .368), and Entropy (r = .388). These findings suggest text-mining tools designed for creativity can capture quality and sophistication of student essays. A comparison of human-raters' creativity scores and text-mining models revealed text-mining models can capture quality (R2 = .445) and sophistication (R2 = .373) better than human raters can capture quality (R2 = .175) and sophistication (R2 = .103).
Degree
thesis:*- Grantor dc:publisher
- University of North Texas
- Year dc:date
- 2022
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Nagel, Janessa Helen Bower
- Contributors dc:contributor
-
- Acar, Selcuk
- Mun, Rachel
- Uanhoro, James
- Barrio, Brenda
- Kursuncu, Ugur
Subjects
dc:subject × 7Rights
dc:rights- Statement dc:rights
-
- Public
- Nagel, Janessa Helen Bower
- Copyright
- Copyright is held by the author, unless otherwise noted. All rights Reserved.
- Language dc:language
- English
Identifiers
dc:identifier.*- Identifier
-
local-cont-no: submission_3195
https://digital.library.unt.edu/ark:/67531/metadc2048679/
ark: ark:/67531/metadc2048679