Back to search

University of Birmingham

An automated learner-based reading ability estimation strategy using concept indexing with integrated Part-of-Speech n-gram features

Abstract

dc:description.abstract

This study is about the development of a retrainable reading ability estimation system based on concepts from the Text Readability Indexing (TRI) domain. This system aims to promote self-directed language learning and to serve as an educational reinforcement tool for English language learners. Student essays were used to calibrate the system which provided realistic approximations of their actual reading levels. In this thesis, we compared the performance of two vector semantics-based algorithms, namely, Latent Semantic Indexing (LSI) and Concept Indexing (CI) for content analysis. Since these algorithms rely on the bag-of-words approach and inherently lack grammatical analysis, we augmented them using Part-of-Speech (POS) n-gram features to approximate the syntactic complexity of text documents. Results show that directly combining the content-and grammar-based feature sets yielded lower classification accuracies than utilising each feature set alone. Using a sparsification strategy, we were able to optimise the combination process and, with the integration of POS bi-grams, we achieved our overall highest mean exact agreement accuracies (MEAA) of 0.924 and 0.952 for LSI and CI, respectively. We have also conducted error analyses on our results where we examined overestimation and underestimation error types to uncover the probable causes for the systems' misclassifications.

Degree

thesis:*
Name dc:type.qualificationname
d_ph
Level dc:type.qualificationlevel
d_ph
Grantor dc:publisher.institution
University of Birmingham
Year dc:date.issued
2017

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Razon, Abigail R.

Subjects

dc:subject × 4

Rights

Language dc:language.dcterms_iso639_2
eng

Chain of custody

source
Harvested from
University of Birmingham
Base URL
etheses.bham.ac.uk/cgi/oai2
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Razon, Abigail R.. An automated learner-based reading ability estimation strategy using concept indexing with integrated Part-of-Speech n-gram features. d_ph thesis, University of Birmingham, 2017.