Back to search

University of North Texas

Accuracy and Interpretability Testing of Text Mining Methods

Abstract

dc:description

Extracting meaningful information from large collections of text data is problematic because of the sheer size of the database. However, automated analytic methods capable of processing such data have emerged. These methods, collectively called text mining first began to appear in 1988. A number of additional text mining methods quickly developed in independent research silos with each based on unique mathematical algorithms. How good each of these methods are at analyzing text is unclear. Method development typically evolves from some research silo centric requirement with the success of the method measured by a custom requirement-based metric. Results of the new method are then compared to another method that was similarly developed. The proposed research introduces an experimentally designed testing method to text mining that eliminates research silo bias and simultaneously evaluates methods from all of the major context-region text mining method families. The proposed research method follows a random block factorial design with two treatments consisting of three and five levels (RBF-35) with repeated measures. Contribution of the research is threefold. First, the users perceived a difference in the effectiveness of the various methods. Second, while still not clear, there are characteristics with in the text collection that affect the algorithms ability to extract meaningful results. Third, this research develops an experimental design process for testing the algorithms that is adaptable into other areas of software development and algorithm testing. This design eliminates the bias based practices historically employed by algorithm developers.

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
2013

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Ashton, Triss A.
Contributors dc:contributor
  • Evangelopoulos, Nicholas
  • Pavur, Robert J.
  • Prybutok, Victor
  • Paswan, Audhesh

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • Public
  • Ashton, Triss A.
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights Reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
https://digital.library.unt.edu/ark:/67531/metadc283791/
ark: ark:/67531/metadc283791

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Ashton, Triss A.. Accuracy and Interpretability Testing of Text Mining Methods. University of North Texas, 2013. https://doi.org/10.12794/metadc283791