Back to search

University of North Texas

The Fabric of Entropy: A Discussion on the Meaning of Fractional Information

Abstract

dc:description

Why is the term information in English an uncountable noun, whereas in information theory it is a well-defined quantity? Since the amount of information can be quantified, what is the meaning of a fraction of that amount? This dissertation introduces a quasi-entropy matrix which developed from Claude Shannon's information measure as an analytical tool for behavioral studies. Such matrix emphasizes the role of relative characteristics of individual level data across different collections. The real challenge in the big data era is never the size of the dataset, but how data lead scientists to individuals rather than arbitrarily divided statistical groups. This proposed matrix, when combining with other statistical measures, provides a new and easy-to-do method for identifying pattern in a well-defined system because it is built on the idea that uneven probability distributions lead to decrease in system entropy. Although the matrix is not superior to classical correlation techniques, it allows an interpretation not available with traditional standard statistics. Finally, this matrix connects heterogeneous datasets because it is a frequency-based method and it works on the modes of data rather than the means of values. It also visualizes clustering in data although this type of clustering is not measured by the squared Euclidean distance of the numerical attributes.

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
2019

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zhang, Yuan
Contributors dc:contributor
  • O'Connor, Brian Clark
  • Chang, Hsia-Ching
  • Anderson, Richard L., 1970-

Subjects

dc:subject × 3

Rights

dc:rights
Statement dc:rights
  • Public
  • Zhang, Yuan
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights Reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: submission_1615
https://digital.library.unt.edu/ark:/67531/metadc1538775/
ark: ark:/67531/metadc1538775

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Zhang, Yuan. The Fabric of Entropy: A Discussion on the Meaning of Fractional Information. University of North Texas, 2019. https://doi.org/10.12794/metadc1538775