Back to search

Cornell University

A Model of Unsupervised Formal Learning for Natural Language

Abstract

dc:description.abstract

Formal language theory has shown that strong notions of learnability do not apply directly to classes of formal language that may include natural languages, regardless of the number of strings presented to the learner. However, research in statistical learning has shown that neural network language models can predict certain linguistic properties when trained on text alone. Unsupervised statistical models that leverage grammar formalisms have not yet achieved the same level of performance, despite advantages in interpretability. I introduce a variably supervised learning algorithms that can directly apply the rules of a number of different grammar formalisms to learn from natural language texts. This algorithm, the Missing Link algorithm, allows for the direct comparison of different grammar formalisms and learning environments. I compare results for Combinatory Categorial Grammars, Tree-Adjoining Grammars, and Relational Grammars with a number of different parameters. These results show that weakly equivalent grammar formalisms, such as CCGs and TAGs, perform differently in unsupervised learning and that directly encoding linguistic features into Relational Grammars can improve performance at specific linguistic tasks, at least in English. I also show that the same algorithm can be used to learn simple a semantics semantics using Abstract Meaning Representations. These results open new lines of research into the exploration of learning models for natural language.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Linguistics
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Linguistics
Grantor
Cornell University
Year dc:date.issued
2020

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Collard, Jacob Neil
Chair dc:contributor.chair
  • Rooth, Mats
Committee members dc:contributor.committeemember
  • Bowers, John S.
  • Despic, Miloje

Subjects

dc:subject × 6

Rights

dc:rights
Statement dc:rights
  • Attribution 4.0 International
Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
13277971
Dc Identifier Other
ProQuest Submission ID: 12154
ProQuest Publication ID: 28031674

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Collard, Jacob Neil. A Model of Unsupervised Formal Learning for Natural Language. Doctor of Philosophy thesis, Cornell University, 2020. https://hdl.handle.net/1813/103003