Back to search

University of York

Unsupervised morpheme segmentation in a non-parametric Bayesian framework

Abstract

dc:description.abstract

Learning morphemes from any plain text is an emerging research area in the natural language processing. Knowledge about the process of word formation is helpful in devising automatic segmentation of words into their constituent morphemes. This thesis applies unsupervised morpheme induction method, based on the statistical behavior of words, to induce morphemes for word segmentation. The morpheme cache for the purpose is based on the Dirichlet Process (DP) and stores frequency information of the induced morphemes and their occurrences in a Zipfian distribution. This thesis uses a number of empirical, morpheme-level grammar models to classify the induced morphemes under the labels prefix, stem and suffix. These grammar models capture the different structural relationships among the morphemes. Furthermore, the morphemic categorization reduces the problems of over segmentation. The output of the strategy demonstrates a significant improvement on the baseline system. Finally, the thesis measures the performance of the unsupervised morphology learning system for Nepali.

Degree

thesis:*
Name dc:type.qualificationname
M.Sc by research
Level dc:type.qualificationlevel
masters
Grantor dc:publisher.institution
University of York
Year dc:date.issued
2011

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Basnet, Santa B.
Advisor dc:contributor.advisor
  • Manandhar, Suresh

Rights

Language dc:language.dcterms_iso639_2
eng

Chain of custody

source
Harvested from
White Rose University Consortium
Base URL
etheses.whiterose.ac.uk/cgi/oai2
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
related terms
citation

Basnet, Santa B.. Unsupervised morpheme segmentation in a non-parametric Bayesian framework. masters thesis, University of York, 2011.