Monterey, California. Naval Postgraduate School
A study of topic and topic change in conversational threads
Abstract
dc:description.abstractThis thesis applies Latent Dirichlet Allocation (LDA) to the problem of topic and topic change in conversational threads using e-mail. We demonstrate that LDA can be used to successfully classify raw e-mail messages with threads to which they belong, and compare the results with those for processed threads, where quoted and reply text have been removed. Raw thread classification performs better, but processed threads show promise. We then present two new, unsupervised techniques for identifying topic change in e-mail. The first is a keyword clustering approach using LDA and DBSCAN to identify clusters of topics, and transition points between them. The second is a sliding window technique which assesses the current topic for every window, identifying transition points. The keyword clustering performs better than the sliding window approach. Both can be used as a baseline for future work.
Degree
thesis:*- Name thesis:degree_name
- M.S.
- Level thesis:degree_level
- Masters
- Discipline thesis:degree_discipline
- Computer Science
- Grantor dc:publisher
- Monterey, California. Naval Postgraduate School
- Year dc:date.issued
- 2009
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Cowan-Sharp, Jessy.
- Advisor dc:contributor.advisor
-
- Martell, Craig H.
- Committee member dc:contributor.committeemember
-
- Garfinkel, Simson L.
Subjects
dc:subject × 2Rights
dc:rights- Statement dc:rights
-
- Approved for public release; distribution is unlimited.
Identifiers
dc:identifier.*- OCLC
- 464224508