Back to search

Michigan State University

A probabilistic topic modeling approach for event detection in social media

Abstract

dc:description

Social media services, such as Twitter, have become a prominent source of information for event detection and monitoring applications as they provide access to massive volume of dynamic user content. Previous studies have focused on detecting a variety of events from Twitter feeds, including natural disasters such as earthquakes and hurricanes and entertainment events, such as sporting events and music festivals. A key challenge to event detection from Twitter is identifying user posts, or tweets, that are relevant to the monitored event. Current approaches can be grouped into three categories---keyword filtering, supervised classification, and topic modeling. Keyword filtering is the simplest approach but it tends to produce a high false positive rate. Supervised classification approaches apply generic classifiers, such as support vector machine (SVM), to determine if a tweet is related to the event of interest. Their performance depends on the quality of features used to represent the data. Topic modeling approaches such as latent Dirichlet allocation (LDA) can automatically infer the latent topics within the tweets. However, due to the unsupervised nature of the algorithm, they are not as effective as supervised learning approaches. The approach developed in this thesis combines probabilistic topic modeling with supervised classification to leverage the advantages from each approach. This supervised topic modeling approach, called subtopicLDA, utilizes label information to help guide the topic model to select topics that best fit the label information. The model is evaluated for its effectiveness in detecting foodborne illness related tweets.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • VanDam, Courtland
Contributors dc:contributor
  • Tan, Pang Ning
  • Chai, Joyce
  • Punch, William

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • In Copyright
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
etd:931
isbn:9781267847294
isbn:1267847298
oclc:931882902
umi:1531765
local:VanDam_grad.msu_0128N_11821

Chain of custody

source
Harvested from
Michigan State University
Base URL
d.lib.msu.edu/oai
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

VanDam, Courtland. A probabilistic topic modeling approach for event detection in social media. 2012. https://doi.org/doi:10.25335/4ter-wq70