Back to search

Monterey, California. Naval Postgraduate School

Persuasion detection in conversation

Abstract

dc:description.abstract

In this thesis, we present a system for annotating persuasion in conversation based on a social-psychological model. We augmented the social model developed by James Cialdini with some of our own categories for annotators to label. The conversations consisted of 37 hostage negotiation transcripts from private and public sources, with all personal information removed from the private source transcripts. We evaluated the level of agreement between annotators using Cohen's Kappa measurement. Our initial results showed only fair to moderate agreement, with an average kappa score around 0.41 for transcripts of significant length (over 200 utterances). Based on these results, annotators revised the annotation model and eliminated some categories of persuasion while adding "other" as a catchall for any persuasive utterance not covered by Cialdini. The revised model showed a significant increase in agreement with an average kappa score of 0.78 for transcripts of significant length (over 200 utterances). Based on this revised model, annotators adjudicated a final persuasion corpus for the 37 transcripts that will be used in future works on persuasion detection.

Degree

thesis:*
Name thesis:degree_name
M.S.
Level thesis:degree_level
Masters
Discipline thesis:degree_discipline
Computer Science
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Monterey, California. Naval Postgraduate School
Year dc:date.issued
2010

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Gilbert, Henry T.
Advisor dc:contributor.advisor
  • Martell, Craig
Committee member dc:contributor.committeemember
  • Anand, Pranav

Subjects

dc:subject × 3

Rights

dc:rights
Statement dc:rights
  • This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
  • Approved for public release; distribution is unlimited.

Identifiers

dc:identifier.*
OCLC
610021693

Chain of custody

source
Harvested from
Naval Postgraduate School
Base URL
calhoun.nps.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Gilbert, Henry T.. Persuasion detection in conversation. Masters thesis, Monterey, California. Naval Postgraduate School, 2010. https://hdl.handle.net/10945/5366