Abstract
dc:description.abstractIn this thesis, we present a system for annotating persuasion in conversation based on a social-psychological model. We augmented the social model developed by James Cialdini with some of our own categories for annotators to label. The conversations consisted of 37 hostage negotiation transcripts from private and public sources, with all personal information removed from the private source transcripts. We evaluated the level of agreement between annotators using Cohen's Kappa measurement. Our initial results showed only fair to moderate agreement, with an average kappa score around 0.41 for transcripts of significant length (over 200 utterances). Based on these results, annotators revised the annotation model and eliminated some categories of persuasion while adding "other" as a catchall for any persuasive utterance not covered by Cialdini. The revised model showed a significant increase in agreement with an average kappa score of 0.78 for transcripts of significant length (over 200 utterances). Based on this revised model, annotators adjudicated a final persuasion corpus for the 37 transcripts that will be used in future works on persuasion detection.
Degree
thesis:*- Name thesis:degree_name
- M.S.
- Level thesis:degree_level
- Masters
- Discipline thesis:degree_discipline
- Computer Science
- Department dc:contributor.department
- Computer Science
- Grantor dc:publisher
- Monterey, California. Naval Postgraduate School
- Year dc:date.issued
- 2010
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Gilbert, Henry T.
- Advisor dc:contributor.advisor
-
- Martell, Craig
- Committee member dc:contributor.committeemember
-
- Anand, Pranav
Subjects
dc:subject × 3Rights
dc:rights- Statement dc:rights
-
- This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
- Approved for public release; distribution is unlimited.
Identifiers
dc:identifier.*- OCLC
- 610021693