Monterey, CA; Naval Postgraduate School
INTEGRITY-BASED TRUST VIOLATIONS WITHIN HUMAN-MACHINE TEAMING
Abstract
dc:description.abstractSuccessful human-machine teaming requires humans to trust machines. While many claim to welcome automation, there is also mistrust of machines, which may stem from more than competence concerns. Human-automation trust research to date has considered automation capable of competence-based trust violations (CBTV), but integrity-based trust violations (IBTV) should also be studied. Future advances in artificial intelligence and cyber warfare could result in the perception—and possible reality—of automation committing IBTVs. The current study paired human participants with an automated teammate to complete a sequence of computer-based visual search and investment tasks. During each session, the automation committed either an IBTV or CBTV, and participants’ trust responses were measured through self-reported trust, trust-based reliance behavior, time spent making reliance decisions, and investment behavior. The results found that (a) average self-reported trust in the automation was significantly lower in the IBTV than the CBTV condition, (b) personal investment behavior was more consistent with reported trust levels than reliance behavior and may be a better gauge of trust, and (c) trust behavior differed more between IBTV and CBTV conditions among participants who invested more in their automated teammate. The differences found in participant trust response between conditions are enough to warrant further research into how humans react to automation committing IBTVs.
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Mechanical Engineering
- Level thesis:degree_level
- Masters
- Discipline thesis:degree_discipline
- Mechanical Engineering
- Department dc:contributor.department
- Mechanical and Aerospace Engineering (MAE)
- Grantor dc:publisher
- Monterey, CA; Naval Postgraduate School
- Year dc:date.issued
- 2018
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Clark, Tiffany
- Advisors dc:contributor.advisor
-
- McGuire, Mollie R.
- Bingham, Brian S.
Rights
dc:rights- Statement dc:rights
-
- This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
- Approved for public release; distribution is unlimited.
Identifiers
dc:identifier.*- Thesis Thesis Identifier
- 29749