Back to search

Michigan State University

Real-time human/group interaction monitoring platform integrating sensor fusion and machine learning approaches

Abstract

dc:description

A person's social intelligence impacts their physical and mental health, and the productivity levels of the individuals involved, for example, in workplace interactions. To promote successful social interactions, this dissertation explores the use of sensor technology and machine learning algorithms to monitor and quantify nonverbal behavior indicators in real time. This dissertation conducts extensive convergence research between psychology, communication science, and engineering and establishes a new real-time human/group interaction monitoring platform. From sensor selection to data collection and algorithm design, existing human behavior monitoring systems vary widely in the type of methods employed for their design. Many of these systems were trained with data collected in controlled environments, making them not practical for real-life scenarios. Moreover, existing systems lack the capabilities needed to recognize behaviors in a manner that could support machine-augmented social intelligence. To address these issues, the developed human/group interaction monitoring platform combines a real-time enabled multi-sensor system with a machine learning framework that establishes training and algorithm design methods for behavior recognition. Methods for the execution of human studies, collection of natural human behavior data, and data annotation procedures were also established to train machines to recognize human behaviors impacting the quality of social interactions. The contributions of this dissertation, which can be universally applied to other behavior studies, will advance the design of human behavior monitoring systems for group interactions and facilitate future real-time feedback to increase self-awareness and promote successful social interactions.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Davila-Montero, Sylmarie
Contributors dc:contributor
  • Mason, Andrew J.
  • Aviyente, Selin
  • Hall, Angela
  • Purcell, Erin
  • Bente, Gary

Subjects

dc:subject × 7

Rights

dc:rights
Statement dc:rights
  • In Copyright
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
etd:50816
isbn:9798357544285
oclc:on1373601782
oclc:1373601782
umi:29991713
local:DxE1vilaMontero_grad.msu_0128D_19487

Chain of custody

source
Harvested from
Michigan State University
Base URL
d.lib.msu.edu/oai
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Davila-Montero, Sylmarie. Real-time human/group interaction monitoring platform integrating sensor fusion and machine learning approaches. 2022. https://doi.org/doi:10.25335/jmt7-wh93