Back to search

Cornell University

HUMAN ACTION TEMPORAL DETECTION AND PROBABILISTIC PREDICTION UNDER ABRUPT CHANGING SCENARIOS

Abstract

dc:description.abstract

Human behavior understanding is central to enabling intelligent, real-time, and proactive systems to interact with humans. While numerous studies have been dedicated to human behavior understanding, detecting and predicting sudden human action changes remains a formidable challenge due to the erratic and stochastic nature of human behaviors. This dissertation presents the development of efficient and accurate algorithms for understanding human sudden change behaviors and predicting such changes to facilitate intelligent systems to interact with humans seamlessly. A two-stage action change detection framework is first introduced to enable a machine to efficiently perceive and comprehend diverse human actions with variable time lengths. In the first stage, the algorithm uses a lightweight multi-window change point analysis method to identify action change times in continuous action sequences. In the second stage, an action recognition algorithm is selectively applied when a new action is detected. Numerical experiments show that this approach reduces computational costs and improves classification accuracy when compared to existing well-known action segmentation methods. Moreover, to enable robots capable of interacting with human seamlessly and proactively, it is essential to develop their cognitive ability to predict human behaviors. This problem is particularly challenging due to the stochastic nature of people’s future behaviors. Existing behavior prediction algorithms, such as trajectory prediction studies, focused on producing multi-modal feasible paths to capture prediction uncertainty. However, this approach encountered challenges in predicting abrupt motions, such as sharp turning or stopping, due to the infrequent occurrence of such scenarios in the current public datasets and the absence of explicit cues in the observed motion pattern. A novel approach is proposed to predict a potential abrupt change in a pedestrian’s motion before this change can be observed from their current motion pattern. The approach is particularly focused on a group of pedestrians undergoing a potentially changing scenario, where one of the group members may lead the change. By detecting the change and leveraging this information, the unforeseen change in another group member’s motion can be predicted. The proposed approach is validated on a novel dataset consisting of abundant abruptly changing scenarios in group settings, demonstrating notable improvement in prediction accuracy compared to existing approaches.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Mechanical Engineering
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Mechanical Engineering
Grantor
Cornell University
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Huo, Qingze
Chair dc:contributor.chair
  • Ferrari, Silvia
Committee members dc:contributor.committeemember
  • Krishnamurthy, Vikram
  • Hariharan, Bharath

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
16921896
Dc Identifier Other
ProQuest Submission ID: 14747
ProQuest Publication ID: 31640856

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Huo, Qingze. HUMAN ACTION TEMPORAL DETECTION AND PROBABILISTIC PREDICTION UNDER ABRUPT CHANGING SCENARIOS. Doctor of Philosophy thesis, Cornell University, 2024. https://hdl.handle.net/1813/117142