Back to search

University of South Florida

Generative Spatio-Temporal and Multimodal Analysis of Neonatal Pain

Abstract

dc:description

Neonates can not express their pain like an adult person. Due to the lacking of proper muscle growth and inability to express non-verbally, it is difficult to understand their emotional status. In addition, if the neonates are under any treatment or left monitored after any major surgeries (post-operative), it is more difficult to understand their pain due to the side effect of medications and the caring system (i.e. intubated, masked face, covered body with blanket, etc.). In a clinical environment, usually, bedside nurses routinely observe the neonate and measure the pain status following any standard clinical pain scale. But current practice is intermittent and subjective.In this dissertation, we investigate developing an automated neonatal monitoring system that can replace the current manual system in a clinical environment. We explore the availability of current neonatal pain datasets and the challenges of neonatal pain data collection. We further collect and present a multimodal neonatal pain dataset, especially focusing on postoperative pain that mimics a real clinical environment. To develop the automated system, at first, we explore the effectiveness of individual modalities (i.e., facial expression, body movement, crying sound, vital signs) and propose novel spatio-temporal methods to analyze neonatal pain. Later, we develop a full multimodal system that is capable of using all modalities together to provide the pain signal. We also want to make sure that the automated system can effectively function in a real clinical environment. In a real clinical system, missing modality is very common due to different clinical factors (i.e., masked face, covered body, etc.) or algorithms' limitations (i.e., low light condition, side face view, etc.). We also propose a multimodal system that can effectively regenerate pseudo-features for missing modalities and continue assessing neonatal pain.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (Ph.D.)
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Computer Science and Engineering
Grantor
University of South Florida
Year dc:date
2022

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Salekin, Md Sirajus
Contributors dc:contributor
  • Yu Y. Sun, Ph.D.
  • Dmitry Goldgof, Ph.D.
  • Ghada Zamzmi, Ph.D.

Subjects

dc:subject × 7

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/9813

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Salekin, Md Sirajus. Generative Spatio-Temporal and Multimodal Analysis of Neonatal Pain. Dissertation thesis, University of South Florida, 2022. https://digitalcommons.usf.edu/etd/9813