Back to search

NJIT

A neural analysis-synthesis approach to learning procedural audio models

Abstract

dc:description.abstract

<p>The effective sound design of environmental sounds is crucial to demonstrating an immersive experience. Classical Procedural Audio (PA) models have been developed to give the sound designer a fast way to synthesize a specific class of environmental sounds in a physically accurate and computationally efficient manner. These models are controllable due to the choice of parameters from analyzing a class of sound. However, the resulting synthesis lacks the fidelity for the preferred immersive experience; thus, the sound designer would rather search through an extensive database for real recordings of a target sound class. This thesis proposes the Procedural audio Variational autoEncoder (ProVE), a general framework for developing a high-fidelity PA model through data-driven neural audio synthesis methods to address the lack of realism in classical PA models. The two-step procedure of training ProVE models is explained through examples of sound classes of footstep sounds and the sound of pouring water.</p><p>Furthermore, the thesis demonstrates a web application where users can generate footstep sounds by defining control variables for a pretrained ProVE model to show its capacity for interactive use in sound design workflows. The increase in fidelity from ProVE models is explored through objective evaluations of audio and subjective evaluations against classical PA methods. These results show that these learned neural PA models are feasible for sound design projects. The thesis concludes with a discussion of applications and future research directions.</p>

Degree

thesis:*
Name thesis:degree_name
Master of Science in Data Science - (M.S.)
Discipline thesis:degree_discipline
Data Science

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Serrano, Danzel
Contributors dc:contributor
  • James Geller
  • Mark Cartwright
  • Przemyslaw Musialski

Subjects

dc:subject × 6

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.njit.edu/theses/2097

Chain of custody

source
Harvested from
NJIT
Base URL
digitalcommons.njit.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Serrano, Danzel. A neural analysis-synthesis approach to learning procedural audio models. https://digitalcommons.njit.edu/theses/2097