Sound is a crucial part of our life. Well-designed acoustic behaviors can lead to significant improvement in both physical and virtual interactions. In computer graphics, most existing methods focused primarily on improving the accuracy. It remained underexplored on how to develop efficient acoustic simulation algorithms for interactive practical applications. The challenges arise from the dilemma between expensive accurate simulations and fast feedback demanded by intuitive user interaction: traditional physics-based acoustic simulations are computationally expensive; yet, for end users to benefit from the simulations, it is crucial to give prompt feedback during interactions. In this thesis, I investigate how to develop efficient acoustic simulations for real-world applications such as immersive media and digital fabrication. To address the above-mentioned challenges, I leverage precomputation and optimization to significantly improve the speed while preserving the accuracy of complex acoustic phenomena. This work discusses three efforts along this research direction: First, to ease sound designer's workflow, we developed a fast keypoint-based precomputation algorithm to enable interactive acoustic transfer values in virtual sound simulations. Second, for realistic audio editing in 360° videos, we proposed an inverse material optimization based on fast sound simulation and a hybrid ambisonic audio synthesis that exploits the directional isotropy in spatial audios. Third, we devised a modular approach to efficiently simulate and optimize fabrication-ready acoustic filters, achieving orders of magnitudes speedup while maintaining the simulation accuracy. Through this series of projects, I demonstrate a wide range of applications made possible by efficient acoustic simulations.

Virtual Stage is a project to use Virtual Reality (VR) technology as an audiovisual performance interface. The depth of control, modularity of design, and user immersion aim to solve some of the representational problems in interactive audiovisual art and the control problems in digital musical instruments. Creating feedback between interaction and perception, the VR environment references the viewer's behavioral intuition developed in the real world, facilitating clarity in the understanding of artistic representation. The critical essay discusses of interactive behavior, game mechanics, interface implementations, and technical developments to express the structures and performance possibilities. This discussion uses Virtual Stage as an example with specific aesthetic and technical solutions, but addresses archetypal concerns in interactive audiovisual art. The creative documentation lists the interactive functions present in Virtual Stage as well as code reproductions of selected technical solutions. The included code excerpts document novel approaches to virtual reality implementation and acoustic physical modeling of musical instruments.