1992Unpublished venueOpen access

Sound rendering

Tapio Takala, James K. Hahn

Open full text 131 citations

Abstract

We present a general methodology to produce synchronized soundtracks for animations.A sound world is modeled by associating a characteristic sound for each object in a scene.These sounds can be generated from a behavioral or physically-based simulation.Collision sounds can be computed from vibrational response of elastic bodies to the collision impulse.Alternatively, stereotypic recorded sound effects can be associated with each interaction of objects.Sounds may also be generated procedurally, The sound world is described with a sound event file, and is rendered in two passes.First the propagation paths from 3D objects to each microphone are analyzed and used to calculate sound transformations according to the acoustic environment.These effects are convolutions, encoded into two essential parameters, delay and attenuation of each sound.Timeciependency of these two parameters is represented with key frames, thus being completely independent of the original 3D animation script.In the second pass the sounds associated with objects are instantiated, modulated by interpolated key parameters, and summed up to the final soundtrack.The advantage of a modular architecture is that the same methods can be used for all types of animations, keyframed, physically-based and behavioral.We also discuss the differences of sound and light, and the remarkable similarities in their rendering processes.

Open-access reader

About this research paper

What this paper is about

We present a general methodology to produce synchronized soundtracks for animations.A sound world is modeled by associating a characteristic sound for each object in a scene.These sounds can be generated from a behavioral or physically-based simulation.Collision sounds can be computed from vibrational response of elastic bodies to the collision impulse.Alternatively, stereotypic recorded sound effects can be associated with each interaction of objects.Sounds may also be generated procedurally, The sound world is described with a sound event file, and is rendered in two passes.First the propagation paths from 3D objects to each microphone are analyzed and used to calculate sound transformations according to the acoustic environment.These effects are convolutions, encoded into two essential parameters, delay and attenuation of each sound.Timeciependency of these two parameters is represented with key frames, thus being completely independent of the original 3D animation script.In the second pass the sounds associated with objects are instantiated, modulated by interpolated key parameters, and summed up to the final soundtrack.The advantage of a modular architecture is that the same methods can be used for all types of animations, keyframed, physically-based and behavioral.We also discuss the differences of sound and light, and the remarkable similarities in their rendering processes.

Why it matters

OpenAlex reports 131 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

We present a general methodology to produce synchronized soundtracks for animations.A sound world is modeled by associating a characteristic sound for each object in a scene.These sounds can be generated from a behavioral or physically-based simulation.Collision sounds can be computed from vibrational response of elastic bodies to the collision impulse.Alternatively, stereotypic recorded sound effects can be associated with each interaction of objects.Sounds may also be generated procedurally, The sound world is described with a sound event file, and is rendered in two passes.First the propagation paths from 3D objects to each microphone are analyzed and used to calculate sound transformations according to the acoustic environment.These effects are convolutions, encoded into two essential parameters, delay and attenuation of each sound.Timeciependency of these two parameters is represented with key frames, thus being completely independent of the original 3D animation script.In the second pass the sounds associated with objects are instantiated, modulated by interpolated key parameters, and summed up to the final soundtrack.The advantage of a modular architecture is that the same methods can be used for all types of animations, keyframed, physically-based and behavioral.We also discuss the differences of sound and light, and the remarkable similarities in their rendering processes.

Key concepts: Rendering (computer graphics), Citation, Computer science, George (robot), Sound (geography), Library science, Multimedia, Computer graphics (images)

Related papers

Back to paper searchBrowse research topicsOriginal source
Sound rendering — Research Paper | ScholarLens