Posted by Eric Mauskopf, Product Manager

- hero 2Bbanner 2Bwith 2Blogo 2Bfor 2Bblog - Resonance Audio: Multi-platform spatial audio at scale

As humans, we rely on sound to guide us through our environment, help us communicate with others and connect us with what’s happening around us. Whether walking along a busy city street or attending a packed music concert, we’re able to hear hundreds of sounds coming from different directions. So when it comes to AR, VR, games and even 360 video, you need rich sound to create an engaging immersive experience that makes you feel like you’re really there. Today, we’re releasing a new audio software development kit (SDK) called Resonance Audio. It’s based on technology from Google’s VR Audio SDK, and it works at scale across and desktop platforms.

Experience spatial audio in our Audio Factory VR for Daydreamand SteamVR

Performance that scales on mobile and desktop

rich, dynamic audio environments into your VR, AR, gaming, or video experiences without affecting performance can be challenging. There are often few CPU resources allocated for audio, especially on mobile, which can limit the number of simultaneous high-fidelity 3D sound sources for complex environments. The SDK uses highly optimized digital signal processing algorithms based on higher order Ambisonics to spatialize hundreds of simultaneous 3D sound sources, without compromising audio quality, even on mobile. We’re also introducing a new feature in Unity for precomputing highly realistic reverb effects that accurately match the acoustic properties of the environment, reducing CPU usage significantly during playback.

- geometric reverb baking unity 2Bfor 2Bblog - Resonance Audio: Multi-platform spatial audio at scaleUsing geometry-based reverb by assigning acoustic materials to a cathedral in Unity

Multi-platform support for developers and sound designers

We know how important it is that audio solutions integrate seamlessly with your preferred audio middleware and sound design tools. With Audio, we’ve released cross-platform SDKs for the most popular game engines, audio engines, and digital audio workstations (DAW) to streamline workflows, so you can focus on creating more immersive audio. The SDKs run on , iOS, Windows, MacOS and Linux platforms and provide integrations for Unity, Unreal Engine, FMOD, Wwise and DAWs. We also provide native APIs for C/C++, Java, Objective-C and the . This multi-platform support enables developers to implement sound designs once, and easily deploy their project with consistent sounding results across the top mobile and desktop platforms. Sound designers can save time by using our new DAW plugin for accurately monitoring spatial audio that’s destined for YouTube videos or apps developed with Resonance Audio SDKs. developers get the open source Resonance Audio SDK that works in the top browsers by using the Web Audio API.

- DAW 2Bplugin 2Bimage 2Bfor 2Bblog - Resonance Audio: Multi-platform spatial audio at scale

DAW plugin for sound designers to monitor audio destined for YouTube 360 videos or apps developed with the SDK

Model complex Sound Environments Cutting edge features

By providing powerful tools for accurately modeling complex sound environments, Resonance Audio goes beyond basic 3D spatialization. The SDK enables developers to control the direction acoustic waves propagate from sound sources. For example, when standing behind a guitar player, it can sound quieter than when standing in front. And when facing the direction of the guitar, it can sound louder than when your back is turned.

- acoustic 2Bguitar 2Bdirectivity 2Bfor 2Bblog - Resonance Audio: Multi-platform spatial audio at scale

Controlling sound wave directivity for an acoustic guitar using the SDK

Another SDK feature is automatically rendering near-field effects when sound sources get close to a listener’s head, providing an accurate perception of distance, even when sources are close to the ear. The SDK also enables sound source spread, by specifying the width of the source, allowing sound to be from a tiny point in space up to a wall of sound. We’ve also released an Ambisonic recording tool to spatially capture your sound design directly within Unity, save it to a file, and use it anywhere Ambisonic soundfield playback is supported, from game engines to YouTube videos.

If you’re interested in creating rich, immersive soundscapes using cutting-edge spatial audio technology, check out the Resonance Audio documentation on our developer site, let us know what you think through GitHub, and show us what you build with #ResonanceAudio on social media; we’ll be resharing our favorites.

.blogimg1 img { width: 0%; border: 0; margin: 0; padding: 20px 0 10px 0; } .blogimg2 img { width: 0%; border: 0; margin: 0; padding: 20px 0 10px 0; } .blogimg3 img { width: 0%; border: 0; margin: 0; padding: 20px 0 10px 0; } - sP5MItMfbzE - Resonance Audio: Multi-platform spatial audio at scale

Source link


Please enter your comment!
Please enter your name here