Nvidia launches the 360º audio and video stitching SDK to facilitate the tasks of the developer and provide tools to achieve greater immersion, thanks to the sound with propagation physics.
Nvidia announced yesterday, during the GTC, the launch of the Audio and 360 Video SDKs for VRWorks, in order to facilitate the creation of virtual reality content. The part of audio it helps to create a real immersive feeling, taking into account the dimensions and properties of the materials of the physical environment in which we find ourselves. The modeling of sound propagation takes into account characteristics such as reflection, refraction and diffraction, and all this in real time, thanks to the graphics card. To trace the path that the sound follows, VRWorks audio uses OptiX, Nvidia’s ray-tracing technology, which allows to obtain an accurate sound that reflects the size, shape and material properties of the virtual environment. The software consists of a set of C libraries, already available in Unreal Engine 4.
VRWorks Audio demo.
VRWorks 360 Video, in beta format, allows capturing, stitching and streaming 4K video in 360º. Currently, the stitching is in mono, but at the GTC they are showing a demo of the next version that will have stereo stitching in real time and will be released soon. Although, for this they are using two Quadro P6000 cards, which have a high cost, but are capable of stitching 8 4K cameras in stereo. “The fact that Nvidia is able to sew stereoscopic 4K video in 360º and in real time, makes live shows a possibility, changes the production line and allows new totally new use cases in VR,” he comments Kinson Loo, CEO of Z CAM.
Both SDKs are available at the following link. We can find more information about the Audio SDK and the 360 Video SDK.
