NVIDIA’s new Turing architecture graphics cards are a breakthrough, but what unique advantages do they bring to virtual reality?
In the nVidia blog they comment on a good number of details of the new benefits offered by the new architecture presented.
Artificial Intelligence for more realistic VR environments
The Deep Learning (deep learning), a GPU-accelerated Artificial Intelligence (AI) method, allows you to study and transform an image to give it more quality and increase performance in Virtual Reality (RV). In the conference given by NVIDIA it is said that you can, for example, take a 2K image and quickly convert it into a quality 4K image. It also allows the improved tracking of the user’s position and eyes (eye tracking)even the realistic character animations.
The Variable Rate Shading (VRS) “variable proportion shading” draws with more quality some areas than others, working more areas of greater detail and giving a lower quality in areas with less noticeable detail. This can be used for foveated rendering, reducing quality where the user does not focus the view, especially useful when combined with eye tracking.
Multi-View Rendering, designed for very wide fields of view.
The Multi-View Rendering (multi-view rendering) is for state-of-the-art virtual reality headsets, which offer ultra-wide field of view (FOV) and have slanted screens; doubles the number of projection views from two to four for a single render pass. The four views are now position independent and able to move along any axis. Ideal to distribute them in a large field of vision without appreciating the separations.
The Real-Time Ray Tracing (real-time light ray tracing). These optical calculations reproduce the behavior of light to create surprisingly realistic images and allow VR developers to better simulate real-world environments. Transparencies, reflections, lights, shadows and global lighting.
Ray Tracing for a realistic sound, depending on the dynamic characteristics of the materials.
Turing’s RT (Ray Tracing) cores they can also simulate sound using the NVIDIA VRWorks audio SDK. The current VR experience provides accurate audio quality in terms of location. But they are unable to meet computational demands to adequately reflect the size, shape, and properties of an environment’s materials, especially dynamic ones.
VRWorks Audio accelerates 6x with the RTX platform compared to previous generations. Its ray-traced audio technology creates a physically realistic acoustic image of the virtual environment in real time.
We will have to be vigilant about the success of these improvements.