One of the most anticipated applications of virtual reality is the possibility of participating with our friends in virtual games in which we can see each other’s faces, and it is just that gap that Hao Li intends to fill with his facial expression capture system.
And of course, if we have a virtual reality viewer glued to the face, it is difficult to capture our expressions, but Hao Li solves the problem using a camera based on Intel RealSense technology to capture our mouth and some sensors located inside the viewer (an Oculus Rift in the demo that you have just seen) for the upper area of the face. And to top off the task, they also read the positioning information of the camera to correct the movement of the head. Thanks to this technology, our virtual avatar could copy our real-life expressions, which can be a real bombshell to integrate in the multiplayer experiences that we can see their faces, or video conferencing applications based on virtual reality.
Of course, we must be careful if we are close to the computer so as not to give it (literally) a blow with this ingenious accessory.