Have you ever watched someone with a VR headset on? They might be having the time of their lives, but watching them can be a tad bit awkward, to say the least. They just look odd with a high-tech blindfold on.
That’s not good for demonstrating the emerging technology, especially while it still has a lot to prove before it enters the mainstream. And that’s why Google’s Research arm and Daydream Labs have partnered to figure out a way to let spectators see VR headset users’ full faces while they’re immersed in an experience – as if the headsets were practically invisible.
End goal? To allow for less awkward demonstrations of VR technology and experiences on video.
In a blog post, Google noted that this solution will go beyond improving VR and mixed reality experiences: Headset removal is poised to enhance communication and social interaction in VR itself with diverse applications like VR video conference meetings, multiplayer VR gaming, and exploration with friends and family. Going from an utterly blank headset to being able to see, with photographic realism, the faces of fellow VR users promises to be a significant transition in the VR world, and we are excited to be a part of it.
Google’s trick, as you can imagine, is not that straightforward. The team first constructs a 3D model of the user’s face, using a color and depth camera in a process that takes about a minute to complete. Next, they’re handed a modified HTC Vive headset that’s capable of tracking eye-gaze. For a fully immersive video demo, the user is shot in front of a green screen while they’re engaged in a VR experience, with their VR environment composited into the background.
Additionally, the specialized camera setup for filming this is calibrated and time-synced with the headset, which makes it possible to replace the headset with the 3D face model and line it up with the visible portion of the user’s face.
Slapping on a digital top half of a person’s head onto a real image can look unnatural (the phenomenon is known as the ‘uncanny valley’); as such, the team decided to depict a ‘scuba mask effect’ that shows the 3D face model composited with a translucent headset. This reduces the chance of viewers getting distracted by imperfections and artifacts in the 3D model.
Confused? Let’s just say this is better than the blindfold look!
As a technology lover you may like our daily important technology news series. It’s a playlist and you can retrieve the total day-wise videos. Please consider subscribing our YouTube channel:
Author: Technology Vista

