Jump to content

VR is still a novelty, but Google’s light-field technology could make it serious art


Recommended Posts

VR is still a novelty, but Google’s light-field technology could make it serious art

By Rachel Metz      

March 14, 2018




I recently got a private tour of a NASA space shuttle’s cockpit, a quirky mosaic-covered LA home, and a peaceful chapel with light streaming through ornate stained-glass windows—all without leaving my chair.


That chair was in an office at Google’s Silicon Valley headquarters, and I was wearing an HTC Vive virtual-reality headset on my face. But because these places were filmed with a high-resolution prototype camera that reproduces some of the key cues we use to understand depth in the real world, it felt more like actually being there than anything I’ve experienced with any other live-action VR. Which is to say it was pretty damn cool.


I could peer around the seats in the space shuttle Discovery, revealing buttons and switches on the walls of the cockpit that were previously obscured. As I looked closely at mirrored bits of tile on the outside of the mosaic house, I glimpsed reflections of other tiles in the background and saw a dizzying display of shapes and patterns. In the chapel, I gazed at the floor, and the colorful sunbeams moved as I did.


Starting Wednesday, Google is releasing these images (which are just stills, though they feel like mini worlds to explore) as part of a free app called Welcome to Light Fields that shows the company’s vision for the future of truly immersive, lifelike virtual reality. The app, which will be available through the video-game platform Steam, is meant to work with HTC’s Vive, Oculus’ Rift, and Windows mixed-reality headsets.


As the name suggests, the images in the app were created by recording and re-creating light fields, a term that refers to all the light traveling in all directions in a given volume of space. Google used a number of small, interlinked cameras to capture lots of images as viewed from the perspective of a roughly beach-ball-size sphere. Using those photos—that spherical patchwork—its system can accurately reproduce the rays of light wherever a viewer might look within that fairly small space.


For many headset users, Google’s app will be the first experience of live-action VR that they can actually explore by moving their head around. And though the app includes only stills, not videos, it gives a sense of what may someday be possible: virtual exploration of historic sites and art, and eventually hyperrealistic VR films.


“If we can do a really good job of capturing the real world, then we really give you a teleportation machine that can help you be anywhere, and that’s pretty powerful,” says Paul Debevec, a senior scientist with Google’s Daydream virtual-reality group, who worked on the camera and app.


Like so much about virtual reality, that idea is still mostly a promise. The technology has yet to become popular with consumers, for many reasons—headsets are bulky, expensive, and silly-looking, and the VR experience doesn’t always look or feel all that real.


Debevec and others working on VR see light fields as a potential solution for that last problem. Most cameras don’t capture depth data, so if you’re looking at video in VR—of, say, swiftly swimming technicolor fish—and you move your head up or down, the whole undersea world will move with you. This is the status quo; it’s obnoxious, and it can cause motion sickness.


With Google’s light-field camera, this doesn’t happen. Rather, just like in real life, when I shifted my head, things that were closer to me moved more than those that were farther away. The phenomenon is called motion parallax, and Google may be the first company to capture it in a widely available live-action app.





Link to comment
Share on other sites

  • Views 318
  • Created
  • Last Reply


This topic is now archived and is closed to further replies.

  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Create New...