According to Avegant CTO Edward Tang, this represents a critical technological leap from current AR or MR (mixed reality) headsets, including the $3,000 HoloLens.
"Mixed reality displays in the market today are fixed single focal plane displays which limit the area where images can be displayed and is particularly challenging in the near field distance, where most interactions occur in MR," Tang said in an email.
Jeremy Bailenson, founding director of the Stanford University Virtual Human Interaction Lab, was deeply impressed by his test of the Avegant Light Field prototype.
"It's not often you witness a technology that could disrupt an entire industry," Bailenson was quoted as saying in an Avegant press release. "Avegant Light Field is that kind of a breakthrough. I had long heard about the possibility of seeing close fields and far fields in the same scene, but experiencing it firsthand was believing. This is how the visual system was designed to work."
As Avegant works to turn its prototype headset into a viable commercial device over the next 12 to 18 months, there are still a lot of questions about how its patented light field technology actually works.
RELATED: Affordable VR Will Take Immersive Therapy Mainstream
Gordon Wetzstein, director of the Stanford Computational Imaging Group, explained that there are several leading methods for producing the kind of light field effects advertised by Avegant, each with its own set of tradeoffs. In a recent paper, Wetzstein's group demonstrated the benefits of one such method, using a "focus-tunable" liquid crystal display that constantly refocuses on where the user is looking.
"It's a very practical approach that can be implemented right now, and we're working with a couple of consumer electronics companies to do that," Wetzstein told Seeker. "The tradeoff there is that you need eye tracking, and you need a few other technological components. All of them are already there, but you'd have to put them together in one headset."
According to a patent application by Avegant, this appears to be exactly what the company is doing, using some sort of eye tracking to follow the user's gaze and automatically adjust the focus with a tunable display. But when tech writer Karl Guttag asked Avegant about the patent, the company said it was not using that method and that the prototype had "no moving parts" or any kind of eye tracking.
How exactly the Avegant device works may be less important than whether or not anyone will buy it when it's available. The company's first device, a head-mounted cinema/headphone display called the Glyph, was launched from a Kickstarter campaign and has posted modest sales. In a video for the new light field display, Tang made the case that his company's tech is critical for the future of the AR space.
"The success of the entire mixed reality industry hinges upon having light field technologies," said Tang. "Light field is the missing link to having truly realistic and interactive mixed reality experiences."
RELATED: Closing the Gender Gap in Virtual Reality
Guttag expressed doubts that the augmented reality or mixed reality market would take off in the next five years, "with or without Avegant's technology." And Wetzstein at Stanford said that the focal issues addressed by Avegant are only one of a set of engineering and design challenges that need to be solved before AR displays have a chance of passing the visual Turing test.
A big challenge, explained Wetzstein, is the issue of "occlusion." Since AR overlays digital characters on real-world environments, the characters must interact with real objects in visually realistic ways. Wetzstein imagines a version of Super Mario Bros. that you can play on your desk.
"If Mario runs behind a physical object, you have to make sure that the physical object occludes [blocks the view of] Super Mario. Otherwise it doesn't create this consistency in the world," said Wetzstein, adding that the same is true for focal cues. "Your eyes will continually focus on either the digital content or the physical object. If those aren't consistent with one another, it doesn't provide a realistic experience."
And then there's the issue of form factor. The Avegant prototype had to be wired to a PC, greatly restricting freedom of movement. The final commercial device may be untethered, like the HoloLens, but all current VR and AR headsets still suffer from the same bulky and decidedly geeky form factor, which remains another barrier to consumer adoption.
Apple CEO Tim Cook has hinted that the design gurus behind the iPhone and iPad may be coming out with an AR device in the near future. And Magic Leap is still working on its own light field device which may very well prove a game-changer.
Until then, people hankering for an AR fix may have to settle for Pokémon Go.
WATCH: The Augmented Reality Revolution