Apple Vision Pro - Eye Tracking

First Impressions and Key Features of Apple Vision Pro

On Monday, 5 June 2023, Apple unwrapped its latest showstopper, the Apple Vision Pro. The much-awaited AR/VR headset is set to go public only in early 2024, but a select group of lucky ducks from the media and YouTube community have already had a sneak peek at this potential game-changer. Here’s the lowdown on their first impressions of Apple Vision Pro.

Initial Set-Up: Customizable Comfort

When it came to getting Vision Pro up and running, everyone seemed to agree it was easy and straightforward. The Light Seal, a comfy fabric lining that sits between your eyes and the headset, can be tailor-fitted to individuals. Much like setting up Face ID, the testers went through a quick face scan on an iPhone in order to receive the right size Light Seal. Although this customized approach is great, it means your Vision Pro may not be easily shareable between different people in a household. But hey, maybe that’s a good excuse to get one for each family member, right?

Those who wore prescription glasses had specially designed, snap-in lens inserts after their eye prescription was taken. Other comfort-enhancing features include the Fit Dial, which allows for precision adjustments of the Head Strap, and an optional top strap to help ease pressure.

The headset itself is a lightweight champ at around 450g. It feels pretty good on your head, but don’t expect to Netflix and chill all day without feeling it.

Intuitive Eye Tracking and Gesture Control

The eye tracking and gesture control wowed everyone. Before they could use the headset, they had to look around at various dots on the display. What this process does is allow the software to learn and calibrate according to the movements of the eyes. Once the system has had a once-over with your eyes, you just have to look at something on the display to highlight it.

The intuitive UI experience extends to the fingers. Pinching with the fingers simulates a mouse click to select items, while pushing or pulling motions mimic the scrolling function. The testers noted that the headset’s array of sensors was able to keep track of the gestures flawlessly, whether their hands were resting on their legs or were moving about.

Merging Real and Virtual Worlds: Low-Latency Video Passthrough

Vision Pro’s advanced display and cameras gave the testers a crystal clear view of the real world, setting it apart from the grainy visuals of other headsets. They found that they could effortlessly read their watch, converse with others, and stroll around the room without removing the headset. Even jotting down notes on their phones was possible.

They used the Digital Crown to toggle between VR and AR experiences. With a simple spin, the level of immersion could be adjusted. The mid-way setting offers you a workspace-like experience – you can engage in live chat with colleagues and access a virtual desktop with apps at the same time. While switching from VR to AR led to a few wobbly knees and instances of detail loss, overall, the testers found the video passthrough impressive.

Apple Vision Pro - Cinema Experience

Like Being in the Movie: Next-Level 3D and Cinema Experience

A 3D version of Avatar: Way of Water was sampled. Many people felt that the characters literally popped right out from the micro-OLED displays.

There is a Cinema Environment feature that is designed to make the whole thing feel even more like a big-screen experience. Apple also gave a glimpse of the upcoming Immersive Video format that’s set to launch on their Apple TV Plus service. This isn’t your typical video format – we’re talking a wide-spanning 180-degree view that packs some seriously high-quality resolution and video clarity. Two sports events were shown at the demo and all marveled at the incredible definition and close-up perspective they witnessed.

But Vision Pro doesn’t stop at just watching stuff. Though the feature was not available to the testers, 3D photos and videos can be captured, say at a birthday party, though you would have to wear the headset to record those moments.

Gaming is also set to be a treat, particularly with its compatibility with Apple Arcade. Coupled with the headset’s game controller support, it seems we’re in for a variety of immersive experiences.

Groundbreaking Apps: A New World of Mixed Reality

Experimenting with third-party applications, the testers recognized an expansive opportunity for developers to exploit the power of Apple’s M2 and R1 chips. These chips, capable of fast real-time data processing, could unlock groundbreaking AR experiences. Among the apps played was ‘Mindfulness’, an application designed to foster relaxation through voice-guided meditation paired with stunning visuals. Also catching the testers’ attention was ‘Encounter Dinosaurs’, a playful app that engages users in interactions with responsive virtual creatures.

Hyper-Realistic Avatars on FaceTime

FaceTime gets a revamp with Vision Pro. The testers were able to have a FaceTime chat with Apple employees and see their 3D holograms. These are hyper-realistic avatars that can be created by scanning one’s face using the headset’s “advanced encoder-decoder neural network” that is trained on a diverse dataset of thousands of individuals. The result is a digital persona that can mimic the user’s facial and hand movements during a FaceTime call. While the effectiveness of this feature is still to be evaluated in uncontrolled settings, it offers a unique solution for using FaceTime without needing a camera directed at one’s face.

Wrapping it Up: The Takeaway

Most of the testers certainly found Vision Pro to be unrivaled in terms of its user-friendly features and immersive capabilities. They particularly praised the superior video passthrough experience, pin-sharp graphics and the seamless navigation of the interface. Sure, it comes with a hefty price tag of US$3,500 (though rumors hint at a more wallet-friendly version on the horizon) and yes, there might be a learning curve in fitting it into our work or play routines. Still, the consensus remains – Apple’s concept of “spatial computing”, which blends the digital seamlessly into our real-world surroundings, genuinely feels like it could be the next big evolution in tech.