WWDC 2023 Recap: Unpacking the Announcements around Apple Vision Pro

Introduction

The Highlight: Apple Vision Pro

In June 2023, the tech world experienced a groundbreaking event during Apple’s annual Worldwide Developers Conference (WWDC) with the unveiling of Apple Vision Pro. Apple’s CEO, Tim Cook, declared it as “an entirely new AR platform.” Described as a “revolutionary spatial computer,” this remarkable device holds the power to change how we experience and engage with the world around us.

This release is significant as it marks Apple’s first major product introduction since the Apple Watch in 2015, and it is poised to change the landscape of augmented reality (AR).

Understanding Augmented Reality

What is Augmented Reality (AR)?

Augmented Reality, or AR, amalgamates the digital world with our physical surroundings. It superimposes computer-generated images onto our view of the real world, creating a composite view that augments our reality.

The Evolution of AR Technology

AR has evolved from a conceptual technology to a robust platform for immersive experiences. Innovations have turned science fiction into reality, culminating in devices like the Apple Vision Pro.

The Journey of Apple in AR

Apple’s First Foray into AR: The Acquisition of Metaio

The genesis of Apple’s AR journey can be traced back to 2015 with the acquisition of the German AR company, Metaio. This strategic move signaled Apple’s commitment to pioneering in the realm of AR.

Notable Milestones: From ARKit to Vision Pro

Since the Metaio acquisition, Apple has made significant strides in AR, most notably with the introduction of ARKit in 2017. The launch of Vision Pro in 2023 represents the apex of Apple’s AR journey thus far.

The Design: A Work of Art and Engineering

The Look and Feel of Apple Vision Pro

Apple Vision Pro is a fusion of aesthetic elegance and functional efficiency. Envision, if you will, the most sci-fi-looking pair of ski goggles, for that is what the design is reminiscent of. Fronted by a laminated glass display that transitions smoothly into an aluminum alloy frame, the headset curves softly to the contours of your face. The Light Seal, a flexible, magnetic cushion, and a customizable headband for the back of the head, together form a modular system that creates a range of fit to accommodate different people.

The Specs: Under the Hood

Sensor Configuration, Micro-OLED Displays and Eye Tracking

Beneath its sleek exterior, it packs a hardware punch, housing five sensors, six microphones, and 12 cameras. The user views the content through two micro-OLED displays which combine to deliver an impressive 23 megapixels of visual clarity. To facilitate precise eye tracking, the device incorporates a system of LEDs and infrared cameras, forming the foundation of the iris scanner, known as Optic ID. This feature serves as an authentication method, similar to the Face ID found in iPhones.

Advanced Spatial Audio System

The device’s speaker is placed within the headband, positioned directly over the user’s ears for optimal audio clarity. It also offers virtualized surround sound, further enhancing the immersive experience.

Cutting-Edge Technology: Dual-Chip Design and Power Options

Powering this technological marvel is the Apple M2 system. It is accompanied by the Apple R1 co-processor, responsible for real-time processing of sensor inputs. As for power sources, the Vision Pro can be charged using an external power supply, a USB-C port on a Mac, or a battery pack, providing approximately two hours of usage on a single charge.

Seamless Connections with EyeSight

The Vision Pro comes with a special feature called EyeSight, which is an outward-facing display. It is a cool way to show others how much you’re “in the zone” with your headset. When you’re using it for augmented reality, your eyes on the display appear dimmed. If you’re in full immersion, your eyes are hidden. If someone comes up to you or starts talking, EyeSight switches back to showing your eyes as normal, no matter how immersed you are. This means you can see the other person, which makes it a neat balance between virtual and real-world interaction.

ZEISS Optical Lenses

Users who wear prescription glasses are catered to with the support of custom optical inserts, developed in collaboration with Carl Zeiss AG. These inserts securely affix onto the main lens through magnetic attachment.

Embracing the Future with VisionOS

VisionOS: A Derivative of iOS

One of the key features of Vision Pro is VisionOS, the operating system powering the headset. Think of it as iOS’s futuristic cousin, specially designed for extended reality software and controlled via motion gestures, eye tracking, and voice input.

Interaction with VisionOS: A Different Approach

There’s a certain nostalgia many of us have for our first iPhone experience and the initial encounter with iOS. VisionOS is set to catapult that sense of wonder into an entirely different realm, where icons defy gravity, hovering before your gaze, and simple eye contact becomes the magic touch to select them.

The VisionOS Experience

A New World of Apps and Environments

VisionOS introduces a novel way of interacting with apps, allowing you to manipulate them as if they were physical objects in your environment. Your favorite apps can be launched in a virtual window that you can move and resize at will. It sounds like something out of a sci-fi movie but that’s the reality VisionOS seeks to create.

Apple’s innovation doesn’t end with the interface; it extends to the apps and environments too. With VisionOS, users can enjoy AR-specific versions of their favorite Apple apps, like FaceTime, Safari, Photos, Music, TV, and Keynote, as well as compatible iPhone and iPad apps. Users can even manipulate 3D objects within these apps, which adds another layer of interactivity.

Third-party apps are also supported. In fact, Disney CEO Bob Iger graced the WWDC keynote with a surprise appearance to deliver exciting news: the Disney+ app will be available on Vision Pro. Users can expect immersive 3D interactive experiences from Star Wars, National Geographic, and more.

Of course, an immersive experience isn’t truly complete without a transformative environment. With VisionOS, users can overlay virtual backdrops – dubbed as “environments” – that seamlessly replace their immediate surroundings with evocative landscapes, be it the lush green of a forest or the stark, celestial beauty of lunar terrains.

In Sync with the Apple Ecosystem

VisionOS Compatibility: Interplay with Other Apple Devices

The operating system will work in harmony with other Apple hardware. You can replicate the screen of your MacBook within the headset using a feature called Mac Virtual Display, making it easy to switch between devices for work or play. For an enhanced AR experience, users can also utilize Bluetooth accessories like the Apple Magic Keyboard or gaming controllers.

Security Takes Center Stage

Introduction of Optic ID: A New Level of Security

Amid all the excitement, Apple emphasizes its dedication to maintaining user privacy. Its new technology, Optic ID, scans your iris every time you put on the headset. This feature guarantees the security of your data by storing it directly on the headset, away from the prying cloud. Access to your personal information is strictly restricted, ensuring that only you have control over it.

Conclusion

Looking Forward: The Future of Apple Vision Pro

So here we are, at the threshold of a new era. With Apple Vision Pro and VisionOS, Apple has challenged our notions of what’s possible and given us a glimpse into the future. But as with all things futuristic, it leaves us with more questions than answers. How will Apple Vision Pro alter our relationship with technology? Where will the boundaries of human-computer interaction be drawn? While it’s too early to say, one thing is certain: with Apple Vision Pro, the future of AR is a lot closer than we think and we can’t wait to see what it has in store.