vision pro: all the details of apple's virtual reality headset

apple Vision Pro: The Future of Augmented and Virtual Reality

Apple has taken a groundbreaking step into the world of augmented and virtual reality with the introduction of its highly anticipated AR/VR headset, Vision Pro. This cutting-edge device seamlessly blends the real world with the digital world, providing users with a new kind of computer that goes beyond traditional displays. With Vision Pro, Apple aims to redefine spatial computing and unlock a whole new dimension of personal technology.

At the Apple Worldwide Developer’s Conference (WWDC 2023) which kicked off today, June 5th, the team unveiled the Vision Pro as a revolution in integrating digital content into our physical space. As Apple CEO Tim Cook says: ‘It’s the first Apple product you look through and not at.‘ Vision Pro is set to allow its users to see, hear, and interact with digital content as if it were part of their physical surroundings. The world becomes a ‘canvas for apps,’ which can be placed anywhere and scaled to any size, without the limitations of the screen — what’s more, you can fully immerse yourself in a selection of ‘Environments’ as the room around you disappears.

images via Apple Worldwide Developer’s Conference 2023

controlled by your eyes, hands, and voice

Apple Vision Pro opens up your space with a fully three-dimensional interface controlled intuitively using your eyes, hands, and voice. The team explains that when you first put on the Vision Pro, you will see your space and everything in it, with the Home View floating in front of you. The interface is designed to have a sense of physicality, with elements that respond dynamically to light, cast shadows, and provide a clear understanding of scale and distance. Interacting with apps and content feels natural and effortless, as if you were moving real objects.

The input model for Vision Pro is incredibly intuitive, requiring no additional hardware or controllers. You browse the system simply by looking, with app icons coming to life when you direct your gaze towards them. Tapping your fingers together allows you to select and scroll, while voice commands are seamlessly integrated through Siri.

eyesight: revealing or concealing your eyes

One of the foundational design goals of Vision Pro is to ensure that users are never isolated from the people around them. A breakthrough innovation called ‘EyeSight’ allows Vision Pro to display your eyes when someone is nearby, giving the illusion of transparency so that people around you are cued into your focus — this changes once you’re fully immersed in an Environment. This seamless integration of the digital and physical worlds creates an environment that is perfect for collaboration and shared experiences.

a tool for collaboration and remote work

From browsing the web with Safari to reliving precious memories through photos and videos, Vision Pro offers a wide range of applications. Web pages are large and videos are stunning, allowing you to enjoy content in a cinematic manner. The device seamlessly integrates with familiar accessories like Magic Trackpad and Magic Keyboard for longer emails or tasks. While on a FaceTime call, friends or colleagues appear in floating video tiles. Other apps can be viewed and shared simultaneously. Vision Pro can also connect wirelessly to a Mac, transforming it into a portable 4K display and changing your environment into an immersive workspace no matter where you are.

Vision Pro features Apple’s first 3D camera, allowing you to capture ‘spatial photos and videos’ that come to life with depth and Spatial Audio. Additionally, a spatial cinema environment turns any space into a personal movie theater, backdropped by a range of Environments, or by a theater-like space.

technical details: the structure

The structure of Vision Pro was designed to provide both performance and comfort. The front of the device features a singular piece of three-dimensionally formed and laminated glass that acts as a lens for EyeSight and various cameras and sensors. The lightweight frame, made from custom aluminum alloy, complements the glass and houses the necessary components while ensuring durability and protection.

The design also incorporates soft textile parts for a comfortable and customizable fit, with a modular system that accommodates a wide range of head shapes and sizes. The headband, made from a 3D-knitted rib structure, provides cushioning, breathability, and stretch, while a secure mechanism allows for easy adjustment and a precise fit. For those who wear glasses, custom optical inserts created in collaboration with Zeiss magnetically attach to the lenses, accommodating vision correction without compromising display performance or eye-tracking accuracy.

the technology

The technology behind Vision Pro is truly groundbreaking. The micro OLED Apple Silicon backplane enables the device to fit an incredible 23 million pixels across two panels, providing an immersive visual experience with true 4K resolution, wide color, and high dynamic range. The custom three-element lens solution magnifies the panels and delivers exceptional sharpness and clarity, ensuring that fine text remains sharp from any angle. Vision Pro’s spatial audio system creates an ambient sound experience that feels like it is coming from the space around you, blending seamlessly with the real world.

The advanced sensor array, including high-resolution cameras, precise eye tracking, and real-time 3D mapping, enables responsive and intuitive input, freeing users from the need for hardware controllers. The system’s computational power is provided by the Apple M2 chip and a specialized chip called R1, which work in parallel to deliver impressive performance, maintain a comfortable temperature, and eliminate lag.

1/6

a new os built from the ground-up

Vision Pro’s operating system, visionOS, builds upon the engineering innovations of Mac OS, iOS, and iPadOS. It introduces new capabilities specifically designed for low-latency spatial computing, such as a real-time execution engine and a dynamically foveated rendering pipeline that maximizes image quality where the user’s eyes are focused. The multi-app 3D engine allows different apps to run simultaneously in the same simulation, opening up new possibilities for multitasking and collaboration. With native support for spatial experiences, visionOS provides a seamless and immersive operating environment for Vision Pro users.