Apple Introduces its First ‘Spatial Computer’ AR Headset, Vision Pro
After much anticipation, Apple has finally revealed its entry into the AR/VR market with the introduction of the Apple Vision Pro headset at WWDC23. This cutting-edge device, dubbed a “spatial computer,” stands out from previous headsets due to its range of technological innovations. In this article, we will provide an overview of the Vision Pro headset and delve into the new silicon that powers Apple’s first foray into the spatial computing realm.
The Apple Vision Pro is a mixed-reality headset, offering both VR (virtual reality) and AR (augmented reality) capabilities. While numerous technologies contribute to the headset’s functionality, we will focus on the hardware aspects. The device incorporates a variety of sensors, including front-facing, downward-facing, side-facing cameras, a true-depth (3D) camera, and a LiDAR scanner. To interface with the user’s eyes, the headset features IR cameras and LED illuminators internally.
Unlike its competitors, such as Microsoft’s Holo Lens or the Meta Quest, Apple has opted to separate the Vision Pro’s battery from the headset itself. The battery can be placed in the user’s pocket and connected to the headset via a USB cable. This design choice reduces weight and prevents overheating, addressing common concerns with AR/VR headsets.
One of the significant challenges in AR/VR experiences has been the occurrence of nausea due to the lag between processed and visual data. Apple claims to have tackled this issue with its proprietary R1 chip, specially designed for sensor processing and fusion. The R1 chip simultaneously processes input from multiple cameras, sensors, and microphones, resulting in minimal latency and a seamless user experience. Additionally, the chip ensures that new images are streamed to the user’s eyes in under 12 milliseconds, eight times faster than the human blink.
Working in conjunction with the R1 chip, Apple’s M2 SoC (System-on-Chip) handles non-sensor computing tasks, providing significant AI compute power and impressive memory bandwidth.
While the impact of Apple’s Vision Pro headset on the AR/VR market remains to be seen, it is undeniable that Apple’s resources, technological prowess, and dedication make it a strong contender. The Vision Pro represents Apple’s foray into spatial computing, bringing the company’s signature innovation to the forefront of this evolving industry.