Apple Vision Pro: Best Spatial Computing Headset

on June 5, 2023, Apple announced a new computer with great anticipation Wearing a computer on your face is nothing new, but how you utilize the Vision Pro is. The output of the computer is projected into your eyes through two tiny, high-resolution screens that are positioned extremely close to you, as opposed to being viewed on a physical screen. Eye tracking and gestures are the main methods of user interface control instead of a keyboard, mouse, or touch screen.

Apple eliminated the need for a physical controller to operate the computer, much as they did with displays when they introduced the iPhone. By observing your eye movements, the computer detects what you are interested in interacting with, and then it looks at your hands to figure out what you want to do.

Each of these items has its predecessors, including a variety of wearable viewing devices like Google Glass and Meta’s Quest Pro as well as gesture control technologies like Leap Motion and the Myo Armband. But none of these forerunners managed to bring it all together into a cohesive whole.

Introducing the Spatial Computer

Apple has referred to this new gadget as a spatial computer. The device’s ability to show digital outputs at any nearby physical location makes its name appropriate.

The gadget may be used without a desk or lap, and the apparent viewing area can be as large as you choose. This implies that you could theoretically view a movie the size of a theatre while seated in a small area, such as an airline seat.

Applications of Vision Pro

As of right now, Apple has described use cases that appear ordinary. With the current 2D information shown on a far more flexible and unrestricted display, you may utilize it just like a regular PC or iPad. Demand exists for that. In situations where room is limited, it will be useful.

Additionally, people who presently occupy their area with a variety of enormous screens may find it useful. In that sense, the closest analog is a large-screen TV. Would $3,500 be paid by anybody for that? At this moment, they do. A display that may cost up to $6,000 is even sold by Apple, called the Pro Display XDR. In light of that, it is definitely within the budget range for existing use cases.

The potential of Vision Pro Beyond 2D Content

A more useful and better-looking display for 2D information, however, does not appear to justify the technology and R&D work invested in the Vision Pro. Whether this gadget can lead to augmented and virtual reality applications that would make wearing a computer strapped to your head justified is the real question. It very definitely possesses the technological capacity to do so.

With the Vision Pro, you can see 3D items in the environment you’re in right now or even travel to another location. Nevertheless, Apple seldom brought up AR and VR in their announcement. They drew a line that had never been drawn before in doing so. This is not a VR or AR device or tool. Since the technology is a spatial computer, applications that utilize a spatial computer are where augmented reality and virtual reality may find their place.

A Brief Overview of VR, AR, MR, and Spatial Computing

As for the device, Apple says the Vision Pro “seamlessly blends digital content with physical space,” or what is now called spatial computing.

Simply, it’s a gadget that integrates digital content into the surrounding real world both vocally and graphically. Apple describes spatial computing broadly in order to account for future device adjustments, given that the Vision Pro is merely the first generation of devices.

Virtual Reality (VR) Headsets

Virtual reality (VR) headsets, such as the Sony PlayStation VR2, HTC Vive, and Meta’s Quest, enable users to explore computer-generated virtual environments by placing screens in front of their eyes. A virtual environment might be found in a metaverse virtual world, surround 3D video scene, or computer game. With VR headsets, handheld controllers are usually utilized to communicate with the virtual space. Virtual reality headsets can be used independently or in conjunction with an external computer or game console. They are usually rather big.

Augmented Reality (AR) Glasses

The goal of augmented reality (AR) is to allow users to experience virtual aspects in the real environment. Smart glasses such as the Magic Leap 2, Microsoft’s HoloLens, Lenovo’s ThinkReality A3, or Qualcomm’s Snapdragon AR reference design are common forms of augmented reality solutions. AR glasses integrate a projector or screen to provide pictures in front of the wearer’s eyes while allowing them to still see their surroundings via the glasses. The user may now perceive and comprehend their surroundings as usual, although with digital graphics shown in their field of vision.

Because AR glasses have better screens and technology, they are larger than regular spectacles. Because they require specialized displays and circuitry, augmented reality (AR) glasses can be costly. However, they are widely used in industrial applications, including shared digital experiences and remote maintenance. Batteries and/or processing might be internal, external, or freestanding. To lighten the headgear, the Magic Leap 2 integrates its battery and computation into an external “puck.”

Mixed Reality (MR) Headsets

Headsets that mix virtual reality (VR) and external cameras, such as the Varjo AR series and the Apple Vision Pro, enable users to see the outside world on internal screens. Through MR, the real and virtual worlds are effectively combined into a single viewing experience. This is a major difficulty since digital displays and cameras are not as capable of processing visual information as the human eye and brain are. Thus, MR headset mobility is limited to sitting or constrained spaces while moving about without real-time depth and peripheral awareness.

MR headsets/glasses are more costly than VR headsets because of the additional requirements for image processing and increased sensor technologies. Similar to VR headgear, they are also frequently heavy, making use limited to a few hours at most. A completely generated exterior world is not often supported by VR headsets with limited camera passthrough capabilities, such as the Quest 2. MR headsets come in two varieties: those that are standalone (Apple Vision Pro) and those that are connected to an external computer (Varjo AR).

Personalized Experience with Apple Vision Pro

The Apple Vision Pro improves the pass-through aspect to provide even more customization. The numerous demonstrations at the event made it clear that each Vision Pro headset must be customized for a single user. This involves selecting the headband, facial “light seal,” and Zeiss prescription glass inserts. The Vision Pro has an iris log-in feature that allows you to unlock it. Furthermore, the user uses a facial scan to build a personalized “persona,” as Apple refers to its avatar.

Because of this, every Vision Pro will be associated with a single person. A “guest” login option has reportedly been added. However, it’s unclear if this means that many users may also log in, which would restrict the usage of Vision Pro as a commercial product to applications requiring multiple users.

The customization procedure makes it difficult for many users to utilize in an enterprise context, unlike other AR glasses and MR headsets, for tasks like evaluating a product design in a shared virtual design or a car in a dealership.

VisionOS Operating System

The latest version of VisionOS is executed by the Vision Pro. With both restricted and unbounded volumes, VisionOS allows for flexible user space definition. Developers and consumers may find it easier to transition from 2D windowing interfaces to volumetric immersion.