Apple blends reality and digital content with the Vision Pro spatial computer

It's been a while since Apple announced something that's truly risky and groundbreaking… but I think we might have to wait a little longer.

Two reasons, and they're at odds with each other.

Don't get me wrong: The Vision Pro is cool as heck, but while it may seem like a daring push into the realm of physical-meets-digital (I refuse to acknowledge the word phygital), it is not far removed from what is already out there on Oculus headsets; Mixed Reality Office, for example.

And while Apple's track record is decent, it's still a pretty ambitious vision if you're counting on it to live up to its lofty promises 100 per cent.

And it's for this simple reason that despite the many announcements at WWDC, the Apple Vision Pro is likely the one topic that will open many conversations today.

Goggles with Apple's design touches

The Vision Pro looks pretty much like a pair of ski goggles that happens to hold a spatial computer that merges digital content with the physical world.

The three-dimensionally formed and laminated glass with a custom aluminium alloy frame has a modular design so you can tailor the fit for a wide range of faces. The soft textile Light Seal conforms to the face for a precise fit, while the three-dimensionally knitted Head Band offers comfort, breathability, and flexibility.

And at its heart lies a dual-chip design: The highly-acclaimed M2 forms the backbone, while the brand-new R1 chip processes inputs from 12 cameras, five sensors and six microphones and is able to stream new images to the displays within 12 milliseconds.

The Vision Pro may be rocking impressive hardware, but we all know the million-dollar question is whether Apple can create software that's better integrated than the competition.

To this end, they designed a new spatial operation system called visionOS to create a 3D user interface that can be controlled by our eyes, hands, and voice. It frees apps from their traditional trappings by allowing them to appear side by side at any scale thanks to a virtually infinite, screen real estate.

The Vision Pro also supports the Magic Keyboard and Magic Trackpad, which turns the spatial computer into a portable — and private — 4K display.

The visuals are achieved via two high-resolution micro-OLED displays that create a screen that "feels 100 feet wide". That's because there are 23 million pixels between the two displays, working out to more than 4K resolution for each screen. For those who need vision correction, optional ZEISS Optical inserts will be sold separately.

The inclusion of Spatial Audio helps sell an immersive experience for cinematic content as well as video games. Entertainment aside, the Vision Pro can also be used to shape your environment through a feature called, err, Environments.

Choose between dynamic landscapes to help you focus or reduce clutter in busy spaces and you can dial in the level of immersion using the Digital Crown a la Apple Watch.

Built-in 3D camera

The Vision Pro also features Apple's first three-dimensional camera, which lets you capture photos and videos that present themselves as life-size. Apple says the panoramic shots will virtually wrap around you and create the feeling that you are physically there.

However, unlike your phone, you can't use the camera on yourself for video calls. While you can see the other parties in life-sized tiles, you are instead, portrayed as a digital persona or avatar that will articulate your hand and facial movements in real time.

To convey a sense of realism, Spatial Audio will place participants such that it feels like an actual virtual room.

The Vision Pro is primarily home- or office-bound, though it can be hooked up to an external battery that provides up to two hours of use.

But lest you feel that wearers are practically living within the virtual world, the Vision Pro has a unique feature called Eyesight that allows others to see your eyes when they approach you, so that you don't lose the human touch entirely.

Final thoughts

For the USD3,499 (S$4,715) asking price, the Vision Pro is certainly not for the faint-hearted, even if the device lives up to its promises when it releases next year in 2024.

But the world will certainly be holding its collective breath to see if this might be the disruptive kick in the nether regions to spark more interest in spatial computing and inspire a range of affordable alternatives for less technically-inclined users.

Do we honestly want to wear a computer the moment we get into the office? It doesn't sound appetising, but then again, it makes sense somewhat if the headset practically makes multiple monitors obsolete; you're basically converting physical interfaces into virtual devices.

But what I'm really looking forward to is the day I see someone on the streets wearing this and a Dyson Zone and no one bats an eyelid. Then, we're truly ready for the future.

ALSO READ: Apple's Vision Pro an impressive headset with few likely buyers, analysts say

This article was first published in Potions.sg.