The New Features Coming to Apple Vision Pro OS 2
When Apple launched the Vison Pro, it didn’t just introduce the world to a new era of spatial computing and mixed reality experiences. It also launched an exciting new spatial operating system: VisionOS. Now the solution is getting a significant update with “Apple Vision Pro OS 2”.
VisionOS 2, as it is officially named by Apple, was confirmed to be arriving later this fall at Apple’s WWDC 2024 keynote. Though many considered the upgraded operating system’s arrival more of a footnote than a major announcement, it introduces some exciting capabilities to Apple’s spatial computing headset.
While budget-conscious consumers are waiting with bated breath to discover whether Apple will ever release a cheaper version of its premium headset, upgrades to the existing Vision Pro’s internal software should make it a more appealing purchase for concerned consumers.
Here’s everything you need to know about the next generation Vision Pro OS, and what it can do.
What is Apple Vision Pro OS 2?
If you’ve read my review of the Apple Vision Pro, you’ll probably already be familiar with “VisionOS”, the proprietary operating system responsible for powering the device’s mixed reality features. The Apple Vision Pro OS 2, or VisionOS 2, is the next generation of this solution.
Though it’s described as the second generation of VisionOS, details about what this new operating system will do are still scarce. Apple showed off a few capabilities rolling out this year at the WWDC 2024 event, focusing on new ways for users to create spatial photos and videos, as well as intuitive hand gestures for accessing content and apps.
The company also said that VisionOS 2 would empower developers to take advantage of more spatial computing capabilities, with upgraded tools and components. This will be an important step forward for Apple. It’s already struggling to compete with Meta’s Horizon OS in terms of app compatibility, despite introducing more than 2,000 app options for the Vision Pro.
Why Did Apple Introduce Apple Vision Pro OS 2?
Introducing a new version of an operating system or device software is nothing new for XR vendors. After all, once a headset is “officially” introduced to the market, it’s difficult to make any changes to the hardware to enhance user experiences, but rolling out software updates is much easier.
Although the Apple Vision Pro headset has earned plenty of great reviews for its amazing visual fidelity and unique mixed reality capabilities, the tech giant is still struggling to increase sales.
Even after Apple has extended its reach, moving beyond exclusive sales in the US to connect with consumers in the UK, the hefty price of the Vision Pro has deterred many consumers.
Most of us just don’t have an extra $3,500+ to spend on a new device – no matter how amazing it might seem. I doubt that the introduction of a more advanced operating system, or more software features will turn Apple’s sales around entirely.
However, the upgraded solution should help to tackle a few of the problems that have made the Vision Pro less appealing to some consumers (like the uncanny Persona feature).
What’s New for Apple Vision Pro OS 2?
As I mentioned in my previous review of the Apple Vision Pro, VisionOS is already a major selling point for this expensive device. It’s already given Apple a way to show the world what “spatial computing” really means in extended reality. However, like any brand-new operating system, it’s undoubtedly suffered from a few teething pains.
Based on its own research and feedback from consumers, Apple has designed the new Apple Vision Pro OS 2 to address some of those problems. Plus, the updated operating system will come with a lot of great features for Apple’s enterprise customers, like an updated Mac Virtual display, new account management tools, and even an enhanced virtual keyboard experience.
Here are the key updates you can look forward to so far.
New Spatial Photo and Video Capabilities
If we’ve learned anything from all the Apple Vision Pro memes and social media posts that emerged after the device’s launch, it’s that people love using this headset to create content. So it’s no surprise (at least to me), that Apple’s new OS will come with a bunch of extra tools for content creators.
For instance, you can now use AI to transform the photos you already have saved to your photo library into “spatial” photos. The system will give them extra depth and dimension, although I’m not sure exactly how well this will work with all photos.
Additionally, you’ll be able to share and interact with all the spatial content you create (videos, photos and panoramas), in Facetime calls with friends. However, for the full experience, everyone you’re interacting with will need their own Vision Pro headset.
In addition, Apple is introducing a new, redesigned Photos app, which makes it easier to organize your library and search for specific spatial images. You’ll also be able to easily trim videos in your photo library and edit them with Final Cut Pro.
Enterprise and Productivity Features
I’ve mentioned it before, but I think the Apple Vision Pro is definitely going to appeal more to enterprise consumers investing in mixed reality than everyday XR fans. That’s something the tech leader seems to be betting on with its Apple Vision Pro OS 2.
Many of the new features seem ideal for businesses investing in immersive collaboration and productivity. For instance, the new Mac virtual display is being expanded, allowing users to view two 4K monitors side-by-side in real time.
You can also customize your Home View now by pinching and holding apps to move them wherever you like – just like on an iPad or iPhone. Plus, you’ll be able to access your keyboard in any environment, which is definitely helpful.
Apple says VisionOS 2 will be able to recognize and reveal your MacBook or Magic Keyboard wherever you are. There’s even a new update to “Travel Mode”, for train support. Apple says you’ll be able to work privately with multiple apps during a long commute, without losing spatial capabilities based on movement.
Gesture Navigation Updates and Personas
Apple’s Personas on the Apple Vision Pro might be handy for video calls on Zoom and Microsoft Teams, but they haven’t earned the best reputation. Many consumers have complained that they’ve struggled to create an accurate virtual version of themselves with Apple’s device.
Even if you manage to create the “perfect” avatar, the Personas are still a little creepy. Apple has attempted to rectify this issue by upgrading the persona system, but there’s still work to be done.
With Apple Vision Pro OS 2, you can access more accurate skin tones and a wider range of clothing colors. The firm has also updated how the software tracks and represents hand movements with new animation effects, so your personas don’t look so robotic. Plus, during FaceTime, you can add backgrounds to your persona, just like using a virtual background on an app like Microsoft Teams.
Speaking of movements, Apple is also introducing new “gestures” that you can use to navigate through apps on the Vision Pro. The company says you’ll now be able to use more simplistic gestures to access commonly used menus and features. For instance, you can hold your hand up and tap the air to instantly return to the home screen.
Entertainment and Device Sharing
Despite the high price of the Apple Vision Pro, Apple doesn’t just want to limit itself to enterprise customers. It still wants to deliver immersive experiences to everyday consumers too. With that in mind, the company is rolling out some new entertainment-focused capabilities with VisionOS 2.
The new operating system introduces an enhanced cinematic experience to customers viewing videos in Safari. You also get a new “glow” and reflection from the screen, and videos from YouTube, Netflix, and so on will look bigger and more refined. You’ll also be able to view multiple streams at once through the Apple TV app.
The new “Multiview” feature allows users to keep up with their favorite sports teams, watching up to five videos simultaneously in separate views. That all sounds a little exhausting to me, but I’m sure it will appeal to avid sports fans. Plus, if you want to share your Vision Pro with friends or colleagues, you can now set up “Guest users.”
The Guest User profile saves the eye and hand data of your most recent guest too, so they can jump back into the immersive experience without setting everything up again.
Additional Updates for Apple Vision Pro OS 2
Alongside all of those primary updates, Apple announced the Vision Pro OS 2 system will be compatible with more accessories (like your Apple mouse). Plus, there’ll be an upgraded developer suite, which I assume Apple hopes will attract more app creators to its platform.
The developer suite will include a range of new APIs and frameworks, to help users build immersive, spatial experiences. You’ll get Volumetric APIs, RealityKit, and Tabletop Kit built in, so you can design faster, more efficiently, and more effectively.
Other updates include:
- Look to dictate: A new feature in the Messages app which allows you to simply look at the microphone icon and start speaking to type.
- AirPlay receiver: Just like you can stream content to other devices with Meta, you’ll now be able to turn AirPlay Receiver on in Apple Vision Pro to mirror your content.
- Security updates: Apple is introducing new “Communication safety” solutions, with alerts for sensitive content, to help boost security in mixed reality.
- Quick Look: In the new Apple Vision Pro OS 2, Quick Look allows users to anchor objects to a surface and move them. For instance, you could use it to plan your living room design.
- Safari: The Safari web browser will allow you to watch embedded videos in an Apple Vision Pro “Environment”, and access Siri to read content for you on the web. You can also customize your Tab groups, and pin a tab to the top of your page.
- Accessibility: With VisionOS 2, Apple’s device will support live captions (real-time transcriptions of video, audio, and speech content). Plus, you can access features like Smart Color Invert, Implant support, and reduced transparency support.
- Apple Music: With VisionOS 2, users can create and edit playlists together and create sing-along sessions in Apple Music.
What’s Next for the Apple Vision Pro?
Ultimately, I think Apple will need to do a lot more than simply upgrade its operating system to effectively compete with all the increasingly advanced and cheaper XR devices on the market. However, the new Vision Pro OS 2 is a good start.
If it’s not the hefty price tag of the Vision Pro preventing you from buying one of these devices – but the operating system’s limitations, you’re in luck. There’s a good chance we’ll continue to see more upgrades to VisionOS going forward, too.
Apple is even doubling down on making its tools more appealing to enterprise customers, with its small business and enterprise toolkits.
If the price of the Apple Vision Pro drops (as rumors suggest), and Apple continues to upgrade its software, it could regain its foothold in the evolving XR market.
Quelle: