AVP

Hands-On with Zoom Meetings on the Apple Vision Pro

If you host most of your immersive collaboration sessions and meetings with Zoom, the Apple Vision Pro headset may have become a lot more appealing to your organization. When I first reviewed the Vision Pro, I noted the range of available apps was a little lacking.

Fortunately, that’s beginning to change. Apple is working tirelessly with developers to create immersive apps that fully exploit its device’s spatial computing capabilities. Unlike most XR headset vendors, Apple seems to be focusing primarily on the needs of business users.

That means, aside from producing entertainment apps, Zoom is also creating unique experiences for healthcare professionals and immersive collaboration. Zoom’s app for the Apple Vision Pro, which began rolling out in February 2024, is a great insight into how the headset could become a valuable tool for the future of work. Unfortunately, it does have its downsides, too.

Here’s a closer look at the pros and cons of Zoom on Apple Vision Pro headsets.

What is the Zoom Apple Vision Pro App?

The Zoom Apple Vision Pro app, first announced in January 2024, represents one of the first conferencing and productivity-focused apps designed for VisionOS, Apple’s proprietary operating system. Rather than just porting a version of Zoom into Apple’s app marketplace, Zoom designed a new “spatial experience” from the ground up.

According to Zoom, the experience seamlessly blends video conferencing capabilities with a user’s physical space, providing a true “spatial computing” meeting experience. It blurs the lines between in-person and remote meetings with an infinite canvas and a range of unique features.

Zoom was already available to access from the Apple app store when the device hit shelves on February 2^nd, 2024. However, the features available at launch were only a fraction of what Zoom has to offer. At launch, some of the key features you could only access with the Zoom Apple Vision Pro app included:

• Personas: Customizable spatial representations of human beings created specifically for the Apple Vision Pro, similar to the Personas you can use for Facetime. The Persona avatar system has been updated slightly since launch, with more customization options.
• Spatial video: Zoom on the Apple Vision Pro is designed to create an “immersive” meeting experience that can be scaled to suit your environment. Zoom says it can make you feel like you’re in the same room as your customers and colleagues in an instant.

Zoom’s Evolving Relationship with Apple

This isn’t the first time Zoom has worked closely with Apple on unique collaboration experiences. Previously, Zoom created a version of its app for Apple CarPlay, which allows users to host mobile meetings on the go by connecting to the CarPlay interface in their vehicle.

The video conferencing giant also has an app for Apple TV, which allows users to connect to video meetings with the “Community Camera” feature and share screens instantly. You can even connect to team members through Zoom Rooms, Mac and Windows computers, telephones, tablets, and more.

However, in my opinion, the Zoom Apple Vision Pro app is one of the most exciting developments from the vendor. It highlights Zoom’s focus on competing with companies like Microsoft in the immersive collaboration space. After all, Microsoft already has its own XR experiences, such as Microsoft Mesh and Microsoft Teams Immersive Spaces.

Zoom even plans on continuously upgrading its Apple Vision Pro experience. Throughout the next few months, users will be able to access new capabilities such as:

3D Object Sharing

RT3D object sharing is quickly becoming an essential part of the extended-reality-enhanced workplace. In some industries in particular, such as the media and design sectors, the ability to share realistic 3D files can be essential.

Although you can always share files on a standard screen or computer, Zoom believes the addition of mixed reality and spatial computing will enhance the experience. With your Zoom Apple Vision Pro app, you’ll be able to actually see the 3D representations of objects you share in the context of any environment and collaborate on development with your team.

Zoom Apple Vision Pro Team Chat

More than just a video conferencing platform, Zoom has proven itself to be a comprehensive solution for all kinds of collaborative work in recent years. This is particularly evident now that Zoom has introduced it’s new range of “Workplace” plans, unifying various tools into a single subscription.

The company has even worked with Meta in the past, on integrating XR productivity tools into Facebook Workrooms. With Zoom Chat for the Apple Vision Pro, users will be able to access a separate floating screen in their mixed reality environment, where they can share files and messages during conversations.

Real World Pinning

The addition of real-world pinning to the Zoom Apple Vision Pro app is probably one of the most exciting upgrades for companies looking to optimize hybrid work. With this feature, users can “pin” up to five participants in Zoom Meetings anywhere in their physical space.

They can even remove a person’s background when they’re pinned, making them seem like they’re actually present in the physical space. In my opinion, this feature definitely helps to make the experience of collaborating in extended reality feel more natural and realistic.

The Problems with the Zoom Apple Vision Pro App

After experimenting with the Apple Vision Pro and its available apps for a couple of months, I’d say the overall experience is pretty impressive. Many app experiences are fantastic, offering deep immersion and unique spatial computing experiences I haven’t seen anywhere else.

However, there are parts of the Apple Vision Pro still facing teething problems. Personas, one of the core features of the Zoom Apple Vision Pro app, are still pretty problematic. When the Vision Pro first launched, users weren’t impressed by the Persona feature.

Most said the virtual avatars created by the Vision OS operating system were bizarre, uncanny, and even downright creepy. You might have even seen a few memes directly ridiculing Apple’s avatars.

Fortunately, Apple introduced an upgraded “Persona Beta” solution in Version 1.1 of its Operating System in April 2024. This has definitely improved the experience to a degree, but many users are still having problems creating a “true-to-life” digital image of themselves.

Notably, the Persona issue isn’t just a problem with the Zoom Apple Vision Pro app. Users need to leverage personas on various workplace tools, from Webex to Microsoft Teams and Apple FaceTime. If the Vision Pro becomes the ultimate “workplace” headset, Apple will need to fix its avatar problem quickly.

How to Use the Zoom Apple Vision Pro App

If you can get past the uncanny valley issues still causing problems with Personas on Zoom’s Pro app, I think the overall experience is still excellent. You can definitely enjoy a more unique and immersive meeting experience in the metaverse with Zoom. Just don’t expect the same “face-to-face” experience when using Personas to stand in for you during virtual conferences.

If you want to experiment with the experience yourself, you’ll need a Zoom account, and (of course), an Apple Vision Pro headset. While I’d definitely recommend choosing a paid Zoom account for full access to all of its latest AI tools and capabilities on desktop and mobile, you can use the free app on your Apple Vision Pro.

Setting up Your Zoom Experience

Once you have an account, all you need to do is:

• Download the Zoom App: Visit the Apple App Store for the Vision Pro headset and search for Zoom. Alternatively, click this link to go straight to the Zoom Workplace page.
• Create your Persona: Before you launch the Zoom Apple Vision Pro app, you’ll need a persona. To create one, turn on your Apple headset, go to the Settings page, and tap Persona. Tap Get Started, and Apple will walk you through the process of capturing the images required to create your virtual avatar.
• Optimize your Persona: I recommend taking some extra time to ensure you generate an accurate Persona. Make sure there’s plenty of natural light in the room, and nothing is covering your face. Choose a simple background with no distracting nearby objects, and avoid turning your head too quickly.
• Customize your Persona: Next, put your headset back on, and you’ll see your Persona. You can choose from different lighting options, adjust the temperature and brightness, and even add glasses to your virtual avatar. Alternatively, you can start again.
• Launch Zoom: Go into your Apple Vision Pro apps section, and select Zoom. The app setup and launch process is similar to Zoom on any other device. You’ll get the same Zoom interface, and you can navigate through the platform using your hands and eyes. You can even tap your fingers to launch your calendar and look at upcoming Zoom meetings.

Is the Zoom Apple Vision Pro App Worth Using?

In my opinion, there’s a lot to love about the Zoom Apple Vision Pro app. There’s a reason it’s the second most popular app on the Vision Pro app store right now (behind Indeed). Although the experience is a little different from using Zoom on your desktop or smartphone, it’s still great for immersive collaboration.

The ability to share 3D animations and models and work on them with colleagues in real time is incredible. The fact that you can pin people to specific locations in your real-world environment makes everything feel more immersive. Plus, you can easily share files and screens, just like you would in a standard Zoom meeting.

The biggest issue, overall, is still Apple’s Persona feature. Although it is getting better, the virtual avatars don’t really seem to perfectly capture your appearance as well as they should. Still, if you’re looking for a next-level XR collaboration experience, I’d definitely recommend giving Zoom’s app a try.

Quelle:

Using Zoom on Apple Vision Pro Headsets: The Pros and Cons

Apple is rolling out beta trials of visionOS version 1.2 – effecting all major Apple devices 

This week, Apple, in a recent change list for its devices, confirmed that it is working on a second update for its Vision Pro spatial computing headset. Named visionOS version 1,2, the minor update is touted to improve the performance and communication between Vision Pro and iPad/iPhone devices.

The 1.2 update also improves products such as iPhone, iPad, and Apple Watch. The firm appears to be carefully optimising Vision Pro and enhancing features like its Persona system, which was updated in version 1.1. Following distribution across the US, it seems to be improving the product before international markets get hold of the device.

The 1.2 update is still in its early beta stages, with Vision Pro developers testing the most recent build periodically ahead of general availability.

Vision Pro’s version 1.2 feature list details are still relatively slim; however, a few details are hiding away based on the short notes available.

Most notable are the improvements to FaceTime and how the application works interoperably across Apple devices. The new update solves a common bug for Vision Pro users, whereby calls from an iPhone, iPad, or Apple Watch will “not sync to Vision Pro and vice versa”.

The update is timely because Apple is working to push productivity use cases and workplace adoption of its Vision Pro. A significant use case is remote communication over AR objects or via XR video calls, and making sure that these communications work as intended is critical to securing reliable communication technology in the workplace – even more so considering that many workers will not have a Vision Pro, so device interoperability allows for the Vision Pro to become more manageable in the workplace thanks to fewer adoption challenges, troubleshooting, and hurdles—little steps towards more major adoption goals.

The other revealed fix in the beta 1.2 build enhances the development of iOS or iPadOS applications on the Vision Pro by creating more stable renders of UI when accessing App Store review request APIs.

While details are slim, and the version 1.2 update will not majorly change the device operations, the small steps towards an improved end-device and its usage will only help broader adoption plans, as well as laying the foundation for a more sustainable update in the future.

The device is still very much in its early days; however, as it attempts to gain recognition, Apple is firmly placing the Vision Pro in notable workplace situations to translate the value of spatial data for business.

In a recent blog post, Apple’s Vice President of Worldwide Developer Relations and Enterprise Marketing, Susan Prescott, noted that Vision Pro represents a tremendous opportunity for businesses to reimagine what’s possible at work.

Prescott noted how enterprise clients are leveraging the Vision Pro in “innovative ways”, such as planning fire response operations to iterating on the most intricate details of an engine design. “Combined with enterprise-grade capabilities like mobile device management built into visionOS, we believe spatial computing has the potential to revolutionize industries around the world,” Prescott also remarked.

Apple Vision Pro Version 1.1: What’s New?

Apple’s version 1.1 debuted last month and has improved performance, application usage, and persona system. For enterprises, Apple has made improvements in enrollment for application access. According to reports, Apple supports workers undergoing account-driven enrollment. They can use new Vision Pro procedures such as installation, managing Apple IDs, networking, and providing support for services like Exchange and Google Workspace.

The latest update for Vision Pro users provides more control over 3D asset interaction, enabling easier manipulation of spatial objects and closer interaction with 3D assets. This feature is essential for small offices, work-from-home environments, and other on-the-go use cases.

The 1.1 update enhances this feature by introducing an updated near-user boundary for volumetric scenes. This allows users to move the volumetric scenes much closer than in the previous version, enabling easier direct interaction with the volumetric scene content.

Vision Pro also features a persona feature that tracks a user’s facial movements and eyes to create a digital twin known as a Persona – the feature’s early stages have faced criticism for its uncanny valley qualities.

Lastly, new SwiftUI frameworks enable a coordinated spatial environment and placement of 360 immersive applications. The 1.1 update for Vision Pro improves application placement and tracking of environmental changes.

Apple WWDC ’24 to be an XR Showcase?

Apple’s annual Worldwide Developers Conference (WWDC) is approaching, where the latest and potentially groundbreaking products will be showcased. The event is scheduled from June 10th to 14th, 2024. Apple will host an in-person keynote presentation at the conference, which will be widely publicized, followed by three days of virtual content to provide developers with the latest updates.

At WWDC 24, it is expected that Apple will talk about Vision Pro and its spatial computing ecosystem. Despite being in its early stages, Apple is working hard to promote Vision Pro as a leading XR product for consumer and enterprise usage. Last year, the device made headlines, but the question remains whether the latest updates will capture the audience’s attention again. It all depends on what is announced.

While Apple has not confirmed any Vision Pro-related news at WWDC, it is believed that the company may introduce the device to new regional markets since it is currently only available in limited regions.

Quelle:

Apple Vision Pro to Optimise iPhone, iPad Cross-Compatibility