Tag

AVP

Is Apple Vision Pro the Future of Augmented Reality?

Apple Vision Pro: The Future Is Here—But Can You Afford It?

Apple has finally launched the Vision Pro, its high-tech mixed-reality headset, and people are already excited about what it means for the future of augmented reality (AR). With a huge price tag of $3,499, it promises a unique experience. But is it really the future of AR, or just an expensive gadget?

A New Way to Experience Reality

The Apple Vision Pro is different from traditional virtual reality (VR) headsets because it blends both AR and VR, a concept Apple calls spatial computing. Unlike VR, which completely immerses users in a digital world, AR overlays digital objects in the real world.

This product features twin 4K micro-OLED screens, sophisticated eye-tracking, and spatial audio. Users don’t need to rely on controllers; they can navigate with hand and eye gestures so that interactions will feel more natural. Vision Pro allows users to browse the internet, play games, watch films, and even work—all within a mixed-reality environment.

How Does It Compare to Other Devices?

Apple is not the first company to produce AR and VR headsets. Meta’s Quest lineup and Microsoft’s HoloLens are already present in the market. Apple’s Vision Pro, however, is special due to its high-quality hardware, slick software, and effortless integration into the Apple ecosystem.

Meta’s Quest 3 is significantly less expensive at $499, which is more affordable for the masses. Although it delivers a decent AR/VR experience, its screen and performance are not as cutting-edge as Apple’s. Microsoft’s HoloLens, on the other hand, is primarily intended for commercial use. Apple appears to be attempting to bridge the gap between productivity and entertainment with Vision Pro.

The Challenges Ahead

Even though the Vision Pro is impressive, there are some big challenges. The biggest issue is its price—$3,499 is too expensive for most people. Another concern is its battery life, which lasts only about two hours, making it less practical for long use. Comfort is also a question, as wearing a headset for extended periods might not be ideal.

Secondly, AR technology is not yet fully developed, and there are not enough apps currently available to leverage its full capabilities. For Vision Pro to succeed, developers must develop more AR-based apps that justify the cost of the device. Otherwise, it will become a pricey gadget instead of a game-changing product.

What’s Next for Augmented Reality?

Apple’s move into the AR arena is a big leap forward. With its brand power and innovation, it can popularize AR technology. Apple could, in the future, launch smaller, cheaper, and more convenient AR devices—just as the original iPhone led to today’s smartphones.

Although the Vision Pro is not the be-all and end-all of AR technology yet, it is certainly a milestone. If Apple can develop the tech further and lower the cost in later models, then AR could be a standard component of everyday life.

Conclusion

The Apple Vision Pro is a daring move to shape what’s next for AR. But it’s pretty pricey, and since the ecosystem is just starting, not everyone might jump on board just yet. It’ll be a big deal or stay as a small-time thing based on what Apple and the devs do next with its capabilities.

Right now, Vision Pro is like a sneak peek into a place where the stuff we see and the stuff on screens become one giving us hints about what could be coming our way.

Quelle:

https://www.analyticsinsight.net/augmentedvirtual-reality/is-a-career-in-arvr-worth-it

21. Februar 2025 0 comment

Examples

FundamentalVR Unveils Version Two of Apple Vision Pro App for Hands-On Medical Training with Spatial Computing

FundamentalVR, the global leader in immersive surgical training, is pleased to announce the release of the second version of its Apple Vision Pro app. The update, available now on the visionOS App Store, offers a refined immersive environment specifically designed to support hands-on medical training, including replicating a real-world Cath lab.

The second version of the app continues to explore the potential of spatial computing in medical education, allowing users to gain practical experience with complex medical procedures in an entirely immersive setting. The latest update introduces universal interaction through native gestures and optional haptic feedback (with compatible hardware required), providing a deeply immersive and tactile learning experience.

“With this release, we are redefining the future of medical training by making it more accessible and immersive than ever before,” said Richard Vincent, Co-Founder and CEO of FundamentalVR. “The app allows healthcare professionals to experience a hands-on, gesture-based approach to learning, while those with haptic devices can further immerse themselves with realistic tactile feedback. Our goal remains to push the boundaries of surgical education and help improve patient outcomes by making training more accessible and interactive.”

The updated app also enables users to engage in a slice of an ultrasound-guided femoral access procedure, utilizing the full power of Apple Vision Pro to deliver fully immersive visuals, accurate patient anatomy, and a functioning ultrasound unit.

Users can interact with the simulation using native Vision Pro gestures, while those with supported haptic devices can experience spatial force feedback, offering a realistic sensation of performing the procedure. This combination of visual and tactile feedback helps users build a deeper understanding of the procedure, enhancing their surgical competency in a controlled and safe environment.

Key Features of the App:

Scale Surgical Competency: Leverage spatial computing to enhance and expand surgical training.
Ultrasound-Guided Procedure: Master part of the femoral access procedure with realistic, step-by-step visual guidance in a virtual Cath lab.
Interactive Learning: Choose between gesture-based interaction or a haptic-enhanced experience to perform the procedure.
Haptic Feedback: For a fully immersive training session, connect a Haply Haptic Device to experience true-to-life tactile feedback.

To download the App, please visit the visionOS App Store: https://apps.apple.com/us/app/fundamental-surgery/id6612024672

Quelle:

FundamentalVR Unveils Version Two of Apple Vision Pro App for Hands-On Medical Training with Spatial Computing

19. Februar 2025 0 comment

Examples

Prima Immersive On Apple Vision Pro Offers The Highest Quality Immersive Video Yet

Prima Immersive on Apple Vision Pro offers the highest quality immersive 3D video yet, sharper than even Apple Immersive Video.

The app currently offers one 16 minute immersive music session of the bluegrass band AJ Lee & Blue Summit, priced at $3.99. A one minute free immersive trailer is available.

Trying out Prima on Vision Pro, the sharpness of the image is truly remarkable. We highly praised Apple Immersive Video in our Vision Pro review, and Prima is even higher quality. After over a decade of streamed immersive video, this is the sharpest I’ve ever tried.

The startup behind Prima Immersive is called Immersive Company, and says it built a custom camera it calls Immersive Camera Two to capture the footage. It provides the same 8K per eye resolution, 90 FPS, HDR, and spatial audio as Apple’s custom immersive cameras (based on its NextVR acquisition) and the Blackmagic URSA Cine Immersive, which Prima will support „in the coming months“.

So how is Prima sharper than Apple Immersive Video, if it’s the same resolution? The answer is software, not hardware. The startup says it developed „the world’s first immersive video encoder“, specifically designed to compress 8K per eye 90FPS HDR immersive footage, with „industry-leading visual fidelity“ at 40-80% lower bitrate than traditional encoders like x265 or Apple’s VideoToolbox.

With Blackmagic URSA Cine Immersive becoming available to studios, Immersive Company plans to turn Prima into the highest-quality portal for immersive video, a title it has, in my experience, taken from Apple.

If you own an Apple Vision Pro you should absolutely try out Prima Immersive, as the sharpness is truly something to behold.

Quelle:

https://www.uploadvr.com/prima-immersive-on-apple-vision-pro-highest-quality-180-3d-video-yet/

18. Februar 2025 0 comment

Examples

How Apple Vision Pro is finding a home in healthcare

300 people are gathering in San Diego to explore the uses of Apple’s spatial computing headset for surgery and other medical applications.

In early 2024, Ryan Broderick, a surgeon at UC San Diego Health, was commiserating with some colleagues about the profusion of screens in today’s operating rooms. Though the displays provided essential guidance for minimally invasive operations in progress, they also added complexity.

“We were looking around the operating room,” he remembers. “We have a lot of monitors, a lot of clutter. We were like, ‘There’s got to be a better way to do this.’”

It wasn’t just about tidiness. ”For [a] monitor to be in the ideal position for surgery, it really should just be directly in front of your head without having to turn your neck or adjust your body,” explains Dr. Broderick. “But often in laparoscopy, you have to adjust your body, turn your neck, and be in uncomfortable positions. And with repeated use like that, it can lead to tight muscles, neck injury, back injury.”

The doctors’ frustration with this situation happened to come to a boil at an opportune time. On February 2, Apple released the Apple Vision Pro, its first headset. A major element of the device’s spatial computing experience was the ability to float multiple virtual screens of any size in real-world surroundings, unconstructed by the bulky inconvenience of physical displays. Dr. Broderick’s team got its hands on a loaner Vision Pro and worked with UC San Diego Health chief clinical and innovation officer Dr. Christopher Longhust to assemble a system capable of streaming video feeds and overlaying them on the live view of a surgery in progress, greatly reducing the need to crane necks.

In short order, the idea became a trial that involved real patients and is currently undergoing peer review. “We’ve done over 50 cases and have had great success thus far,” says Dr. Broderick.

Quelle:

Foto: courtesy of Sharp HealthCare

https://www.fastcompany.com/91269127/apple-vision-pro-healthcare

7. Februar 2025 0 comment

Examples

Craftrium Is A Personalized Spatial Aquarium App For Apple Vision Pro

Craftrium lets you create a spatial aquarium in your living space, and it’s out now for free on Apple Vision Pro.

Developed by Graffity and published by Shochiku, Craftrium is described as a relaxing experience that lets you create a personalized digital aquarium in your living space. Item placement determines which types of fish appear in your aquarium, and the studio states “creative combinations” cause new species to appear. Here’s the launch trailer.

Upon discovering new species, these fish can then be added to an encyclopedia by tapping on them. While Craftrium’s main focus appears to be on mixed reality using pass-through, the aquarium app also offers an ‚Immersive Mode‘ that turns your entire room into an underwater world.

Speaking in a press release, Graffity states Craftrium was inspired by Apple Vision Pro as a productivity device. “This game not only showcases the innovative capabilities of Apple Vision Pro but also introduces a novel concept of workspace aesthetics through user-created aquariums,” said Toshiaki Morimoto, CEO of Graffity in a prepared statement.

Craftrium is available now on Apple Vision Pro.

Quelle:

https://www.uploadvr.com/craftrium-apple-vision-pro-aquarium/

4. Februar 2025 0 comment

Examples

Neurochirurgie: virtueller Blick in den Patienten

Medizinische Eingriffe sollen Patienten möglichst wenig belasten; auf einem präzise festzulegenden Weg zu der Stelle, die operiert werden muss, darf kein Gewebe verletzt werden.

Dies gilt besonders bei Operationen an sensiblen Organen wie dem Gehirn. Bei bestimmten Hirntumoren wählen Operateure den schonendsten Zugang ins Gehirn – über die Nase. Hier kommt nun modernste Technik ins Spiel: Diese visualisiert, was der Arzt von außen nicht sehen kann. Als ‚Landkarte‘ für die Navigation dienen präzise, hochaufgelöste Bilddaten des Patienten, wie sie die Magnetresonanztomographie (MRT) bietet; der operierende Arzt sieht diese Bilddaten als Projektion in einer Datenbrille. Eine zentrale Komponente, das Handstück für die Anbindung des Operationsbestecks, wird am Fraunhofer-Institut für Werkzeugmaschinen und Umformtechnik IWU entwickelt und 3D-gedruckt.

Das zentrale Bindeglied zwischen MRT-Daten und Brille ist eine neuentwickelte App, die nun als Ergebnis langjähriger Forschung und Entwicklung zur Verfügung steht. Sie entstand in einer Zusammenarbeit der Forschergruppe LEGEND der Klinik und Poliklinik für Neurochirurgie des Universitätsklinikums Leipzig (UKL) mit dem Zittauer Institutsteil des Fraunhofer IWU.

Die App führt das vor der OP aufgenommene MRT-Bild mit der realen OP-Situation zusammen und erlaubt somit eine genaue topographische und strukturelle Zuordnung des OP-Befundes. Analog einem GPS-System führt sie den Operateur auf dem besten, also schonendsten Weg zum beabsichtigten Ziel. Die systemseitige Anbindung von chirurgischen Instrumenten erlaubt darüber hinaus deren Abbildung im Navigationssystem bzw. Nutzung als Zeigeinstrument. Dabei wird die exakte Position des chirurgischen Instruments dem Operateur in Echtzeit angezeigt. Wichtige Zusatzinformationen wie beispielsweise die Entfernung zum Zielgebiet befinden sich im direkten Blickfeld des Arztes und liefern weitere wertvolle Hinweise. Besonders stolz ist PD Dr. habil. Ronny Grunert, wissenschaftlicher Mitarbeiter am Fraunhofer IWU (Zittau) und Leiter der Forschungsgruppe ‚Legend‘ am UKL, auf die praktisch verzögerungsfreie Betriebsbereitschaft des Systems: „Unserem Team ist mit einer vollautomatisierten Registrierung bei der neurochirurgischen Spatial Computing Navigation ein weltweites Novum gelungen. Binnen einer Sekunde ist die Kalibrierung und Registrierung abgeschlossen und die Navigation zur Echtzeiterkennung der Instrumenten-Position startklar. Das entwickelte System ist sehr intuitiv bedienbar und kommt dem Gebrauch einer GPS-Assistenz sehr nahe.“

Großen Wert legte das Team auf ein übersichtliches, den operierenden Arzt optimal unterstützendes User-Interface, das Bedienungsfehler ausschließt und sich auf die Anzeige wesentlicher Informationen beschränkt. Ein Beispiel für die klare, präzise Darstellungslogik ist ein grünes Fadenkreuz, das die Position der Instrumentenspitze anzeigt und perfekt in das vorher erstellte bzw. in die Datenbrille eingespielte MRT-Bild integriert ist.

Binnen einer Sekunde ist die Kalibrierung und Registrierung abgeschlossen und die Navigation zur Echtzeiterkennung der Instrumenten-Position startklar

Ronny Grunert

Das am Fraunhofer IWU in Zittau entwickelte und 3D-gedruckte Handstück für Operationsinstrumente enthält Marker-Geometrien, die von der Datenbrille erkannt werden.

Das Prinzip einer sogenannten Neurochirurgischen Spatial Computing Navigation ist nicht grundsätzlich neu. Heutige, für den Einsatz in Kliniken geeignete Systeme starten bei rund einer halben Million Euro. Eine wichtige Motivation für die gemeinsamen Anstrengungen von IWU und UKL war, dass präzise Navigationstechnik nicht länger finanzstarken Gesundheitssystemen bzw. Einrichtungen vorbehalten bleiben sollte. Sie konzipierten ihre neue App von Anfang an für den Einsatz mit standardisierten Datenbrillen, deren Preise mittlerweile im Consumer-Bereich angekommen sind. Grunert: „Diese Brillen kosten einen Bruchteil computergestützter Navigationssysteme für die Neurochirurgie.“

Am Fraunhofer IWU trieb das Team um Ronny Grunert die Entwicklung des Handstücks voran, das die Instrumente aufnimmt und deren exakte Positionsbestimmung ermöglicht. Es enthält spezielle Marker, deren Geometrien und Muster von der Datenbrille erkannt werden. Diese Geometrien können kleine Kugeln, Quader oder andere Körper sein. Die Kunststoff-Handstücke werden am IWU in Zittau und am UKL in Leipzig 3D-gedruckt.

Der erste Pilotkurs für das Training am anatomischen Modell fand bereits im Herbst 2024 am UKL statt. Im nächsten Schritt konzentriert sich das Team auf die Fertigstellung des Prototyps; danach beginnt der Zulassungsprozess gemäß der Medical Device Regulation (Medizinprodukte-Verordnung) für den europäischen Markt bzw. entsprechend den Vorschriften der amerikanischen Gesundheitsbehörde FDA für die USA. Der Einsatz am Patienten könnte somit in ca. zwei Jahren erfolgen.

Quelle:

https://healthcare-in-europe.com/de/news/neurochirurgie-virtuell-operation.html

Foto:

Neurochirurg Prof. Dr. Dirk Winkler und Informatiker Conrad Günther (UKL) testen die App für die neurochirurgische Spatial Navigation an einem Modellkopf. Der operierende Arzt kann sein Instrument dank der in einer Standard-Datenbrille visualisierten, realen und virtuellen Informationen (Mixed-Reality) sicher führen und die Verletzungsgefahr für Patienten minimieren.

Fraunhofer-Institut für Werkzeugmaschinen und Umformtechnik IWU

27. Januar 2025 0 comment

Examples

Apple Vision Pro Gains Enterprise-Grade XR Streaming Capability – CES 25

Innoactive debut NVIDIA spatial streaming for Omniverse for Apple Vision Pro at CES 2025

Another piece of CES news this week: among all the big announcements and innovations, XR streaming solutions provider Innoactive announced a new product partnership with Apple and NVIDIA to introduce a streaming service between Omniverse and Apple Vision Pro.

The move enables NVIDIA Omniverse developers to stream their Universal Scene Description (OpenUSD) workflows to an Apple Vision Pro headset.

Innoactive announced NVIDIA spatial streaming for Omniverse at CES this week, aiming to continue immersive industry-wide advancements in streaming technology, which allows headsets to display high-quality 3D models and experiences.

This is a massive leap for the industry. If wireless streaming continues its uptick, the ability to stream more complex services onto increasingly small-end devices could prove paradigm-shifting for the AR/VR/MR hardware market.

The streaming platform notably features support for streaming digital twin-related workflows to Apple Vision Pro devices, in a move which seems to parallel NVIDIA’s usage of Apple products in its simulation and robotics fields.

Furthermore, Innoactive notes that the CES announcement marks the debut of hybrid rendering, a platform feature that combines local and remote rendering. Therefore, the new hybrid-rendering feature allows NVIDIA developers to render fully interactive experiences in an Apple SwiftUI or Reality Kit application.

The new streaming platform’s features also include streamlined access to immersive 3D environments, browser streaming, standard VR headset streaming, on-demand cloud tools, enterprise-grade security considerations, and support for NVIDIA accelerated computing technology.

Innovative is working to deploy its Vision Pro-ready solutions in professional settings today, such as working with Automotive firm Volkswagen Group and Healthcare leaders Syntegon.

Dr Axel Heinrich, Head of Innovation and Systems Architecture at Volkswagen AG, noted that the company uses Innoactive’s XR Streaming platform to power its Digital Reality Hub tool.

Heinrich added:

Now with their support of NVIDIA Omniverse, OpenUSD and Apple Vision Pro, we can do exact surface validation as well as early product decisions in ergonomics and user interaction – without needing any physical prototype, at lightning speed. This includes high precision and realistic visualization of the surface, incorporating real-time lighting and shadowing. Additionally, it enhances the user car experience and provides insights into the experience of valency.

Apple Vision Pro Helps to Train NVIDIA Robots

NVIDIA recently took centre stage to showcase its latest innovations in emerging technology, focusing on its robotics and artificial intelligence investments. The company’s research into robotics and self-driving cars is closely intertwined with developing an AI framework to support the next generation of these technologies.

In addition, NVIDIA’s announcements at CES highlighted the significant role of spatial computing and the Omniverse platform in training its robotics, environmental AI, and self-driving car systems. These systems require the ability to analyze and understand real-world environments to function effectively.

Importantly, in its official press releases about recent updates in robotics, NVIDIA featured Apple’s Vision Pro mixed reality headset in several promotional images, illustrating its crucial role in this initiative. During last year’s NVIDIA GTC, the company emphasized how the Vision Pro would become increasingly significant in its research into emerging workplace tools, reinforcing the connection between the device and the Omniverse platform.

The support from NVIDIA and Innoactive for the Apple Vision Pro indicates a strong commitment and investment in the mixed reality device, countering the notion that it underperformed in its first year.

Quelle:

Apple Vision Pro Gains Enterprise-Grade XR Streaming Capability – CES 25

15. Januar 2025 0 comment

Research

Apple Vision Pro Helps to Train NVIDIA Robots – CES 2025

Apple Vision Pro looks to have a secure future through NVIDIA Omniverse Integrations

This week, at CES 2025, NVIDIA took centre stage to showcase its latest innovations in emerging technology. Namely, NVIDIA showed off its robotics and AI investments. The two go hand in hand for NVIDIA. As the firm researches into robotics and self-driving cars, it is taking the necessary steps to develop an AI framework to power this next generation of tech.

That’s not all. According to the firm’s recent CES announcements, spatial computing and NVIDIA’s Omniverse platform will play a significant role in training the firm’s robotics, environmental AI, and self-driving car frameworks, which need to analyse and understand real-world spaces in order to operate correctly.

Notably, in its official press releases regarding NVIDIA robotics updates, Apple’s Vision Pro MR headset was featured in various promotional images, highlighting its pivotal role in this journey.

Last year, during NVIDIA GTC, the firm directly noted how the Vision Pro will play an increasingly important role in NVIDIA’s leading research into emerging workplace tools, with the Apple device becoming more closely linked to the Omniverse platform.

How is NVIDIA Leveraging Apple Vision Pro?

Reports from this year’s CES suggest that Vision Pro is deeply involved in the forthcoming success of recent announcements. For example, NVIDIA debuted Issac GROOT at the event, an AI framework for advancing humanoid robotics, specifically for industrial and manufacturing sectors.

NVIDIA developers can leverage Apple Vision Pro devices in their Omniervse workflow to capture human movements as 3D spatial data or, in other words, a digital twin that a robot can replicate in a simulation or real-life scenario.

Combined with Omniverse, Apple Vision Pro, and NVIDIA’s broader developer ecosystem, they combine hardware and software to create the future of work and the role of robotics. XR plays a vital role in capturing crucial data for this journey.

Alongside the work NVIDIA is doing to secure the future of workplace robotics, with partial thanks to XR, the firm also introduced the new “Omniverse Spatial Streaming to Apple Vision Pro” at CES 2025, which supports developers in creating applications for the immersive streaming of large-scale industrial digital twins.

NVIDIA Omniverse Cloud Debuts on Apple Vision Pro

NVIDIA first debuted its support of Apple Vision Pro developer workflows on the Omniverse platform last year at GTC. This move laid the foundation for this week’s CES 2025 announcement and Apple’s role in NVIDIA’s robotics journey.

NVIDIA introduced Omniverse Cloud APIs last year. Thanks to cloud-assisted computing processes, these APIs enable Apple Vision Pro users to customize and distribute high-quality OpenUSD file types on mobile devices without sacrificing content or performance quality.

Vision Pro users can stream their Omniverse creations directly onto the Vision Pro device, with the cloud API handling much of the computing power required for such content. NVIDIA’s Graphics Delivery Network (GDN) also supports OpenUSD streaming on the Vision Pro. The GDN is available in over 130 countries, allowing users to access it on any compatible device. U.S. customers can also take advantage of Omniverse cloud rendering on the Vision Pro.

Rev Lebaredian, the Vice President of Simulation at NVIDIA, explained at the time:

Apple Vision Pro is the first untethered device which allows for enterprise customers to realize their work without compromise. We look forward to our customers having access to these amazing tools.

As of writing, the technology collaboration between Apple and NVIDIA is only approximately a year old. However, the work between each firm is clear, and ambitions are high.

NVIDIA clearly holds a lot of value in robotics and AI empowerment, and if Apple Vision Pro is crucial in this journey, then Apple will have a stream of support and investment into its MR device going forward—pushing back ideas that the device underperformed in its first year.

Quelle:

Apple Vision Pro Helps to Train NVIDIA Robots – CES 2025

14. Januar 2025 0 comment

Hardware

What is Apple Immersive Video? Mesmerizing Media

Introducing Apple Immersive Video

It’s easy to write the Apple Vision Pro off as being “dead in the water” at this point. After all, the evidence is mounting that Apple is going to discontinue the spatial computing device in the future. But that doesn’t mean Apple’s XR journey is over – as evidenced by Apple Immersive Video.

Sure, “immersive video” doesn’t sound as exciting as a brand-new mixed reality headset, or a pair of augmented reality glasses – but it does have potential. With this new “storytelling format” designed exclusively for the Apple Vision Pro, the tech giant is demonstrating its potential to a wider range of consumers – particularly content creators.

Apple isn’t just promising 3D video experiences here, like the ones you can get with YouTube on other mixed-reality headsets. It’s introducing a new 8K viewing experience with spatial audio and an impressive 180-degree field of view built in.

Here’s everything you need to know about Apple Immersive Video, and what it means to the future of XR arts, media, and entertainment.

What is Apple Immersive Video?

Apple Immersive Video is a new video format, designed for the Apple Vision Pro, that leverages 3D video capture, spatial audio, and a 180-degree field of view. Basically, it enables media creators to design highly immersive viewing experiences that put people straight in the heart of the action.

Announced in July 2024, Immersive Video is still in its early stages, but Apple has already begun rolling out experiences designed with this format for users to try. As an example, users can view highlights from the 2023 Major League football finals, which transport you directly into the heart of the field, allow you to explore the locker room with the players, and so on.

Creators working with Apple to produce Immersive Video content have raved about the format too. For instance, the first short film (submerged) released for the Apple Vision Pro was announced in October 2024. Award-winning filmmaker Edward Berger described the Immersive Video format as an impressive “new medium” that expands the horizon of storytelling.

According to him, Apple Immersive Video inspired him to tell a story in a way that simply wasn’t possible before. He even said that he thinks that the format is going to change the future of media.

What Can You Watch with Apple Immersive Video?

Since announcing the Immersive Video format, and promising to revolutionize the future of XR-based entertainment, Apple and its partners have only released a handful of XR media experiences. Aside from the sports-related content mentioned above, there are a range of options to choose from, including series-based content, concerts, documentaries, and films.

Here’s a quick look at what we’ve seen so far.

Boundless: The First TV Series

Boundless, introduced in July 2024, is a series that invites viewers to explore new locations and trips like never before. The first installment in the series was the “Hot Air Balloons” video, which takes Apple Vision Pro users to the skies over the landscape of Cappadocia in Türkiye.

After that, in the fall, Apple introduced a new “Arctic Surfing” video, which allows viewers to enjoy surfers exploring regions of the Arctic Circle. We found both experiences to be extremely impressive – it’s not just like watching a YouTube clip. It really feels almost like you’re actually there – in the action, with the people you’re watching.

Wild Life

Wild Life is another “series” on the Apple Immersive Video platform, targeted at nature lovers. This series takes viewers into the heart of Kenya, where they can join the Sheldrick Wildlife Trust helping orphaned elephants to find their way in life. You can watch these elephants frolic in mud baths (occasionally flinching when mud flies up towards you).

Later in the year, Apple also released another video for Wild Life which introduces a group of divers in the Bahamas, swimming with apex predators.

Elevated

The initial episode of the Elevated aerial travel series takes viewers above volcanoes, waterfalls, and incredible landscapes across the longest island chain in the world: Hawaii. In the second episode, viewers can take a trip to New England, where they’ll see the region in all of its colorful glory during the autumn months, and view a range of coastlines and rivers.

Submerged

The first scripted short film in Apple Immersive Video, Submerged, is probably the one that’s gained the most attention (particularly from media creators). This experience premiered in Fall 2024, and introduces viewers to an incredible landscape in the midst of World War II.

The action-adventure tale brings Vision Pro users into the heart of a story where submarine sailors struggle to navigate and survive a torpedo attack. It’s honestly one of the most impressive storytelling experiences ever released – highlighting just how valuable XR can be in the media landscape.

2024 NBA All-Star Weekend

For sports fans, Apple Immersive Video goes beyond the 3D viewing apps offered by groups like the NBA, immersing viewers deeper into the action. The NBA All-Star weekend, for instance, offers access to an immersive short film that takes you into the Slam Dunk contest, the Rising Stars of the industry, and the first ever NBA vs WNBA 3-point challenge, with behind-the-scenes footage.

You can genuinely explore the court and see players from perspectives you’ve never considered before – all without the need to actually travel and pay for tickets.

The Weeknd Concert

The Weeknd is no stranger to immersive storytelling – just look at the unique experiences he’s created for things like Universal Studio’s Halloween Horror Nights. With Apple Immersive Video, this creator offered fans a premier concert experience in mixed reality.

Other artists are following suite, with a growing catalog of Apple Vision Pro experiences, like the “Concert for One” musical extravaganza from singer-songwriter RAYE.

Red Bull Big-Wave Surfing

Finally, for thrill seekers, Red Bull brings its big-wave surfing experience into the Apple Immersive Video landscape. Here you can join elite surfers as they attempt to overcome some of the heaviest waves in the world, just off the coast of Teahupo’o, Tahiti.

How to Watch Apple Immersive Video

As mentioned above, Apple Immersive Video is only available for Apple Vision Pro, and VisionOS users for now. It doesn’t seem like Apple has any plans to extend this “storytelling” format to other devices yet – but who knows what the future might hold.

If you have an Apple Vision Pro headset, all you need to do is download the Apple TV app (you can also watch a range of 3D videos through this). Once you have the app downloaded, select it from within your Apple Vision Pro headset, then:

Select Home in the tab bar
Choose any title that says Apple Immersive Or you can head to Search and select the “Only on Vision Pro” option to visit the editorial room. Here, you’ll see all of the Apple Immersive titles alongside top 3D movies available for Apple TV.
Pinch and hold over the title you want to watch to download it (this will ensure you can watch it offline). Alternatively, just pinch to select the video and watch it immediately.

One thing worth keeping in mind is when we were testing the Apple Immersive Videos feature, we did notice a few bugs from time to time. For instance, the headset sometimes struggles to “restart” playback if you need to take your headset off and come back to it.

If you find the experience struggles to load after a quick break, the only thing you can really do is restart the Apple TV app, or your headset.

How to Create Apple Immersive Videos

Right now, Apple doesn’t offer a lot of unique tools to help creators actually produce “Immersive Video” experiences. You can record spatial videos on an iPhone and upload them to the cloud to view on your headset – but this doesn’t give you the full experience.

What makes Apple Immersive Videos unique is that they’re 8K videos, with included spatial sound and a 180-degree field of view. You can’t recreate that with a standard smartphone. Apple has partnered with a video camera company to create a solution for recording Immersive Videos, however.

The BlackMagic Design USRA Cine Immersive camera is the first system specifically designed to capture Immersive Video for the Vision Pro. It includes a fixed, custom lens system, designed for Apple. The sensor also supports an 8160 x 7200 resolution per eye, for Vision Pro users, and 16 stops of dynamic range. Unfortunately, we can’t see many amateur videographers using this kit.

Right now its available for preorders at a cost of $29,995 in the US only. That’s a pretty hefty price to pay for a new camera – unless you’re running a world-leading film studio, of course.

Apple Immersive Video: What it Means for XR Media

For years, art, media, and entertainment experts have been exploring the potential of extended reality for creating more immersive, engaging experiences. However, we’ve really only scratched the surface of what’s possible with “3D videos”, and immersive museum or concert tours.

Apple Immersive Video really seems to be taking things up a notch. It’s introducing the potential for a new era of content creation – one that puts viewers in the heart of experiences like never before. In the months ahead, Apple is planning on introducing more content to its Immersive Video collection, and honestly – we’re excited to see it.

However, with the hefty costs associated with creating this type of content, it’s uncertain whether immersive video will become the next “big video trend”. We don’t think we can expect to see this type of video experience emerging in your local cinema any time soon, for instance.

Quelle:

What is Apple Immersive Video? Mesmerizing Media

30. Dezember 2024 0 comment

Examples

Apple’s Final Cut Pro for Mac Now Supports Editing Spatial Videos

Apple’s Final Cut Pro video editing software for Mac now supports editing spatial videos.

Spatial Video is Apple’s term for stereoscopic 3D video using the Apple HEVC Stereo Video Profile format of MV-HEVC. Spatial videos can be captured by all iPhone 16 models, the iPhone 15 Pro models, Apple Vision Pro, and Canon’s EOS R7 camera with its upcoming spatial lens attachment. Spatial videos can be viewed on Apple Vision Pro, Pico 4 Ultra, Meta Quest headsets via Meta’s phone app, or any VR headset if you convert to SBS 3D via an iPhone app.

Final Cut Pro 11 for Mac is out now, and it includes the ability to import and edit spatial videos, add effects and titles with adjustable depth, and make color corrections that apply to both views.

Spatial video projects can be previewed instantly on Apple Vision Pro, including when connected via Mac Virtual Display. You can also publish them to your Photos library to view on Vision Pro later, or upload them to a platform that supports spatial videos and visionOS such as Vimeo.

The update also brings new AI-powered features to Final Cut Pro, including the Magnetic Mask, which automatically segments people and objects without the need for a green screen or rotoscoping, and automatic captioning with a very low error rate.

Final Cut Pro for Mac is available for $300 on the Mac App Store. And Apple Vision Pro’s new Ultrawide Mac Virtual Display mode is arguably the ideal way to use it, whether you’re editing regular video or spatial video.

Until now, spatial videos have mostly been simple consumer-captured clips, mostly intended to relive a memory at a later date. But now, the ability to edit spatial videos, combined with a platform to publish them on, could lead to professional entertainment, documentary, and educational productions, especially after Canon’s R7 spatial lens ships.

Vimeo said it was funding the first spatial video short film, called Currents, which was supposed to release on November 11. But three days later, it’s nowhere to be seen. We’ve reached out to Vimeo to ask what the status of Currents is.

Quelle:

https://www.uploadvr.com/apple-final-cut-pro-for-mac-spatial-video-editing/

18. November 2024 0 comment