Tag

Spatial Computing

What Leaders Need to Know About Spatial Computing

Spatial computing is an evolving form of computing that blends our physical world and virtual experiences using a wide range of technologies, thus enabling humans to interact and communicate in new ways with each other and with machines, as well as giving machines the capabilities to navigate and understand our physical environment in new ways. Apple’s entrance into the market is a big step for the technology, but the idea has been in development for years. Now, spatial computing is already starting to make an impact, including on communication and co-presence, manufacturing, gaming, human resources, media, sports and entertainment, and data visualization.

Earlier this year, Apple unveiled its entry into a completely new market segment. During the company’s June developers conference, Tim Cook announced the launch of the Apple Vision Pro, a head-mounted device with just as much processing power as a MacBook Pro and the company’s first spatial computer. During the keynote, Cook signaled that the device is part of Apple’s long-term vision and a shift from personal computing (the Mac) to mobile computing (the iPhone) and now into spatial computing (the Apple Vision Pro).

The announcement sparked both excitement and skepticism about whether betting on this new technology was prescient or outrageous. People wondered just what this technology was, what its current and future business applications might be, and what it might look like for it to become integrated into our daily lives and work.

Apple’s entrance into the market is a big step for the technology, but the idea has been in development for years. Here’s what leaders need to know.

A Working Definition for a New Way to Compute

Spatial computing is a term that many in the business world might have heard for the first time during Apple’s announcement, but it is by no means a new term. In 2003, researcher Simon Greenwold, then at the MIT Media Lab, defined spatial computing as: “Human interaction with a machine in which the machine retains and manipulates referents to real objects and spaces.” Companies such as Amazon, Apple, Magic Leap (my former employer), Meta, Microsoft, and others have come up with their own definitions, but they basically boil down to this: Spatial computing is an evolving form of computing that blends our physical world and virtual experiences using a wide range of technologies, thus enabling humans to interact and communicate in new ways with each other and with machines, as well as giving machines the capabilities to navigate and understand our physical environment in new ways.

From a business perspective, it will allow people to create new content, products, experiences, and services that have purpose in both physical and virtual environments, expanding computing into everything you can see, touch, and know.

Sci-fi as this may sound, it’s already in use. One could argue that our mobile phones are primitive spatial devices. Many professionals in augmented reality (AR), virtual reality (VR), extended reality (XR), and artificial intelligence (AI) have been working on spatial computing for years.

In practice, the coming generation of spatial computing tools is arriving in the form of wearable headsets that have cameras, scanners, microphones, and other sensors built into the device, and make use of artificial intelligence, augmented and virtual reality technology, and the internet of things to create a more immersive relationship with computing. Users interface through hand gestures and finger movements, gaze tracking, and voice. GPS, Bluetooth, and other sensors make creating digital content with physical context possible. And while much of the focus is currently on headsets, projects like Google’s Starline offer a glimpse of other possibilities.

The goal of all of this is to expand the canvas of our screens, allowing users to work, collaborate, and engage with data and applications in whole new ways. If it catches on, it would be an evolutionary technological shift away from static devices that must hang on our walls, sit on our desks, or rest in our hands to devices that start to fade into the background and allow us to go back to focusing on the physical space around us, albeit augmented. But what are the use cases that will make people and businesses actually want to use it?

Where Businesses Are Using Spatial Computing

Spatial computing is already starting to make an impact include communication and co-presence, manufacturing, gaming, human resources, media, sports and entertainment, as well as data visualization. Below is a list of some of the ways spatial computing is already being used in these sectors. This list is not exhaustive but helps demystify how spatial computing is already being used and how companies, nonprofits, and organizations are starting to think about spatial computing and its impact on their business and audiences.

Communication and co-presence

The way we communicate through flat screens is bound to evolve. Technology has thrust our social interactions forward, so a move toward more immersive ways of communicating and experiencing co-presence might be the next logical step.

A recent demo of Meta’s codec avatars on Lex Fridman’s podcast interview with Mark Zuckerberg in volumetric form made headlines recently, giving the tech and business world a sneak peek of what’s on the horizon. Apple also announced that the new iPhone 15 will record spatial photos and video, one of the features highlighted during the launch of the Vision Pro. A stronger sense of presence via spatial video and shared memories could become a reality with spatial computing.

Spatial computing could also solve many communication challenges for businesses by using headsets, volumetric video, or avatars to provide better co-presence at work for remote teams, clients, and other stakeholders. For example, in 2019 BNP Paribas rolled out holographic meetings across their global offices using Magic Leap headsets. Bank clients were able to put on a headset and be offered real-time investment advice in consultation with the bank’s real estate team in hologram form, while being able to manipulate and alter the common plans modeled in a 3D projection of new real estate ventures. The company used spatial computing and visualization to help clients around the world view real estate with a consultant in that area.

In a related vein, Google developed Project Starline, which uses computer vision, machine learning, spatial audio, and real-time compression to present a person as though they’re sitting across from you at a table. You can talk, make hand gestures, use body language, and make eye contact in life size and three dimensions — all without wearing anything on your face. As part of Project Starline’s early access program, Salesforce and T-Mobile are using new prototypes that are gathering real-world data on how Project Starline can help distributed workforces stay connected. While the technology seems like magic, it’s really the collaboration and ideas that take shape in a shared mixed reality that is truly magical.

Manufacturing

Manufacturing was one of the first industries to embrace spatial computing. Several already use spatial devices to remotely assist workers, display virtual work instructions, and capture soft knowledge before operators retire. From assembling parts on the line to quality assurance and assisting operators, spatial computing has measured success.

Lockheed Martin, an American aerospace company, achieved a 93% reduction in costs on one part of the manufacturing process for the Orion space vehicle when they implemented augmented reality aids. What once took eight shifts of eight hours each was reduced to six hours via Microsoft HoloLens and Scope AR’s Worklink.

Gaming

Data from Newzoo estimates that there are approximately 2.7 billion gamers around the world — meaning that one in every three people on the planet identifies as a gamer. The gaming industry is worth more than the movie and music industry combined. A progression from gaming on consoles, tablets, or mobiles is a natural progression for spatial computing. Pokémon Go, an AR mobile game, has millions of daily gamers across the globe, and who would probably make the shift to a new kind of device if that meant playing their favorite game in a more immersive way without having a small mobile screen get in between them and the Pokémon they wish to catch.

Rec Room has already announced support for the Apple Vision Pro upon release, and Resolution Games made a recent announcement that they will support the Apple Vision Pro as well with one of their games called Demeo as one of the first spatial computing games that will debut when the Vision Pro launches next year. Gaming just seems like a natural fit for this progression in the way we engage with computing.

Human resources

Recruiting and HR is another area that has been using spatial computing. The Dan Marino Foundation is an example of a nonprofit that has used spatial computing to help neurodivergent students prepare for an interview. Instead of using poorly produced videos and outdated slide decks, they turned to spatial computing to help neurodivergent job candidates prepare for interviews.

The scenarios the candidates experienced ranged from friendly to hostile interviewers, and during the process, educators were able to track candidates’ responses, eye contact, body language, and engagement during the interview training. Plus, the students were able to practice in the physical world seeing a virtual interviewer in front of them. It allowed them to practice the interview process, work on eye contact, and deliver their answers so that when they got to the job interview with a human interviewer, some of their social anxiety might be reduced and they would be better prepared. Close to 72% of the foundation’s neurodivergent students who tried this training found employment. Compare that to national averages that indicate that more than 80% of adults with autism are unemployed.

Media, sports, and entertainment

AT&T knows that spatial computing will require new networking speeds like 6G. The company’s CTO, Andre Fuetsch, described new technologies like “volumetric spectrum sharing and efficiency” are needed to make 6G a reality. Magic Leap partnered with AT&T in 2020 to create in-store experiences for Game of Thrones’ The Dead Must Die: A Magic Leap Encounter. The physical space looked like King’s Landing, but when visitors put on the Mag Leap One, it turned into an icy scene where they would have to fight a virtual White Walker in the physical world.

In 2023, Apple and Disney announced a Disney+ app for Apple’s Vision Pro. Additionally, when Apple acquired NextVR in 2020, they signaled a focus on immersive sports experiences in the future. The way that we experience movies, TV, sports, and entertainment in general is impacted by our mobile phones. Now, think about how spatial computing will once again change our content viewing habits.

Data visualization

Data visualization is a clear use case for spatial computing. Even though designers create 3D prototypes with 3D design tools, they still have to show them on 2D screens instead of trying to read graphs or update dashboards to view data in context to the physical environment. BadVR does this with their product SeeSignal, which uses spatial computing to visualize cellular dead zones. Instead of carrying multiple pieces of equipment and reading a heat map, operators can use a headset to see in real time and real space where dead zones are.

Finding the Business Value of Spatial Computing

It’s easy to see why the business world has yet to start taking spatial computing seriously when generative AI has taken over the headlines and VC investments. Still, spatial computing offers some initial glimpses into how it will be useful today and what the potential business will be in the next decade. It is important to point out that current XR headsets already have AI, but the confluence of all advancements in technology makes the use of improved spatial computing technology using new breakthroughs in AI a revolutionary happening.

A recent Tweet (X Post) from Andrew Schwartz, Director of Metaverse Engineering at Nike, points out why spatial computing could be transformative. “If the organizing principle of the internet is that information wants to be shared, and the organizing principle of the metaverse is that information wants to be experienced, spatial computing brings together the tools necessary to create those experiences,” he wrote.

Spatial computing is a natural evolution of the way we use and experience technology. It can create new interfaces and ways of interacting with people. Companies will need to take spatial computing seriously, maybe not today, but in the next decade, because it will change how people interact, especially as spatial computing starts to come into our lives, much in the way that phones came into our lives and changed the way we interacted with each other and with our work. It has the potential to fundamentally change how people think about computing, from collaboration between co-workers, to supporting creativity and optimizing business processes.

The world is continually transforming into a blended physical and virtual one. Younger generations are growing up used to digital assistants, online video games, and augmented social media. They’re the next generation of customers, employees, and owners. Investing in spatial computing not only assists with business’ pain points today but sets them up for the future.

Employees uplevel their work when technology adapts to make sense for the person, not the person needing to make sense of the technology. Spatial computing isn’t a virtual escape. It’s not a fad technology. It’s the natural next step for how computers and humans will interact. We are still in the early stages spatial computing. Still, all signals point to a transformation as powerful as the one we experienced with the coming of the internet and the advent of the mobile phone. We are in the very early days of how these new interfaces that will change business and society in the years to come.

Quelle:

Foto: HBR Staff/Damir Khabirov/ Andriy Onufriyenko/Getty Images

https://hbr.org/2023/11/what-leaders-need-to-know-about-spatial-computing

1. Januar 2024 0 comment

Examples

6 Spatial Computing Trends to Watch in 2024

Emerging trends in the world of spatial computing

Spatial computing trends, and the trends influencing both the extended reality landscape and metaverse ecosystems are closely connected. While spatial computing isn’t an entirely new concept, major market leaders like Apple believe it will shape the future of our digital interactions.

Offering a way to blend computing systems with the physical world in a more natural, interactive way, spatial computing could impact virtually every industry. We’re already seeing aspects of spatial computing emerge in everything from collaborative platforms like Microsoft Teams to smartphones.

With a projected value of $544.6 billion by 2032, it’s safe to say the spatial computing industry is growing. The question is, which trends will influence the solutions of the future?

1. Advancements in Hardware and Wearables

Spatial computing solutions rely on a combination of intuitive hardware and powerful software. One of the major spatial computing trends we’ll see in the years ahead revolves around developing more advanced hardware. This includes the development of more comfortable, lightweight, and powerful wearable headsets, like the impeding Apple Vision Pro.

Products like the Vision Pro combine virtual and mixed reality experiences in a single, adjustable headset to give users new ways of interacting with digital content. It’s not just wearable hardware that’s evolving, either. Increased interest in spatial computing is leading to the development of more advanced sensors for hand/eye tracking and IoT connectivity.

Plus, we’re seeing a rise in the development of XR-focused chips designed to power spatial computing systems. Even the cameras and processors in these innovative tools are becoming smaller and more powerful.

2. Spatial Computing Trends: Dedicated Software and Tools

Just as vendors are producing more advanced hardware for the spatial computing landscape, the software used to power these systems is evolving, too. When announcing its new Vision Pro spatial computing device, Apple also introduced “visionOS.” According to the company, this is the first dedicated spatial operating system introduced to the XR market.

Apple has since embedded aspects of spatial computing software into its iOS ecosystem, too. However, it’s not the only company experimenting in this area. Rokid recently launched a dedicated AR studio spatial computing platform. This allows users to create more advanced spatial experiences for the augmented reality landscape, with hand gesture recognition and spatial audio.

Foremost cloud leaders like AWS and Microsoft offer access to spatial computing solutions, such as Amazon Sumerian, for 3D scene creation. There’s also Azure’s Mixed Reality service kit, which provides tools for remote rendering, advanced spatial mapping, and object anchoring.

3. Evolving Interaction Options

One of the core benefits of spatial computing is that it allows users to interact with computer systems and content more naturally. To do this, the ecosystem uses sensors to track movement in various ways. We’ve already seen the impact of evolving hand and eye-tracking tools in the market.

These solutions can support everything from hands-free interaction with content to foveated rendering. However, as technology evolves, spatial computing trends pave the way for even more advanced tracking capabilities.

For instance, Ultraleap’s innovations in the hand-tracking world allow the software to monitor everything from your knuckles to your fingertips. Meta is in the process of developing full-body tracking software for its Quest devices and future metaverse strategies. Companies like Unity also create tools to make eye and gaze tracking more accurate.

4. Spatial Computing Trends: Connectivity

When examining spatial computing trends, it’s worth remembering that it isn’t a single technology. It’s a term that refers to a wide range of solutions that improve our interactions and experiences with machines. Many of these solutions, from AI to XR software, require significant computing power.

To minimize lag and ensure the accessibility of spatial experiences, companies are investing in more advanced connectivity options. For instance, NVIDIA’s CloudXR 4.0 platform enables developers to create comprehensive cloud platforms with 5G mobile compute edge connectivity.

XR Cloud streaming solutions and access to 5G connectivity will enable companies to create and use more powerful spatial computing experiences with less expense. This could pave the way for more companies of all sizes to adopt the technology in the years ahead.

5. Increased Adoption and New Use Cases

Like many XR concepts, spatial computing was initially seen primarily as a solution for the entertainment and gaming landscape. However, as companies continue to invest in immersive technologies for collaboration, creativity, and productivity, that’s beginning to change.

Apps designed to create spatial workspaces for remote and hybrid teams are becoming more advanced. Spatial computing technologies are also becoming an essential component of the industrial metaverse and manufacturing industries.

In these landscapes, spatial computing tools can give employees real-time guidance on the field, helping them to rapidly repair products and machines through AR content mapped to specific components. The same tools can help power immersive product development through digital twins and IoT. There are even companies using spatial computing to assist with boosting the success rate of surgeries in the medical space.

6. Evolving Opportunities for Immersion

While there’s more to spatial computing than virtual reality, many technologies focus on immersing users within a specific experience or situation. As a result, some of the top spatial computing trends are linked to the rise of immersive solutions.

For instance, spatial audio is becoming more common in the modern landscape. Companies like Apple are infusing spatial audio into their devices. Microsoft even creates spatial audio solutions for advanced meetings on Microsoft Teams.

Another immersive technology relevant to the world of spatial computing is haptic wearables. Haptic gloves, body suits, and similar tools simulate the feeling of actually touching a digital object. Although these solutions have seen limited adoption in recent years, that could change as new vendors enter the market with more affordable options.

The Latest Spatial Computing Trends

With major technology giants now going all-in on spatial computing, the market is set to experience significant growth. In the years ahead, vendors will continue to discover new ways of combining intuitive hardware and powerful software to change how we interact with machines.

These tools could pave the way for the future experiences we have not just in the metaverse but in the workplace, too.

Quelle:

6 Spatial Computing Trends to Watch in 2024

6. Dezember 2023 0 comment

Examples

5 Reasons to Invest in Spatial Computing Technology for 2024

The benefits of spatial computing technology

Spatial computing technology has played a role in the evolving XR and digital landscapes for some time. However, hype around the concept has recently increased, thanks to companies like Apple promoting their new “spatial computing system”: the Vision Pro.

Though still a relatively misunderstood concept, spatial computing has the power to shape the future of human and technology interaction. The term “spatial computing” refers to the wide variety of solutions that allow people to interact with computer systems in a more immersive format.

With spatial solutions, such as haptic feedback and computer vision, companies empower users to interact with digital content and tools like never before. If you’re interested in a future where computers and humans can work together synergistically, here are some reasons to consider investing in spatial tech.

The Reasons to Invest in Spatial Computing Technology

While it’s easy to see spatial computing as just another term for “extended reality,” the concept is much broader than you’d think. Spatial computing technology bridges the gaps between intelligent technologies, from IoT and digital twins to the metaverse, AI, and automation. This technology is currently growing in popularity at a CAGR of 20.4%.

1. Spatial Computing Technology Enhances User Experience

Perhaps the most apparent benefit of spatial computing technology is the ability to improve our experiences with computers and digital systems. With spatial technologies, users won’t have to rely on computer keyboards and XR controllers to convey instructions to machines.

Instead, we can navigate virtual and augmented environments using gestures and eye movements. We can use IoT sensors and tools to stream information directly to computer systems. We can even touch and interact with digital content, thanks to haptic feedback.

All of this leads to a more natural, organic experience whenever we interact with new technologies. In the business world, employees can interact with software and content intuitively, with minimal need for extra hardware. In the consumer world, we’ll discover a new variety of products designed to make us safer and more productive. For instance, spatial computing is one of the core concepts driving the development of autonomous cars.

2. Spatial Solutions Will Transform Education

Technologies linked to spatial computing, such as extended reality and artificial intelligence, are already impacting how we share and develop knowledge. Companies in every industry are beginning to embrace XR training landscapes. These environments allow businesses to create realistic simulations of scenarios for a more interactive, immersive learning experience.

Advancements in spatial computing technology will only make simulated training and education more impressive. They’ll allow people to practice actions, like performing surgery or repairing a machine, without using buttons and controllers. This promotes the development of muscle memories.

Spatial computing solutions can create adaptive learning paths for students, adjusting content based on an individual’s progress and skill level. With integrated tools for communication and AI, companies can even provide feedback to employees in real-time as they learn.

3. Spatial Computing Drives Productivity and Innovation

Like extended reality, the capabilities of spatial computing are quickly capturing the attention of businesses looking to innovate and evolve. Already, companies in the industrial and manufacturing landscape are using 3D visualization and digital twins to enhance product design strategies. With these tools, companies can experiment with new concepts without limitations.

In the manufacturing world, spatial computing systems can also help bridge the gaps between various systems, people, and processes. For instance, a worker can program a robotic arm using an AR interface and then use tools to control the technology from a distance remotely.

Spatial solutions can even utilize IoT, AI, and automation, allowing companies to rapidly fix problems with machinery, implement repairs, or mitigate issues. These solutions pave the way to a more productive and efficient workforce where machines and humans work collaboratively.

4. Spatial Tools Transform Immersive Collaboration

The rise of new, more affordable, and accessible XR technologies has paved the way for a future of immersive collaboration. Even as businesses drive employees back into the traditional workplace, there’s still a need to bridge the gap between various workers. Hybrid, remote, field, and global employees need to be able to connect in an environment that facilitates collaboration.

Spatial computing technology can help to immerse team members in a more productive environment for a range of tasks. Companies can place employees in a virtual environment where everyone can interact with products, work together on creative ideas, and share knowledge.

Spatial solutions can also provide employees on the move with access to support from subject matter experts and supervisors. Innovative tools, like the Qualcomm spatial computing platforms, can merge physical and digital environments in real time. Teams could even use these tools to train and onboard new employees working in the field.

5. Spatial Computing Technology will Upgrade Customer Service

Finally, investing in spatial computing technology can help businesses in all industries to deliver a new level of customer support and service. In the retail landscape, spatial computing allows companies to support customers through their sales journey, offering personalized insights. Brands can even offer immersive onboarding sessions and teach users how to use new products.

In the tourism and hospitality industries, spatial computing solutions can provide helpful information and context to consumers. For instance, museums could augment physical environments with information about each display’s history and origins.

Even in the healthcare landscape, spatial technologies are changing how professionals serve and support patients. Surgeons embrace extended reality and spatial computing technologies to visualize complex patient anatomies, plan surgical procedures, or deliver remote guidance.

Investing in the Future of Spatial Computing Technology

While spatial computing technology isn’t an entirely new concept in the tech world, it’s currently making waves. Transformations in AI, connectivity solutions, and extended reality have paved the way for a new generation of spatial computing opportunities.

Used correctly, spatial solutions can shape the future of the metaverse, digital experiences, and even the modern workforce.

Quelle:

5 Reasons to Invest in Spatial Computing Technology for 2024

27. November 2023 0 comment

Examples

Comparing Spatial Computing Solutions in 2024

How to choose a spatial computing solution in 2024

patial computing solutions are capturing significant attention in today’s world.

Innovators in this landscape promise a future where interacting with computers and digital content will feel natural, intuitive, and fully immersive. Although spatial technology has existed for some time, companies like Apple have spawned new interest.

They believe spatial solutions, combining XR, AI, IoT sensors, and more will shape the future of the digital and physical world. As a result, the spatial computing market is growing, set to reach an incredible $544.6 billion by 2032.

So, if you want to be part of the spatial revolution, how do you compare the market and find the right vendor? Here’s a step-by-step guide for success.

Step 1: Understand the Principles of Spatial Computing

The first step in comparing spatial computing solutions is understanding what “spatial computing” means. Spatial computing isn’t just another word for an XR headset or experience. It’s an umbrella term referring to various technologies influencing how we interact with computer systems.

This includes XR headsets, sensors, artificial intelligence software, and cloud technology. To invest in a complete spatial computing solution, you’ll need tools that support:

Sensing: The ability of computers to sense the environment around us is a crucial part of spatial computing. Sensors use IoT technology and can be built into everything from standalone systems to wearable headsets and smartphones.
Data decoding: Spatial computing solutions need to understand our actions and decode the instructions we give through gestures, speech, and more. This requires the use of artificial intelligence and machine learning algorithms.
Interactivity: The key to spatial computing is ensuring you can interact with digital content and computer systems as intuitively as possible. This is where headsets, haptic feedback tools, cameras, and microphones come in.

Step 2: Define Your Spatial Computing Use Cases

Once you understand how spatial computing works, the next step is to identify how you want to use the technology. Some spatial computing solutions are designed specifically for enterprise environments and immersive collaboration. Tools like the Apple Vision Pro, combined with a collaboration tool like Microsoft Teams, link the real world to digital content. This paves the way for a more meaningful, powerful session between teams.

However, there are many different use cases for spatial computing. In the industrial metaverse and manufacturing, spatial computing solutions can help with product design and improve user safety. Companies can even use smart glasses to send instructions to field workers or IoT devices to control machines from a distance remotely.

In the healthcare landscape, spatial computing solutions can create anatomy maps for surgeons or offer unique ways to train new professionals in complex skills. Knowing what your use cases are will help to inform your decisions in the next step.

Step 3: Know your Hardware and Software Needs

As mentioned, spatial computing solutions aren’t just a single app or device. The term refers to many different technologies and tools which work together to improve human/machine interaction. If you’re investing in spatial computing experiences, you’ll need to define your requirements:

Hardware: Spatial computing hardware can cover everything from the computer systems you need to access or mobile devices to wearable headsets (MR, VR, and AR), sensors, and even processing chips for hardware development.
Software: From a software perspective, you’ll need to think about everything from solutions designed to help you build metaverse experiences to digital twin technologies. You might also need to work with developers to create unique experiences.
Accessories: Accessories in the spatial computing space can include haptic gloves, spatial sound systems, cameras for collaboration, and microphones.

Step 4: Consider Interactivity and Immersion

The focus of spatial computing solutions is on improving the way people interact with machines. However, the interactivity options available from different vendors and systems can vary. Some organizations focus heavily on hand tracking. For instance, Ultraleap offers state-of-the-art hand-tracking tools to monitor even minute movements at your fingertips.

Other brands leverage eye tracking to help enhance user experiences in the extended reality world and even offer functionality like foveated rendering. Spatial computing systems can also respond to gestures and even voices through AI algorithms.

Alongside considering how you’ll interact with your spatial technology, it’s also worth thinking about how you can deepen the immersion for users. Spatial audio is an excellent way to engage more of the senses, particularly in an XR environment.

Step 5: Address Connectivity for Spatial Computing Solutions

One of the significant challenges in implementing spatial computing solutions is managing the demand these tools impose on bandwidth and data. AI, extended reality technologies, and IoT solutions all rely on a significant amount of computing power. Many smaller businesses will struggle to build and implement a comprehensive solution in-house with their data centers.

Fortunately, new solutions are beginning to emerge. For instance, the NVIDIA CloudXR 4.0 platform empowers developers to use advanced cloud streaming solutions. Like other leading solutions, this ecosystem offers access to 5G and cloud-edge connectivity.

When comparing spatial computing solutions, make sure you know how much computing power they need and how you can manage the demand. If you’re building an experience from scratch, consider looking into Metaverse as service opportunities.

Discovering the Best Spatial Computing Solutions

Spatial computing solutions combine the virtual and physical worlds seamlessly, transforming our interactions with technology. Countless companies are beginning to explore this landscape, from Microsoft and Apple to Unity and Magic Leap.

The key to choosing the right solution for your needs will be extensive research. Learn about the potential of spatial computing and define your use cases. Then, look for vendors and innovators who can help you overcome the challenges in this realm.

Working with market leaders who can help you address everything from VR sickness, to the complexity of building metaverse experiences will pave the way for rapid adoption.

Quelle:

Comparing Spatial Computing Solutions in 2024

21. November 2023 0 comment

Knowledge Research

VisionDevCamp To Jumpstart Apple Vision Pro Developers In Early 2024

Shortly after Apple Vision Pro launch in early 2024 developers will gather for VisionDevCamp to work on app ideas for the new headset.

Long-time AR developer Raven Zachary has been working with others to organize iPhone developer hackathons since 2007. Now, he’s turned his sights to helping jumpstart spatial computing apps on Vision Pro with VisionDevCamp. The event is unaffiliated with Apple and will be held in the San Francisco area shortly after the U.S. launch of Apple Vision Pro early in 2024.

„In 2007, we organized iPhoneDevCamp to celebrate the launch of Apple’s new platform. In 2024, we’ll be staying true to this core focus for Apple’s newest platform and first spatial computer,“ Zachary told UploadVR. „The first year with a new development platform is always exciting, and we expect that excitement will be contagious at the event.“

Hundreds attended the first iPhoneDevCamp in July 2007, just a week after the U.S. launch of iPhone during a time when Apple only offered developers the option of making Web apps for the device. As Apple’s new development platform took shape in 2008 and beyond, the dev camp series grew too with iPadDevCamp and iOSDevCamp. Organizers say apps like Square, TestFlight, and Barack Obama’s 2008 election year app got their start at these events.

Registration isn’t open yet for VisionDevCamp, but there is a notification sign-up for when registration starts and also a Discord server to connect with others about the event.

„VisionDevCamp is a not-for-profit developer event focused on creating applications for Apple Vision Pro and visionOS,“ an announcement page explains. „Attendees are encouraged to develop native visionOS, Unity PolySpatial, and web applications during the event.“

Apple released its software development kit for Vision Pro in June and developers are currently building for the system using a visionOS simulator. Apple CEO Tim Cook confirmed in September that the headset is still on track to ship early in 2024.

Quelle:

https://www.uploadvr.com/visiondevcamp-vision-pro-developer-event-2024/

20. November 2023 0 comment

Examples

6 Spatial Computing Trends to Watch in 2024

Emerging trends in the world of spatial computing

With a projected value of $544.6 billion by 2032, it’s safe to say the spatial computing industry is growing. The question is, which trends will influence the solutions of the future?

1. Advancements in Hardware and Wearables

2. Spatial Computing Trends: Dedicated Software and Tools

3. Evolving Interaction Options

4. Spatial Computing Trends: Connectivity

5. Increased Adoption and New Use Cases

6. Evolving Opportunities for Immersion

The Latest Spatial Computing Trends

These tools could pave the way for the future experiences we have not just in the metaverse but in the workplace, too.

Quelle:

6 Spatial Computing Trends to Watch in 2024

14. November 2023 0 comment

Knowledge Research

Spatial Computing: Was VR und AR verändern werden

Spatial Computing, XR oder Metaverse: Egal, wie man es nennt, die Technologie wird das, was wir bisher als Realität kennen, drastisch verändern.

Steve Jobs soll als Führungskraft recht schwierig gewesen sein – und auch kein begnadeter Techniker. Doch wenn der legendäre Apple-Chef seine Technik-Visionen anpries, musste man ihm einfach glauben, dass die Zukunft mit diesem oder jenem Gerät eine bessere wird. Seine Kritiker sprachen von einem „Realitäts-Verzerrungs-Feld“, das Jobs umgab. Jetzt will Apple eine Realitäts-Verzerrungs-Maschine auf den Markt bringen: die Vision Pro.

Sie sieht auf den ersten Blick kaum anders aus als ein gewöhnliches VR-Headset. Aber sie ist weit mehr als das. Glaubt man den Produkt-Ankündigungen des Konzerns, wird die Brille ein Versprechen einlösen, das Techniker und Entwickler seit mehr als 20 Jahren geben: Die Brille soll ihren Trägern das nahtlose Verschmelzen der Realität mit virtuellen, im Computer erzeugten Objekten ermöglichen. Verschiedene Realitäten werden ineinander verschwimmen, ein Wechsel zwischen ihnen wird mühe- und stufenlos. Einfach an einem kleinen Rädchen der Brille drehen, und schon wird die Zimmerdecke zum wolkenverhangenen Himmel.

Apple nennt das Bedienkonzept der Brille „Spatial Computing“ – vermutlich, um sich von den enttäuschten Erwartungen rund um Virtual- und Augmented Reality abzugrenzen. Denn in diesem Begriff, der (mindestens) 20 Jahre alt ist – 2003 taucht er in einer Masterarbeit des MIT-Studenten Simon Greenwold zum ersten Mal auf –, steckt mehr als das Spiel mit virtuellen oder ergänzten Realitäten. Greenwold definiert Spatial Computing als „die Interaktion des Menschen mit einer Maschine, bei der die Maschine Bezüge zu realen Objekten und Räumen beibehält und manipuliert“. Das klingt abstrakt, ist aber vor allem für die Entwickler von User-Interfaces eine spannende Idee: Denn um Menschen die Bedienung von Computern zu erleichtern, mussten Schnittstellen-Entwickler bislang zu Hilfsmitteln greifen.Immer mehr Wissen.Das digitale Abo für IT und Technik.

…

Quelle:

https://www.heise.de/hintergrund/Spatial-Computing-Was-VR-und-AR-veraendern-werden-9310471.html

27. September 2023 0 comment

Examples

Wie könnte Spatial Computing und Erfahrungsbasiertes Lernen zusammengedacht werden?

Erfahrungsbasiertes Lernen

Erfahrungsbasiertes Lernen ist eine Lernmethode, die davon ausgeht, dass Lernen am effektivsten ist, wenn es auf realen und praktischen Erfahrungen basiert, anstatt lediglich auf theoretischen Informationen.

Erfahrungsbasiertes Lernen betont somit die Bedeutung der direkten Erfahrung und Reflexion im Lernprozess und erkennt an, dass Lernen oft am besten geschieht, wenn es in einem realen oder simulierten Kontext stattfindet, der für den Lernenden relevant und bedeutsam ist. Es geht davon aus, dass das Lernen sowohl ein persönlicher als auch ein sozialer Prozess ist und dass Reflexion ein kritischer Bestandteil dieses Prozesses ist.

Dieses Konzept wurde von mehreren Pädagogen und Theoretikern vorgeschlagen und entwickelt, am bekanntesten ist wahrscheinlich David Kolb.

David Kolb hat ein Vier-Phasen-Modell des erfahrungsbasierten Lernens vorgestellt, das so funktioniert:

Konkrete Erfahrung: In dieser Phase macht der Lernende eine neue Erfahrung oder begegnet einer ungewohnten Situation.
Reflektierendes Beobachten: Nachdem er die Erfahrung gemacht hat, reflektiert der Lernende darüber und versucht, die Erfahrung aus verschiedenen Blickwinkeln zu betrachten.
Abstrakte Begriffsbildung: Auf Basis der Reflexion versucht der Lernende, das Gelernte zu konzeptualisieren und Theorien oder Modelle darüber zu entwickeln.
Aktives Experimentieren: Schließlich wendet der Lernende das, was er gelernt und konzeptualisiert hat, in neuen Situationen an, was wiederum zu neuen konkreten Erfahrungen führt.

Diese vier Phasen sind zyklisch und können immer wieder durchlaufen werden, wodurch der Lernende seine Kenntnisse und Fähigkeiten weiter vertieft und verfeinert.

Es gibt verschiedene Ausprägungen des erfahrungsbasierten Lernens, darunter:

Praktikum: Lernende arbeiten in realen Arbeitsumgebungen, um praktische Erfahrungen zu sammeln.
Service-Learning: Lernende engagieren sich in gemeinnützigen Projekten oder Dienstleistungen und reflektieren über ihre Erfahrungen.
Studienreisen: Durch Reisen in andere Kulturen oder Umgebungen erhalten die Lernenden direkte Erfahrungen, die ihr Verständnis für bestimmte Themen vertiefen können.
Simulationen und Rollenspiele: Lernende nehmen an simulierten Aktivitäten teil, die realen Situationen nachempfunden sind.
Projektbasiertes Lernen: Lernende arbeiten an konkreten Projekten, oft in Teams, um ein Problem zu lösen oder ein Produkt zu erstellen.

Spatial Computing

Spatial Computing bezieht sich auf Technologien, die die physische Welt mit digitalen Daten und Umgebungen verschmelzen lassen. Es umfasst Augmented Reality (AR), Virtual Reality (VR) und Mixed Reality (MR). Wenn man überlegt, wie Spatial Computing die verschiedenen Ausprägungen des erfahrungsbasierten Lernens unterstützen kann, eröffnen sich zahlreiche Möglichkeiten

Kombination Spatial Computing und erfahrungsbasiertes Lernen

Spatial Computing und erfahrungsbasiertes Lernen können auf mehrere innovative Weisen kombiniert werden, um das Lernen zu verbessern, personalisieren und realitätsnäher zu gestalten.

Die Kombination von Spatial Computing und erfahrungsbasiertem Lernen bietet eine Fülle von Möglichkeiten, das Lernen interaktiver, personalisierter und effektiver zu gestalten. Durch den Einsatz moderner Technologie können Lernende in Umgebungen eintauchen, die sowohl lehrreich als auch fesselnd sind.

Mehrwerte der Kombination:

Immersive Umgebungen: Spatial Computing kann immersive, dreidimensionale Umgebungen erstellen, in denen Lernende realitätsnahe Erfahrungen sammeln können. Dies kann besonders wertvoll sein in Bereichen wie Medizin, Bauingenieurwesen oder Physik, wo realistische Simulationen von Verfahren oder Prozessen zum Lernen eingesetzt werden können.
Interaktive Lernpfade: Erfahrungsbasiertes Lernen erfordert oft, dass Lernende eigene Wege gehen und Entscheidungen treffen. Spatial Computing kann Umgebungen bieten, in denen Schüler verschiedene Lernpfade erkunden und die Konsequenzen ihrer Entscheidungen in Echtzeit erleben können.
Gruppenarbeit und Zusammenarbeit: Spatial Computing ermöglicht es mehreren Nutzern, sich in einem gemeinsamen virtuellen Raum zu treffen. Dies kann genutzt werden, um Teamarbeit und kollaboratives Lernen zu fördern, wo Teams zusammen Projekte in einer virtuellen Umgebung durchführen können.
Echtzeit-Feedback: Durch die Kombination von KI und Spatial Computing können Lernende sofortiges Feedback zu ihren Aktionen und Entscheidungen in der virtuellen Umgebung erhalten, was den Lernprozess beschleunigt.
Adaptives Lernen: Mithilfe von KI und Datenanalyse kann die Lernerfahrung individuell angepasst werden. Je nach Fortschritt und Vorlieben des Lernenden kann die virtuelle Umgebung angepasst werden, um den Lernbedürfnissen gerecht zu werden.
Integration von physischen und virtuellen Elementen: Spatial Computing kann auch Augmented Reality (AR) nutzen, um physische und virtuelle Elemente miteinander zu kombinieren. Dies ermöglicht es den Lernenden, mit physischen Objekten in einer durch AR erweiterten Umgebung zu interagieren, was besonders nützlich für Fächer wie Biologie, Chemie oder Kunst sein kann.
Zugänglichkeit und Inklusion: Spatial Computing kann Lernerfahrungen für Menschen mit unterschiedlichen Bedürfnissen und Fähigkeiten anpassen. So können beispielsweise hör- oder sehbehinderte Personen durch angepasste virtuelle Umgebungen unterstützt werden.

Auswirkungen auf die Rolle des Trainer*in/Lernenden

Um die Veränderungen durch den Einsatz der neuen Möglichkeiten genaueer zu verstehen, müssen wir uns die Beteiligten im Lernprozess einmal genauer ansehen. Aus Trainer*in und Lernenden Perspektive könnten so Auswirkungen zu berücksichtigen sein:

Trainer*in-Sicht

Erfahrungsbasiertes Lernen erlaubt mir, Theorie und Praxis auf eine Weise zu verbinden, die traditionelle Lernmethoden oft nicht bieten können. Durch das direkte Anwenden und Erleben von Konzepten im echten Leben oder in simulierten Umgebungen kann ich mein Verständnis vertiefen und die Relevanz des Gelernten in realen Kontexten erkennen. Es verändert das Lernen von einem passiven Prozess des „Aufnehmens“ von Informationen zu einem aktiven Prozess des „Tuns“ und „Reflektierens“.

Auswirkungen auf den Trainer*in-Rolle aus Sicht des Lerners

Vom Lehrer zum Begleiter: Statt lediglich Inhalte zu präsentieren, wird der Trainer eher zu einem Begleiter oder Mentor. Er unterstützt und leitet den Lernprozess, anstatt ihn zu dominieren.
Aktives Zuhören: Der Trainer wird mehr Zeit damit verbringen, den Lernenden zuzuhören, ihre Erfahrungen und Erkenntnisse zu verstehen und sie entsprechend zu leiten.
Flexibilität: Da erfahrungsbasiertes Lernen oft unvorhersehbare Lernpfade und Ergebnisse mit sich bringt, muss der Trainer flexibel und adaptiv sein, um auf die Bedürfnisse und Entdeckungen der Lernenden reagieren zu können.
Bewertungsmethoden: Traditionelle Prüfungen und Tests könnten weniger relevant werden. Stattdessen könnte der Schwerpunkt auf Projektbewertungen, Reflexionsaufsätzen oder anderen Formen der Beurteilung liegen, die die praktischen und reflexiven Aspekte des Lernens hervorheben.
Ständiges Lernen: Um im erfahrungsbasierten Lernen effektiv zu sein, muss der Trainer ständig lernen und sich weiterentwickeln, um den sich ständig ändernden Bedürfnissen und Interessen der Lernenden gerecht zu werden.

Aus Lernenden-Sicht

Die Möglichkeiten bieten, das Lernen durch direkte Erfahrung, Interaktion und Immersion zu vertiefen und zu bereichern. Es ermöglicht mir, über die Grenzen des traditionellen Trainings hinauszugehen und neue, spannende und oft unerreichbare Welten des Wissens zu erkunden. Folgende Punkte sehe ich als Lernenden sehr hilfreich:

Immersion: VR bietet ein höchst immersives Erlebnis. Das Eintauchen in eine virtuelle Umgebung kann das Lernen intensiver und fesselnder machen, insbesondere bei komplexen oder schwer zu verstehenden Themen.
Interaktivität: In einer VR-Umgebung kann ich mit Objekten interagieren, Experimente durchführen oder verschiedene Szenarien durchspielen. Dies ermöglicht ein hands-on Lernen, das mir hilft, Konzepte besser zu verinnerlichen.
Sichere Simulation: In VR kann ich Situationen simulieren, die in der realen Welt gefährlich, teuer oder einfach nicht umsetzbar wären. Das erlaubt mir, in einer sicheren Umgebung zu experimentieren und zu lernen.
Globale Zusammenarbeit: VR ermöglicht es mir, mit anderen Lernenden aus der ganzen Welt in einer gemeinsamen virtuellen Umgebung zu interagieren und zusammenzuarbeiten.
Personalisiertes Lernen: Viele VR-Lernanwendungen bieten personalisierte Lernerfahrungen, die sich an mein Tempo und meinen Lernstil anpassen.
Emotionale Verbindung: Durch das Erleben von Geschichten oder Situationen in VR kann ich eine tiefere emotionale Verbindung zum Lernmaterial herstellen, was das Erinnern und Verstehen fördert.
Zugang zu unerreichbaren Orten: Mit VR kann ich Orte besuchen, die ich sonst nie erleben könnte, sei es die Spitze des Mount Everest, das Innere einer Zelle oder eine Reise durch das Sonnensystem.
Engagement: Die fesselnde Natur von VR kann dazu beitragen, meine Motivation und mein Engagement für das Lernen zu steigern.

Zusammenfassung

Spatial Computing und erfahrungsbasiertes Lernen ergänzen sich, um Lern- und Arbeitsumgebungen zu revolutionieren. Spatial Computing ermöglicht immersive, realitätsnahe Simulationen, die die konkrete gefordertet Erfahrung nach dem erfahrungsbasiertes Lernen verstärken. Diese Technologie fördert somit eine tiefere Reflexion durch die unmittelbare Visualisierung komplexer Daten und Szenarien. Teams können in einer digitalen Umgebung zusammenarbeiten, wodurch der reflektierende Beobachtungsteil des erfahrungsbasiertes Lernen erleichtert wird. Das schnelle Prototyping und die Echtzeitsimulationen unterstützen die abstrakte Konzeptualisierung und das aktive Experimentieren. Die Integration von KI bietet adaptive Unterstützung, fördert personalisierte Lernerfahrungen und optimiert den Problemlösungsprozess.

Für mich ist Lernen am effektivsten, wenn es persönlich und relevant ist. Erfahrungsbasiertes Lernen ermöglicht genau das. Es gibt mir die Möglichkeit, meine eigenen Lernerfahrungen zu gestalten, zu experimentieren, Fehler zu machen und daraus zu lernen. Diese Methode fördert die Eigenverantwortung und hilft mir, kritische Denkfähigkeiten, Problemlösungskompetenzen und praktische Fähigkeiten zu entwickeln, die für die reale Welt unerlässlich sind.

Mehr Informationen hier.

Quelle

Torsten Fell

30. August 2023 0 comment

Examples

What Apple Vision Pro Means for Enterprise

After years of speculation and delays, Apple revealed its first XR device yesterday. Apple Vision Pro is a highly impressive first-generation headset that appears to seamlessly blend the real and digital. Here are some observations and first thoughts on what Apple’s headset could mean for enterprises.

APPLE’S VISION: “The era of spatial computing is here.”

Noticeably absent from WWDC 2023 was any mention of the words Metaverse, mixed reality, or virtual reality. Instead, Apple uses “spatial computing” to refer to what most call XR or extended reality.

Nevertheless, Vision Pro is a mixed reality device that’s capable of full immersion (VR). In the keynote, Apple primarily positions Vision Pro as an augmented reality headset, which accords with Tim Cook’s views about AR versus VR. Vision Pro’s EyeSight feature reflects what Cook dislikes about VR–that it’s an isolating experience. With Vision Pro, though, “you see your world and everything in it.”

‍

INTRODUCING THE MASSES TO SPATIAL COMPUTING: “A stunning new way to use the apps we love.”

Thus far, XR has struggled to convey its value to consumers. In yesterday’s presentation, Apple stressed the ability to bring your favorite apps into your space. Freeing apps “from the boundaries of a traditional display” isn’t a new pitch for XR, but coming from Apple – the apps in question being familiar iPhone and iPad apps and building upon the continuity of Apple devices – it may finally ‘hit home.’

‍

AESTHETICS

As others have already noted, Vision Pro looks like a pair of ski goggles. The headset may be sleek and lightweight with its curved glass front and aluminum alloy frame, but I was expecting something smaller in size.

The headset mask or Light Seal appears soft and cushiony, while the changeable strap or Head Band is “3D knitted” for breathability and stretch. Apple says both can flex to fit a variety of face shapes and head sizes. The headband will come in three sizes for a more custom fit, and I can see additional sizes and styles becoming available in the future enabling further customization and perhaps additional use cases.

Apple also went with a separate battery to keep Vision Pro as light as possible. A “woven cable” running from the back of the headset to the battery pack is rather unseemly, and with just two hours of battery life, a tethered experience is necessary for extended use. This may not be an issue for users who stand at a desk for much of the day (see below); however, storing the battery in your pocket as shown could be problematic for women.

A modular design, by the way, isn’t new: Both RealWear and Vuzix offer a variety of headbands and mounting options for their AR glasses to accommodate different use cases. The different band sizes and flexible materials of Vision Pro, though, feel new. ‍

SPECS

Price and availability: Vision Pro will start at $3,499 and launch sometime early next year.

visionOS: Apple’s new operating system for the Vision Pro, which adds a “real-time subsystem” for processing interactive visuals.

Dual-chip design: Uses the M2 and R1. R1 is a new Apple chip designed to eliminate lag. According to Apple, R1 processes images “8 times faster than the blink of an eye.”

Display: From what we’ve seen, Vision Pro delivers incredible clarity thanks to dual 4K micro-LED displays with a total of 23 million pixels.

23 built-in sensors: 12 cameras (including Apple’s first 3D camera), 5 sensors, and 6 mics enabling eye tracking, hand tracking, and object tracking. Eye tracking also makes foveated rendering possible. (Our eyesight is sharpest at the center and blurrier at the periphery; foveated rendering mimics this to utilize less power.)

Input: Vision Pro is controller-free. Apple plans to rely entirely on gaze, gesture, and voice controls. From the video, gesture control appears very natural. The downward-facing exterior cameras are able to track your hands even if they’re resting low on the body (as opposed to pinching the air in front of you; see image below).

Privacy: Highly sensitive eye tracking data has been a cause of concern in VR. Apple directly addresses this with a new authentication system called OpticID, assuring users that “where you look stays private.”

EyeSight: This feature projects a live feed of the user’s eyes to the external display when someone is nearby. One of the disorienting aspects of VR is the disconnect from one’s surroundings. With EyeSight, “you’re not isolated from other people.” Alternatively, the headset glows when the user is in full VR.

More: Spatial audio; Unity support; active cooling; magnetic lenses by Zeiss for prescription wearers; dial to adjust the level of immersion.

THE REVEAL: Integrated into work and life

Even more than everyday consumers, Apple’s keynote seemed to target remote workers, showcasing Vision Pro as a kind of WFH gamechanger. “You can create the perfect workspace no matter where you are.”

‍WWDC marketed Vision Pro as a collaboration and work productivity toolespecially for people who work from home. We saw several individuals using the headset as a monitor and for video conferencing at home, at the office, in a hotel room, etc. To that end, you can connect your Mac by simply looking at it and pair the headset with Bluetooth accessories like Apple Magic Keyboard and Trackpad for a variety of work setups. Professional apps like Adobe Lightroom and Microsoft Office will also run natively on Vision Pro at launch.

‍
On FaceTime and other video calls, Vision Pro users will be represented by a Persona, essentially a realistic 3D avatar generated with face scans and a machine learning algorithm. According to Apple, your persona will show your true expressions (your real face and hand movements), while spatial audio will make it feel as if remote colleagues are in the room with you. Microsoft Teams, WebEx, and Zoom will also support Personas.

I’m excited to see what enterprise apps developers come up with for Vision Pro, especially how they make use of Environments (transform your workspace, employee wellbeing, training, marketing, etc.). The price point alone suggests that Apple counts on enterprises being among the first buyers or early adopters of the headset.

‍

FINAL THOUGHTS

If nothing else, Apple entering the XR space legitimizes immersive technologies amid growing doubts about AR/VR/the metaverse. Assuming the experience lives up to the video, Vision Pro is a stellar debut by Apple into a market that has struggled to take off. It is both a milestone and a much-needed push for the XR industry.

That being said, Vision Pro is just one more option for enterprises. There is no one XR headset today for all use cases. Every high-performance headset has its pros and cons. Every design decision comes with a trade-off (Vision Pro’s external battery is a good example), making it more important than ever to do your research and know the requirements of your use case in order to choose the right device for your business.

Quelle:

https://www.brainxchange.com/blog/what-apple-vision-pro-means-for-enterprise

12. Juli 2023 0 comment

Examples

Apple Vision Pro: The iPhone moment for spatial learning

This is a defining moment that validates the trailblazing work of all of us in the VR learning industry.

The future of “spatial learning” just arrived. Again.

The most valuable company on the planet unveiled the high-end aspirational virtual and augmented reality headset the industry needed and only Apple could deliver. Its iPhone magic is sure to ignite a fire in the industry, spurring a fresh wave of competition and innovation. With Apple joining the fray that Meta/Facebook has dominated, we’re likely to see Samsung and other contenders soon. If history is any guide, Apple enters any new product market just as it’s primed for widespread adoption. This is a defining moment that validates the trailblazing work of all of us in the virtual reality learning industry. We were not crazy after all. The future of learning really is spatial.

The “Apple Vision Pro” is not just named for its stunning visual display, but also for its pioneering vision-based user interface. Just glance at an icon and it highlights. Pinch your fingers in your lap to interact with it. This eye and “lazy finger gesture” combo seems destined to become the computer mouse of mixed reality. And Apple‘s fresh take extends to marketing and positioning. VR is now rebranded as “fully immersive experiences,” “headset” is “spatial computer,” avatars are “personas,” “AI” is “machine learning,” and “metaverse” is “environments,” all in an effort to reach a broader mass market and shed the baggage of earlier VR efforts.

As the $3,500 price point and “pro” name suggest, this is an enterprise device. Yet, there were no demos of factories or hospitals, digital twins or job simulators at the launch event. Instead, it featured people sitting on couches interacting with giant Excel and PowerPoint screens and talking to avatars floating around the room. Apple is focusing on office productivity and collaboration. If anyone can make people read emails and hold meetings Minority Report-style wearing a computer on their face, it would be Apple.

The Vision Pro is an augmented reality device that makes virtual objects appear in the physical world. Unlike HoloLens and Magic Leap which use transparent lenses, it uses front-facing cameras to beam a video view of the physical environment, similar to the Quest Pro and forthcoming Quest 3, yet with much higher resolution. It’s not designed for AR assistance out in the field. You wouldn’t want to operate hazardous equipment or perform surgery watching a live stream video of your surroundings. This is AR for the conference room, classroom and living room.

That’s not to say the Apple Vision Pro doesn’t excel at realistic job simulations. With display quality and pass-through cameras that rival the $6,000-plus PC-tethered Varjo headsets used by the military, Apple is setting the stage for hyper-realistic mixed-reality simulations.

Imagine overlaying a digital experience on physical mannequins for medical training or a real cockpit for flight training, blending tactile experiences of physical simulators with a diverse array of virtual scenarios. The Apple headset is equally well-suited for immersive VR simulations. Don’t get fooled by Apple’s “don’t say VR” rhetoric, this is a full-fledged VR headset that wraps around the eyes and creates a complete sense of presence in a virtual workplace. It even sports an Apple Watch-style crown to dial the level of VR immersion. With a simple twist, your real-world room can morph into an entirely virtual scene where experiential and visceral learning can take place.

Apple’s commitment to VR is evident in its partnership with Unity, the game engine that powers most VR training simulations. It will allow developers like my firm, the Gronstedt Group, to create training simulators in Unity and deploy them to both Quest and Vision.

As compelling as the Vision Pro sounds, the market leading Meta Quest still provides several benefits for training simulations:

Affordability: The $500 Quest 3 suddenly seems like an incredible bargain. Apple certainly has widely superior hardware, but with similar features, most companies will probably prefer seven Quest 3s for the price of one Vision Pro.
Shareability: The Apple headset is designed for a single user, just like the iPhone. Eyeglasses cannot fit inside, requiring a tailor-made prescription lens. In contrast, the Quest fits most glasses comfortably. And there is no word about an Apple enterprise platform with “kiosk mode” to share the headset with multiple users, as provided by Quest for Business. The $3,500 price tag would be chump change if a company could train thousands of people using a few shared headsets at self-serve stations, which is the predominant deployment method for VR training today. That will probably not be an option with Apple’s many customized features and account setup.
Controllers: Apple didn’t announce support for hand controllers that provide haptic feedback and the ability to grab objects and navigate larger virtual spaces. A vibration in the controller can go a long way to feel like you’re actually spraying your hands with antiseptics in our VR pharma labs. The thumbstick on the controllers allows HVAC giant Daikin’s customers to move around its giant heating units on a rooftop and watch them from every angle. Active hands-on simulations designed to build muscle memory might never be available for Vision Pro unless they support controllers.

The Apple Vision Pro is certainly over-priced and over-engineered. Apple has crammed so much technology into the headset that it requires a separate battery fanny pack, which only lasts a few hours. That’s the point though, Apple prototyped an optimal user experience for its developers. Apple’s vibrant developer community is its biggest competitive advantage and the primary target of this launch product.

The iPhone didn’t take off until Uber, Google Map and Facebook built “killer apps” that made people use the device in entirely new ways. Whereas Quest has 400 apps in its store, Vision Pro will debut with hundreds of thousands of existing Apple apps. This will include Microsoft Office, Slack, Zoom, Google Workspace and all other productivity apps presently in the Apple App Store. Most of those will initially be retrofitted 2D apps, it remains to be seen how well the app makers take advantage of the 3D space. This is a platform, not just a product. While Apple’s famed developer echo system will create content over the next several years, Apple will focus on shrinking the cost, size, and weight of the headset.

Meanwhile, competitors will draw inspiration from Apple’s novel ideas and expand upon them. I can’t wait to try Quest 3 and whatever Samsung will launch later this year. We’re on the cusp of a new era where “spatial computing” is poised to become mainstream, and “spatial learning“ could transition from experimental novelty to large-scale deployment. But only if the enterprise learning and development community steps up to create its own killer learning apps that harness the superpowers of spatial computing.

Quelle:

Apple Vision Pro: The iPhone moment for spatial learning

21. Juni 2023 0 comment