Tag

Vision Pro

Siemens and Bilt launch spatial computing electrician training on Apple Vision Pro

Siemens and Bilt have launched a spatial computing app to train electricians using the Apple Vision Pro mixed reality headset.

The companies are the creators of 3D Intelligent Instructions and they’re optimizing their mobile guides into spatial models for the Apple Vision Pro, which lets you see 3D animations overlaid on a view of the real world with the new headset.

As the need for skilled electricians and other trades grows, training the entering workforce while up-skilling the existing one, is essential. Tools such as Bilt on Apple Vision Pro provide a highly immersive and visual training experience that helps users not only learn faster, but safer.

Siemens’ first product assembly and installation guides available on Bilt on Apple Vision Pro include Siemens Smart Infrastructure’s Class 14 NEMA motor starter, designed to control and protect motors applied in industrial processes, and the P5 Power Distribution Panel. The latter is used in a variety of commercial construction applications to safely distribute power within a building.

With the ultra-high-resolution display system on Apple Vision Pro, Bilt provides users a photorealistic digital twin that combines the real and the digital worlds, unlocking powerful spatial experiences. Guided learning on Apple Vision Pro allows users to utilize natural and intuitive gestures using their eyes, hands, and voice to interact with each element of the product, enlarge or minimize parts, and see animated step-by-step assembly instructions.

“This is a great example as to how we are maximizing digitalization to enable the next generation of electricians,” said Andreas Matthé, CEO of electrical products at Siemens Smart Infrastructure, in a statement. “The ability to pick a digital representation of electrical equipment and work with it in the physical space in front of you, transforms the educational experience, creating a safer, low cost and innovative way of learning.”

Both products have the UL standard and are focused on the North American market and other countries that use the UL standard.

To further the partnership and accelerate applications globally, Bilt will become the newest addition to Siemens’ Xcelerator Ecosystem and Marketplace. Siemens Xcelerator, an open digital business platform and powerful ecosystem of partners, is where industrial clients from around the world can look for solutions that suit their needs. As part of Siemens Xcelerator, Bilt will now be available as a turnkey solution to accelerate digital transformation and learning easier, faster, and at scale.

“Closing the skills gap and empowering the next generation of electricians is what we at Siemens also aim for. By partnering with innovative companies like Bilt, we are revolutionizing the learning experience,” said Siemens CTO Peter Koerte, in a statement. “We are excited to welcome Bilt as the newest partner in our Siemens Xcelerator ecosystem — further expanding our transformative workforce offerings together.”

In the future, Siemens plans to introduce several additional products to Bilt for Apple Vision Pro to supplement its extensive library of mobile instructions. The roadmap includes Siemens’ smart home energy management portfolio of products, InHab, as well as power distribution switchboards designed for electric vehicle charging applications.

“Siemens is an industry innovator,” said Nate Henderson, CEO of Bilt, in a statement. “They’re making it possible for apprentices and new electricians to upskill faster, install with confidence, and follow safety guidelines more easily. BILT for Apple Vision Pro enables them to provide tactical and intuitive training that fits the needs of a new generation of learners.”

Attendees at Germany’s largest industrial tradeshow, Hannover Messe, will have an opportunity to experience Bilt on Apple Vision Pro from April 22 to April 23, 2024 at the Siemens booth in hall 9. The demo will feature a guided installation of Siemens’ Class 14 NEMA motor starter and P5 Power Distribution Panel as part of Siemens’ Xcelerator showcase.

Quelle:

Foto:

Electricians can train using the Apple Vision Pro. Siemens/Bilt

https://venturebeat.com/games/siemens-and-bilt-launch-spatial-computing-electrician-training-on-apple-vision-pro/

22. April 2024 0 comment

Examples

Surgeons perform UK’s first operation using Apple’s Vision Pro headset

Apple’s mixed reality device could revolutionize the industry

What just happened? Apple’s Vision Pro might have its detractors, not least due to the $3,500 price tag, but its use in the enterprise and other non-consumer sectors could be revolutionary. In the UK, for example, surgeons have performed the first operation in the country where the mixed reality headset was utilized.

Apple hopes that one area where the Vision Pro will find plenty of success is the medical industry. The profession is examining the use of mixed reality in certain fields and, according to some analysts, Apple’s powerful headset could be a game changer.

During a recent operation to repair a patient’s spine at the private Cromwell Hospital in London, a scrub nurse working alongside the surgeon used the Vision Pro to help prepare, keep track of the procedure, and choose the right tools, reports the Daily Mail. This marked the first operation in the UK where the Vision Pro was used.

The software running on Apple’s headset during the operation comes from US company eXeX, which has made similar programs for Microsoft’s HoloLens. It offers nurses and technicians both holographic and touch-free access to the surgical setup and the procedural guides from within the sterile field of the operating room, according to the press release. The software also tracks each stage of an operation and can measure how well the op went compared to previous procedures performed by other surgeons.

„It eliminates human error and eliminates the guesswork,“ said Suvi Verho, lead scrub nurse at London Independent Hospital. „It gives you confidence in surgery.“

While this marked the first time that the Vision Pro was used during a UK surgery, the first-ever time the device was used in an operating room was last month, just three days after its release, when Orlando resident and world-renowned Neurosurgeon Dr. Robert Masson wore it during several spine reconstruction surgeries (top of page).

„We are in a new era of surgery, and for the first time, our surgical teams have the brilliance of visual holographic guidance and maps, improving visuospatial and temporal orientation for each surgical team and for each surgery in all specialties“, said Masson.

The Vision Pro is being trialed across different areas by several healthcare organizations around the globe. In addition to aiding surgery, it’s also being used for radiology, patient monitoring, medical teaching and planning, therapy, and spotting early signs of conditions.

Quelle:

Foto: Serving tech enthusiasts for over 25 years.
TechSpot means tech analysis and advice you can trust.

https://www.techspot.com/news/102212-uk-surgeons-perform-first-operation-using-apple-vision.html

19. März 2024 0 comment

Knowledge Software/Apps

‚Nearly All‘ iPad & iPhone Apps Will Be Available On Apple Vision Pro At Launch

Apple confirmed that „nearly all“ iPad and iPhone apps will be available on Vision Pro at launch early next year.

Vision Pro will have an App Store that serves both apps developed specifically for visionOS and any compatible iPad and iPhone apps that can run on the headset.

In a note to developers, Apple explains:

„By default, your iPad and/or iPhone apps will be published automatically on the App Store on Apple Vision Pro.
Most frameworks available in iPadOS and iOS are also included in visionOS, which means nearly all iPad and iPhone apps can run on visionOS, unmodified.
Customers will be able to use your apps on visionOS early next year when Apple Vision Pro becomes available.“

Alternatively, developers can build a native visionOS version of their app and use Apple’s Universal Purchase cross-buy system to offer it for free to customers who have already bought it on iPhone or iPad, and vice versa. Developers can also specifically opt their app out of appearing on visionOS entirely if they really want.

Apple has previously confirmed that Vision Pro will prefer the iPad version of apps and display them in landscape orientation, but will fall back to a portrait orientation iPhone app when an iPad version isn’t available.Adobe Lightroom iPad app running on Vision Pro

However, iPad and iPhone apps that use capabilities or frameworks that aren’t available on visionOS won’t be listed automatically in the Vision Pro App Store.

Those unavailable capabilities include raw accelerometer or gyroscope access, custom peripheral drivers, raw GPS, NFC, SMS, HealthKit, RoomPlan, AppClip, and MLCompute.

Third party apps also can’t access Vision Pro’s cameras, though attempting to do so won’t crash or break the app. Instead, accessing the selfie camera will return a virtual webcam view of you as your Persona, Apple’s name for its realistic face-tracked avatars, while accessing the rear camera will return a black feed with a „no camera“ icon in the center. This ensures the app works without crashing, but obviously renders any in-app photography experiences useless. It also prevents developers from building their own custom computer vision solutions.

Some other iPhone and iPad features are automatically adapted for visionOS. Apps using TouchID or FaceID will be forwarded through Vision Pro’s eye tracking based OpticID, for example. And while Vision Pro doesn’t have a GPS, Apple’s Core Location API allows for a location to be approximated via Wi-Fi or obtained from a nearby iPhone.

Developers can also enhance their existing iPhone and iPad apps for Vision Pro without having to build a new separate visionOS app. This includes adding custom hover effects designed for the visionOS eye tracking interaction system.

Apple claims „hundreds of thousands“ of iPhone and iPad apps will „run great“ on Vision Pro at launch, and developers can already use the visionOS simulator to make sure theirs work too.

Quelle:

https://www.uploadvr.com/nearly-all-iphone-ipad-apps-apple-vision-pro/

20. September 2023 0 comment

Hardware Knowledge Software/Apps

iPhone 15 Pro is Apple’s First Smartphone With Spatial Video Capture, for Viewing on Vision Pro

Apple today announced its iPhone 15 lineup of smartphones, including the iPhone 15 Pro which will be the company’s first phone to capture spatial video for immersive viewing on Vision Pro.

While Apple Vision Pro itself works as a spatial camera, allowing users to capture immersive photos and videos, I think we can all agree that wearing a camera on your head isn’t the most convenient way to capture content.

Apple seems to feel the same way. Today during the company’s iPhone 15 announcement, it was revealed that the new iPhone 15 Pro will be capable of capturing spatial video which can be viewed immersively on the company’s upcoming Vision Pro headset. The base versions of the phone, the iPhone 15 and iPhone 15 Plus, won’t have the spatial capture capability.

Details on exactly how this function works are slim for the time being.

“We use the ultrawide and main cameras together to create a three-dimensional video,” the company said during its announcement. But it isn’t clear if “three-dimensional” means stereoscopic footage with a fixed viewpoint, or some kind of depth projection with a bit of 6DOF wiggle room.

Given that the iPhone 15 Pro cameras are so close together—not offering enough distance between the two views for straightforward stereo capture—it seems that some kind of depth projection or scene reconstruction will be necessary.

Apple didn’t specifically say whether the phone’s depth-sensor was involved, but considering the phone uses it for other camera functions, we wouldn’t be surprised to find that it has some role to play. Curiously, Apple didn’t mention spatial photo capture, but ostensibly this should be possible as well.

While users will be able to watch their immersive videos on Vision Pro, Apple also said they’ll be able to share the footage with others who can watch on their own headset.

While the new iPhone 15 lineup will launch on September 22nd, Apple says the spatial capture capability won’t be available until “later this year”—which is curious considering the company also said today that Vision Pro is “on track to launch in early 2024.” Perhaps the company plans to allow creators to access the spatial video files for editing and use outside of Apple’s platform?

Quelle:
https://www.roadtovr.com/apple-iphone-15-pro-spatial-video-capture-3d-vision-pro/

18. September 2023 0 comment