visionOS 2.0 gets big upgrades with photo 3D processing, multiple 4K Mac screens & more

AppleInsiderAppleInsider
Posted:
in visionOS edited June 10

Users of the Apple Vision Pro will expand the usability of almost every aspect of their device with huge updates coming to visionOS 2.0.

Person wearing a VR headset at a wooden table in a modern living room, interacting with multiple floating virtual screens displaying media and documents.
visionOS 2.0 and Mac monitors



Apple released VisionOS in February of this year, and today, it announced updates that, according to the company, cover productivity, collaboration, and entertainment.

Apple showed off some of the apps available for VisionOS, which now has over 2000 apps. These apps include games, immersive experiences, educational tools, and entertainment. The lack of content for Apple Vision Pro was one of the original concerns about the platform, but developers have jumped onto it.

Apple Vision Pro has native apps for productivity tools like Zoom, Webex, and the Microsoft 365 suite. Immersive sports apps from the NBA, MLS, NHL, MLB, and more are available. All traditional streaming platforms, from Apple TV+ to Showtime to Disney+, are available on Apple Vision Pro.

While Apple didn't bill Apple Vision Pro as a gaming headset, as Oculus Quest and others have, gaming is particularly immersive on Apple Vision Pro. Apple has connected Apple Vision Pro to Apple Arcade, and several VR games, including Job Simulator, are available on Apple Vision Pro.

Multiple basketball games displayed on a screen in a living room, featuring players from different teams in action.
Immersive experiences in visionOS are highlights of the Apple Vision Pro, and new tools in visionOS 2 will make them even more immersive.



With visionOS 2, Apple says new ways to connect and work together are coming to the platform.

Photos on VisionOS 2 will enhance their use beyond spatial photos. Apple says the new version of Photos for visionOS uses machine learning to transform 2D images into 3D images with the click of a button. Any photo in a library, from portraits to panoramas, can be converted to a simulated spatial photo.

SharePlay in the Photos app will allow users to share photos with other Apple Vision Pro users for multi-person

New gestures allow users to twist their hands to quickly access new features like the Mac virtual display, settings, and control interfaces.

Mac Virtual Display will be updated to a larger wraparound virtual display, and visionOS 2 will allow multiple monitors.

Apple is adding a new train mode to the existing plane mode for those using the Apple Vision Pro on the go. Internal sensors currently detect when a user is on a plane. The detection disables some movement controls so the shakes and bumps of a plane ride don't cause jitter or app crashes.

Train mode will extend this to a moving train's motion, allowing commuters to use their devices without motion disrupting the experience.

Apple is also releasing more APIs to create apps that use 3D space. TabletopKit will allow developers to make games and other apps connected to a surface like a table, and enterprise APIs will enable corporate users to create Apple Vision Pro-specific apps.

A living room with a white sectional sofa, large arched windows, and a hologram of a futuristic cityscape projected in the middle.
While games aren't a key selling point of the Apple Vision Pro, the number of available games continues to grow.



Turning to spatial video, Apple announced new commercial workflows, and Canon will release a special lens to capture spatial video from affordable mirrorless cameras. The ability for creators to use a traditional camera instead of the Apple Vision Pro will greatly simplify a creator's ability to create spatial video.

Apple's new Final Cut Pro can edit spatial video captured with the Apple Vision Pro or traditional cameras.

Apple will release the new version of VisionOS this fall, along with the newly announced versions of macOS, iOS 18, iPadOS 18, and tvOS 18.

Apple has said the Apple Vision Pro is the most significant product introduced in decades. While the iPhone and the iPad moved computing from the desktop to the palm of your hand, Apple has said that Apple Vision Pro represents the future of computing.

As part of the visionOS announcements, Apple added eight countries to the official device support list.



Read on AppleInsider

Comments

  • Reply 1 of 2
    machead4evermachead4ever Posts: 5member
    Early adopter here! I have been waiting since February for hearing devices to actually work on my Vision Pro. Apple Support says AVP was rolled out with minimal driver support and that they could not promise me support despite the fact that my iPhone and iPad DO have working hearing device support. While the AVP has great speakers, I have a pair of digital hearing aids that process that sound into frequencies that I can actually hear. IF hearing aid support doesn't start working this Summer, I may have to look for a Class Action suit to join. I love Apple, but hearing devices work on the iPhone and iPad then it should be a no-brainer for the software engineers. Come on, guys, get the drivers rolling out before we are forced to let ChatGPT start writing the software. :-)
    watto_cobra
  • Reply 2 of 2
    dave marshdave marsh Posts: 352member
    I also heard nothing of the Accessibility update that Apple Executive Relations advised me months ago was coming to deal with the lack of prism support.  So, while I appreciate their offering me a full refund after the two week window closed, I love the product enough and continue to struggle along with third party optical inserts with prisms that I have no intention of returning it.  I can view content clearly now, but have to drag every window right up near me to directly touch controls to manipulate content, since visionOS can’t determine where my eyes are looking to allow vision control.  Perhaps when they release visionOS 2.0 public beta in July I’ll discover the unmentioned controls in System Settings.  Fingers crossed.
    edited June 10 watto_cobra
Sign In or Register to comment.