Spatial Personas adds 3D calling to FaceTime on Apple Vision Pro

Posted:
in Apple Vision Pro

FaceTime is set to become more immersive for Apple Vision Pro users, with Apple testing out Spatial Personas that make callers float in front of you.

Spatial Personas [Apple/Inverse]
Spatial Personas [Apple/Inverse]Spatial Personas [Apple/Inverse]Spatial Personas [Apple/Inverse]



Like many other Apple devices, the Apple Vision Pro offers users the ability to take and place audio and video calls using FaceTime. While the current version is fairly similar in concept to the existing flat video version, Apple envisions a way for Apple Vision Pro users to see each other in a more immersive way, thanks to Personas.

Spatial Personas is a version of the Apple Vision Pro that Inverse reports that Spatial Personas taps into the Persona digital avatar system to change how others are viewed within a FaceTime call. At least, for Apple Vision Pro users.

Normally, FaceTime calls are conducted in floating tiles, which display either a video feed or a version of the contact's Persona, depending on what hardware they are using to take the call.

In a demonstration by Apple's Public Relations and Product Marketing teams, Apple's new system skips the tile element entirely and instead floats the caller's head, upper body, and hands in front of them.

The system also works for group calls, with callers gathered in a circle. To help with body language cues in conversation, the contacts are arranged in the same order, so everyone will see the same person or thing that an individual's looking or pointing at correctly.

Audio is also directional, helping users identify which person in a group call is speaking, relative to their position.

Users can also decide to sit down or stand up, with their positions and eye-lines changing to match their position in relation to other users. Participants can also move around in their physical space to change their position relative to other callers.

Walking through another Persona results in the other person turning temporarily into a circular contact card.

The demonstration of Spatial Persona was viewed as a very immersive and conducive to shared experiences. For productivity, up to five people could be working on a digital whiteboard at once, for example, while apps such as board games could become a more sociable experience with people gathered around a board or table.

Coming very soon



It appears that owners of the Apple Vision Pro could get to use the Spatial Persona system soon, with one tweet from Ben Lang on X indicating that users on the latest release of visionOS should be able to use it after rebooting. A rollout is expected to happen at some point on Tuesday.

Once enabled, Spatial Personas will exist as a new option above the End Call button in FaceTime, during a call with other Apple Vision Pro users.



Read on AppleInsider

Comments

  • Reply 1 of 8
    thttht Posts: 5,450member
    Yup. This was inevitable. You could tell from the WWDC videos on visionOS common environments. 

    Wonder if the Television app is using this?

    I don’t think it is that valuable for meetings. You share content, not faces, in our countless streaming meetings, but if it is good enough, perhaps for more personal and private meetings?

    Face-to-face meetings enforce attention. That’s probably the big thing. Will displaying your persona hide your inattention? Force you to pay attention and not play on your phone? Hmm…
    ForumPost
  • Reply 2 of 8
    danoxdanox Posts: 2,868member
    Hard to do without the processing power inside the Apple Vision the M2/R1 and it will only get better with the M3/R2 SOC'S. Coming in the future but you have to lay down the foundations/ecosystem first.
    ForumPostrezwits
  • Reply 3 of 8
    MarvinMarvin Posts: 15,326moderator
    These look much better than the flat versions with the depth and lighting, even using the same persona capture used in 2D.






    williamlondonStrangeDaysjas99rezwits
  • Reply 4 of 8
    Still does not full figure e.g. the back of the head/body is blurry 
    williamlondon
  • Reply 5 of 8
    StrangeDaysStrangeDays Posts: 12,879member
    The demo in Marvin’s first video is very cool! The way they can view each other in 3D space, see profiles, watch or interact with a screen together. Definitely a more immersive experience than panel faces.
    jas99
  • Reply 6 of 8
    StrangeDaysStrangeDays Posts: 12,879member
    ForumPost said:
    Still does not full figure e.g. the back of the head/body is blurry 
    This is not surprising considering the AVP has no data of that to show you. Perhaps one day the persona scanning task will incorporate having a friend scan you in 360, but right now it’s limited to what you capture of yourself during set up. 
    jas99rezwits
  • Reply 7 of 8
    StrangeDays said: Definitely a more immersive experience than panel faces.
    Yeah, the Brady Bunch aspect of video conferencing has always been a bit odd. 
  • Reply 8 of 8
    MacProMacPro Posts: 19,728member
    Just wait... Siri is going to materialize at WWDC.
Sign In or Register to comment.