Vision Pro users explore what's possible with Spatial Persons

Vision Pro users explore what's possible with Spatial Persons

Yesterday, Apple released a beta version of Spatial Personas to Vision Pro users. They are amazed at the telepresence this technology enables.

A new, improved version of Apple's Personas is causing a stir among Vision Pro users.

Personas are created by taking a 3D facial scan with the Vision Pro. The device's sensors then track facial expressions and hands and animate the personas in real time.

Until yesterday, personas were confined to a window like in traditional video chat (see video above). With Spatial Personas, the avatars break out of that frame and can move freely around the room and toward you. This creates a sense of co-presence, or the illusion of being in the same place together.

Spatial personas are activated during FaceTime calls by tapping the call and selecting the respective option. You can then play games, watch movies, or collaborate in real time with up to four other Vision Pro users via SharePlay.

The first videos show Spatial Personas in action

The following videos document the first public uses of Spatial Personas.

In one Twitter video, the co-presence seems so real to users that they try to touch each other with their hands.

The following YouTube video shows how 3D objects can be viewed together and manipulated in space. The Vision Pro users also play rock, paper, scissors.

Another YouTube video explores how Vision Pro deals with locomotion.

The next example from Bradley Lynch shows couch co-op with Vision Pro. Lynch plays the 2D scroller Cuphead in co-op mode with Eric Masher via Steam Remote Play.

In another video, Lynch watches the cult VR movie "The Lawnmower Man" with Youtuber Virtual Reality Oasis and plays a round of Battleship.


In the last video example, you can see Tested editor Norman Chan and CNET editor Scott Stein playing a round of virtual chess.

And where is Meta?

Meta Quest still only allows you to meet cartoon avatars, and the system software is not optimized for spatial co-presence in the same way as Vision Pro.

Meta has been demonstrating its research into photorealistic telepresence, known as Codec Avatars, since 2019. The technology has not yet left the research lab and is still waiting to be implemented in products. The Codec Avatars of Mark Zuckerberg and Lex Fridman shown last October were powered by two workstations. In October 2022, UploadVR was told that Meta is still "three to four research miracles" away from bringing codec avatars to standalone headsets.

We hope that Apple's forays into telepresence will accelerate the development and commercialization of Codec Avatars. Rumor has it that a Meta Quest Pro 2 with a first video of the Codec Avatars could be released in 2025.