visionOS 2 will bring greatly improved hand tracking to Apple Vision Pro

visionOS 2 will bring greatly improved hand tracking to Apple Vision Pro

With visionOS 2, Apple addresses one of the biggest criticisms of Vision Pro and dramatically improves hand tracking.

FACTS

With visionOS 2, the hand tracking update rate is increased from a low 30 Hz to the display's frame rate, which is normally 90 Hz. This means that Vision Pro detects three times as many hand poses per second, which should result in much smoother and more responsive hand tracking.

Developers can now also use prediction for hand tracking. With this option enabled, Vision Pro estimates what a hand pose will look like, reducing the perceived latency of hand tracking.

These improvements were shown in a developer session (starting at 12:12) and were not part of the WWDC keynote. You can read about other visionOS 2 improvements in our overview article.

logo

CONTEXT

In terms of latency, the Vision Pro's hand tracking is not yet as good as the Meta Quest 3's, as a measurement and comparison by RoadtoVR showed.

This should change with visionOS 2, or at least the gap should get smaller. The website wants to repeat the measurement and make a new comparison.