Using Meta Quest 3 as a 3D scanner - is it possible?
The experimental MR app Digitalizer promises easy object scanning with Quest 3, but falls short in practice.
Digitalizer is based on a very promising idea. You hold a virtual scanner in your right hand, with which you can digitize real objects. The scanned object can then be exported in OBJ format.
"Use cases range from using the scanned object as a reference to create higher quality, true-to-scale models, 3D printing, animation, or using it as the background of a short film," reads the description in the Horizon Store.
The developer writes on Reddit that the app uses the Quest 3's depth sensor to scan objects and environments with an accuracy of up to 5 millimeters.
I tested the VR app on the Quest 3, but the initial results were underwhelming. Whether scanning a small item like a can or a larger object like a vacuum cleaner, the output resembled an amorphous cluster of voxels (see video below), with only vague similarities in outline and color to the original.
The idea is exciting, but the current Quest hardware and software implementation are currently lacking for use cases like this. I'm sure both will improve in the future as Quest headsets get higher resolution depth sensors.
Digitalizer uses Meta's new Passthrough API
I tested the latest version (v7) of Digitalizer, which was released a few days ago. Among other things, it introduces RGB support. This means that the colors of the real object are estimated and applied to the scanned copy.
This is made possible by Meta recently introduced Passthrough Camera API (PCA), which allows developers to access the Quest cameras and apply proprietary computer vision algorithms and AI models to the video material in real time, for example for the purpose of color recognition. Since apps with PCA are not yet allowed to be published on the Horizon Store, you can only get RBG support with the version sold on Itch.io.
The update also brought an undo function and multimodal hand tracking, which means that you can use hand tracking and controller at the same time.
You can find Digitalizer in the Horizon Store for Meta Quest 3 and 3S. For RGB support, you need to purchase the VR app from Itch.io.
What do you think of this app? Join the conversation on Facebook, Bluesky or X or share your opinion in the comments below.
For feedback, topic suggestions, or other ideas, please email us at hello@mixed-news.com.
Note: Links to online stores in articles can be so-called affiliate links. If you buy through this link, MIXED receives a commission from the provider. For you the price does not change.
