Meta Smart Glasses will get multimodal AI input in April
An update coming to Ray-Ban Meta Smart Glasses in April will let Meta AI accept photos as input and respond to questions about what you see.
Multimodal Meta AI
Ray-Ban Meta smart glasses will get multimodal AI next month. This added capability lets you ask Meta AI about what you’re looking at.
In addition to the usual “Hey Meta” wake word, adding “look and …” signals to the AI assistant that it should use the built-in camera to "see” what you’re talking about and respond to questions.
The New York Times broke the news of an April release date and shared some examples of its successes and failures. For example, the beta of Meta AI can translate signs in English, Spanish, French, and German, but couldn’t identify cherimoya fruit.
Out of Beta
This isn’t the first time we’ve heard about the upcoming feature. Meta started beta testing multimodal AI for the Ray-Ban Meta Smart Glasses in December of 2023.
Several YouTube influencers have posted about their experience with the beta version of Meta AI with visual processing capabilities. Here’s one example from XR enthusiast Jasmine Uniza.
Note: Links to online stores in articles can be so-called affiliate links. If you buy through this link, MIXED receives a commission from the provider. For you the price does not change.
