ray-ban meta AI glasses can report history and explain science with new multimodal update

Ray-Ban Meta AI glasses enter beta multimodal stage

Meta and Ray-Ban’s AI glasses can now report the history of landmarks, share the backstories of objects, and give scientific explanations when asked with their recent multimodal update. Mark Zuckerberg takes the news to Instagram with a series of clips where he takes the Ray-Ban Meta AI eyewear on a weekend trip in Montana. As the AI glasses record where the Meta founder is walking, Mark Zuckerberg asks the accessory to tell him the history of the Roosevelt Arch, explain how snow is made like a caveman, and let him know if horses feel cold in snowy weather.

images courtesy of Meta and Ray-Ban

The Ray-Ban Meta AI glasses may have taken a while to answer the questions, but once they did, they responded with a semi-monotonous voice and at a pace that could help the wearer clearly understand each word. When asked to explain the snow process like a caveman, the AI glasses even started with a sound resembling a neanderthal before diving into the scientific explanation. The beta version of the recently updated Ray-Ban Meta AI glasses, as Mark Zuckerberg showed on his Instagram post, can also identify landmarks such as the Big Sky Mountain in Montana and continues to share pieces of information for a more in-depth answer.

Meta and Ray-Ban’s AI glasses can now report the history of landmarks and share the backstories of objects

Ray-Ban Meta AI glasses can identify historical places

In his Instagram post, Mark Zuckerberg even asked the beta version of the Ray-Ban Meta AI glasses, ‘how many onesies are too many?’ The eyewear responded with silence, prompting a chuckle from the Meta founder, but this may entail that the design team is still developing the new multimodal features of the AI glasses. So far, the most recent addition to the growing list of updates is their ability to identify landmarks and provide in-depth information about them, as well as give explanations to scientific and factual questions. If this feature gets expanded, the Ray-Ban Meta AI glasses may step into the role of a walking digital encyclopedia.

the AI glasses can give scientific explanations when asked because of its recent multimodal update

brief overview of Ray-Ban and Meta’s AI glasses

Ray-Ban Stories was Meta’s first smart and AR glasses, unveiled in February 2023 and built in partnership with EssilorLuxottica. They became the foundational block of the duo to develop the new generation of Ray-Ban Meta smart glasses with AI features, improved audio and cameras, and over 150 different custom frame and lens combinations. Unlike the AR headsets like the Apple Vision Pro and even the Meta Quest 3, the Ray-Ban Meta AI eyewear is worn like a normal pair of eyeglasses, all wireless and lightweight. They might be mainly used for day-to-day tasks too rather than game playing, hence a sharper focus on activity-based features such as identifying landmarks and documenting what the wearer sees.

since the Ray-Ban Meta AI glasses are hands-free, the wearer uses voice commands

Since the Ray-Ban Meta AI glasses are hands-free, the wearer uses voice commands. They say ‘Hey Meta!’ out loud and hear the AI’s voice next to their ears to prompt them to tell the system what they want it to do or know. So far, the wearer can livestream from the glasses to Facebook or Instagram and see the comments in their preview, or tap and hold on the side of your glasses to hear them out loud. The 12 MP camera takes photos and 1080p videos up to 60 seconds, and the user can even directly share photos to friends and family from glasses with ‘send a photo’ voice command. The recent update is still under development, and the design team has yet to announce its arrival.

the recent update is still under development, and the design team has yet to announce its arrival