Muse is coming to Meta smart glasses

Meta’s AI agent is arriving on its glasses alongside a wave of new accessibility, camera, and navigation features.

Just a couple of weeks after launching Muse , Meta announced that it’s “working on” bringing the agent to its smart glasses, including the new glasses it unveiled at Meta Connect. Users will be able to activate Muse from their glasses by saying its name and ask it to handle tasks like guiding a workout, logging meals, or helping them shop for products they’re looking at.

Muse is just one of several major updates coming to Meta’s glasses. They’re also getting some new accessibility features, like a Hearing Enhancement feature Meta says is “FDA-cleared software for adults with perceived mild to moderate hearing loss.” It will be available later this year with a Meta One subscription or as a $149 add-on for compatible glasses. Meta AI will also be able to give “more context-rich answers” when users ask the glasses what they’re looking at, potentially making Meta’s glasses more effective for helping blind and low-vision users interpret their surroundings. A new audio customization feature will also allow users to shift their smart glasses’ volume between their left and right ears, including sending all audio to one side.

Meta’s introducing some new audio and photo features as well, including Dolby Atmos Capture, which will allow users to record videos with 360-degree spatial audio. A new Dynamic Photo feature automatically captures multiple frames when you take a photo with Meta’s glasses, then uses Meta AI to suggest the best frame from each batch.

The Meta Ray-Ban Display glasses are getting the new “Hologram” feature Meta announced for its new VR Glasses, which it says is “a photorealistic digital version of your face for calls from Meta Ray-Ban Display” that “infers” your expression using your voice. The feature’s “rolling out in Early Access on WhatsApp to Meta Ray-Ban Display users in the US later this fall.”

A couple new heads-up navigation features are coming to the Meta Ray-Ban Display as well. Starting later this month, users in the US and Canada will have an option to use their voice to ask for real-time cycling or public transit directions. The Meta Ray-Ban Display will also start using “the world in front of you rather than street signs in turn-by-turn walking directions,” like referencing a house, car, or landmark the glasses detect. A few other new features are on the way for the Display glasses, including an option for editing photos directly on the glasses’ display, a new “Explore” app for finding new apps, an improved calendar, and mirroring for phone notifications.