Meta AI glasses can now help blind users see the world around them

Meta is adding new accessibility features to its AI-powered smart glasses, and the update could make a real difference for people who are blind, have low vision, or face mobility challenges. The company says the goal is to make everyday tasks easier without needing to constantly use a phone or other assistive devices.  Also Read: Meta introduces ‘Incognito Chat’ on WhatsApp to keep AI conversations private: How it works

The features are coming to Meta’s Ray-Ban and Oakley smart glasses, which already support voice commands and AI-powered assistance. This time, the focus is more on accessibility and hands-free use.  Also Read: Meta Ray-Ban Display glasses can now type messages without touching a phone

How the glasses are helping users 

One of the biggest additions is Meta’s expanded partnership with Danish mobile app Be My Eyes. Users can now start a hands-free video call with a trusted friend or family member just by saying, “Hey Meta, Be My Eyes.”  Also Read: Can AI read your mind? Meta’s brain-predicting AI raises a bigger privacy question

This allows blind and low-vision users to get real-time help while moving around. For example, someone can ask another person to describe surroundings, read signs, or help locate something nearby without taking out their phone. 

Meta says the glasses are already being used in daily life by people with disabilities. One example shared by the company is Donald Overton, a US Army veteran who lost his vision in Iraq. According to Meta, he now uses the glasses to read restaurant menus, navigate airports, and move around without carrying multiple assistive tools. 

Another user, Noah Currier, who is quadriplegic, said the glasses allow him to take photos and videos entirely through voice commands. 

New voice controls and shortcuts 

Meta is also introducing more voice-based controls for calls on WhatsApp, Messenger, Instagram, and Be My Eyes. Users will be able to mute calls, switch video on or off, or hang up completely through voice commands. 

There is also a new shortcut feature where users can assign a favourite action to the button on the glasses. This could be something like asking Meta AI to describe the surroundings instantly. 

The company has also added live captions during calls on supported apps. This can display what the other person is saying directly on the in-lens display, which may help users in noisy environments. 

Third-party apps are getting involved too 

Meta is also opening access to developers through its Wearables Device Access Toolkit. This allows third-party apps to work with the smart glasses.  

Apps like OOrion can help users find objects around them, avoid obstacles in their path, and understand what’s nearby through live audio instructions. Another app, Aira, connects blind users with trained visual interpreters for live assistance. 

Meta is also testing new wearable tech 

Apart from the glasses, Meta is also working with Carnegie Mellon University on a neural wristband that can detect muscle signals. 

The idea is to allow people with spinal cord injuries to control devices using subtle hand gestures. Meta says the technology can translate those signals into actions like clicking, scrolling, or navigating through digital interfaces. 

Add Techlusive as a Preferred Source

The company shared that these accessibility-focused updates are part of its broader effort to make wearable AI more useful in everyday situations.