News · Meta adds hands-free accessibility features to its AI glasses and opens a developer toolkit
Meta adds hands-free accessibility features to its AI glasses and opens a developer toolkit
Ahead of Global Accessibility Awareness Day, Meta detailed new voice and one-touch controls, a Be My Eyes service directory, third-party apps, and an EMG research project with Carnegie Mellon.
What Meta actually shipped for the glasses
The announcement bundles four distinct interface changes to Meta's AI glasses, each tied to a concrete physical constraint. Group calling now lets a blind or low-vision user say "Hey Meta, Be My Eyes with [name]" to start a hands-free video call with a trusted contact rather than a stranger volunteer. A Service Directory extends the same feature to trained representatives at Tesco, Sony, Amtrak, and Hilton.
Voice controls during calls will let users mute, unmute, toggle video, or hang up on WhatsApp, Messenger, Instagram, and Be My Eyes without touching the frames — Meta explicitly frames this for people with limited hand mobility. One-touch shortcuts remap the action button on Ray-Ban Meta Optics and Oakley Meta Vanguard styles so a single press replaces a multi-step voice command. Captioned calls put real-time transcription of the other speaker on the in-lens display of Meta Ray-Ban Display glasses.
The through-line is reducing the number of steps and the amount of touch required. Each change targets a different disability — vision, hearing, hand mobility — rather than a single generalized "accessibility mode."
The Device Access Toolkit is doing the heavy lifting
The more structurally interesting piece is the Meta Wearables Device Access Toolkit, which lets developers extend existing mobile apps onto the glasses. Meta names two early apps: OOrion, which guides blind and low-vision users toward objects with live audio feedback and lets them scan and save personal items like keys or a wallet to find later; and Aira, which connects users to professionally trained Visual Interpreters based on the glasses' field of view while keeping hands free for a cane or guide dog.
That's a notable division of labor. Meta supplies the sensors, the audio pipeline, and the camera; specialist companies supply the domain expertise and the human interpreters. Aira's mention of enterprise-grade privacy and training standards signals that these are established assistive-tech vendors porting their services, not hobbyist demos. For applied teams, the toolkit is the part that determines whether the glasses become a durable platform or a fixed set of Meta-built features.
Muscle-signal control is still research, not a product
Separate from the shipping features, Meta describes a three-year partnership with Carnegie Mellon University exploring electromyography — the same technology in the Meta Neural Band that accompanies Meta Ray-Ban Display. The band reads subtle forearm muscle signals and translates them into clicks, scrolls, and steering, and Meta says it works even in people paralyzed for many years.
The demonstration is specific: a participant named Cass with a spinal cord injury raced a multiplayer game against a standard-controller player, steering and boosting through gestures captured by two Neural Bands. This is framed as exploration, not a launched feature, and the honest signal in the writeup is that it sits in a research section rather than the product rollout. It's the most ambitious claim here and also the least finished.
The evidence Meta chose to lead with
The announcement is anchored by two veterans rather than product specs. Donald Overton, blinded by a blast in Iraq, describes reading a restaurant menu without the backpack of assistive devices he used to carry. Noah Currier, a Marine Corps veteran with quadriplegia, describes the first hands-free photo he took.
I'm a quadriplegic, so my hands don't work. I probably have fewer photos and videos in my phone than anybody else in the world. Being able to take them hands-free was incredible. The very first thing I did was take a picture of my baby when I got home.Montana Labs
These are the outcome metrics Meta is choosing to be judged on — a date night, a photo of a child — rather than latency or recognition accuracy. It's a deliberate framing that centers restored independence over technical benchmarks.
Why the toolkit, not the features, is the real bet
The specific implication of this release is that Meta is trying to convert accessibility from a feature checklist into an open platform. Voice controls and captioned calls are useful, but they are things Meta ships and freezes. The Device Access Toolkit, the Be My Eyes and Aira integrations, and the CMU EMG research all point at the same wager: that the most valuable assistive experiences will be built by people closer to the disabilities than Meta is.
For teams building on wearable AI, the practical takeaway is that the glasses are now a distribution surface for existing assistive services, and the interesting engineering questions are about field-of-view context, privacy standards, and human-in-the-loop handoff — not about whether the hardware can describe a scene. Whether this compounds depends on how many developers the toolkit actually attracts beyond the two launch partners named here.
Find this story relevant to you?
Contact us to find a unique solution
Need an AI engineering partner that can actually build?
We help businesses integrate AI, build AI-powered products, automate high-value workflows, and modernize the software systems behind them.
Related reading
More analysis around product delivery, operational AI, and the systems work that makes deployment hold up in reality.