Researchers at Facebook Reality Labs detail work on giving AR users “perceptual superpowers”, attempting to automatically amplify what users are trying to hear
important for our future AR glasses! https://tech.fb.com/... @techatfacebook : The audio team at @FBRealityLabs Research is working on novel technologies to enable both audio presence and perceptual superpowers with our future AR Glasses. We take you behind the scenes for a look at their current demos and prototype technology. // https://tech.fb.com/... @fbrealitylabs : The Facebook Reality Labs Research teams have also been working on technology that lets you hear better in noisy environments so you can connect better with the person in front of you, key to our future AR glasses. Learn more: https://tech.fb.com/... https://twitter.com/... Matt May / @mattmay : Product review meeting: FB exec 1: This is missing something that speaks to the Facebook brand FB exec 2: How about a feature that sounds social but enables tons of creepy, invasive use cases FB exec 1: OMG YES https://twitter.com/... Max Dylan Ash / @mynameisntdave : Glasses that give superhearing? What's next? Earplugs that make things tasting better or someshit?!? https://twitter.com/... Matt Navarra / @mattnavarra : Read this It will either terrify you 😱 Or Excite you. 🤓 https://about.fb.com/... Dan White / @atdanwhite : Everyone under 50: The only people who use Facebook are my parents and my aunts. Facebook: Not true! We make hearing aids now. https://twitter.com/... Josh Sternberg / @joshsternberg : if you thought the ad platform that facebook has now is bananas; the ad delivery mechanism for this shit is gonna be awful https://twitter.com/...
Context & Ripple Effects
This demo slots into Facebook's accelerating AR glasses pipeline. Weeks earlier, Andrew Bosworth described Project Aria, the ~100-tester field study in Seattle and San Francisco meant to refine what consumer glasses actually need to sense, and he and Michael Abrash followed up with interviews on how the glasses would use personal data. The audio work is one answer to that sensing question: before glasses can augment sight, they have to handle sound.
It also extends an older thread — Facebook Reality Labs has been building a voice assistant since 2018 and had already approached smart-speaker vendors, per earlier reporting. 'Perceptual superpowers' hearing is the same ambition moved onto the face: a device that figures out what you want to attend to and filters everything else.
First-order effects
- Users in noisy environments are the immediate beneficiaries: the technology selectively amplifies what they are trying to hear, making conversation possible where it currently fails — the core use case FRL cites for future AR glasses.
- FRL's audio team moves from research curiosity to critical-path supplier for the glasses program Bosworth and Abrash are publicly shepherding, alongside the camera-and-sensor stack being tested through Project Aria.
Second-order effects
- Hearable and hearing-aid makers face a new class of competitor: a general-purpose glasses platform whose audio filtering is bundled with display, assistant, and social graph rather than sold as a single-purpose device.
- Always-on microphones tuned to infer user intent sharpen the privacy questions Abrash and Bosworth were already fielding about glasses data — every hearing demo doubles as evidence the device must continuously record and model the acoustic environment around non-users too.
Third-order effects
- If intent-inference audio ships at scale, wearables shift from displaying information to mediating perception itself — deciding what a user hears — which puts attention-filtering on regulators' agenda alongside the data-use questions Facebook has already been pressed on for the glasses program.
- The pattern points toward platforms competing on sensed-context quality rather than apps or content: whoever owns the microphone array on your face owns the input layer for assistants, ads, and social features alike.
The trend: Consumer AR is advancing from rendering overlays to actively curating perception, with audio amplification as the first perceptual layer Facebook is proving out ahead of its glasses launch.