Microsoft's Seeing AI app, which narrates what's in front of the camera for sight-impaired users, now lets users “touch” objects' edges via haptic feedback
Parmy Olson / Forbes :
Context & Ripple Effects
Seeing AI has been Microsoft's flagship free accessibility app since its 2017 iOS launch, when it could only narrate what the camera saw. The company has been steadily adding non-visual channels around it: Soundscape brought 3D audio cues for navigation in 2018, and Microsoft Research had already demoed sensing tech that reacts to fingers before they touch a screen back in 2016.
The haptic update turns the phone itself into a tactile display, letting users trace object edges by feel rather than relying solely on spoken description. It lands in a field where Microsoft has also moved upstream — licensing Be My Eyes' AI into its Disability Answer Desk and pushing image captioning models into Azure, Word, and Outlook — making accessibility both a product line and a showcase for its computer-vision stack.
First-order effects
- Blind and low-vision Seeing AI users gain a second feedback channel beyond narration: haptic signals that convey object boundaries directly through the device, useful when speech is impractical or too slow.
- The update deepens the app's differentiation against volunteer-assistance models like Be My Eyes, which Microsoft already taps for its own customer-service desk — machine-generated feedback now covers cases that previously needed a human caller.
Second-order effects
- Rival assistive-vision tools such as Aira Explorer face pressure to match multi-sensory output, shifting competition from recognition accuracy alone toward how information is delivered — audio, haptics, or both.
- Phone makers' haptic hardware becomes a functional input for accessibility software, giving vibration-motor quality new weight in a market segment — assistive tech — where it was previously an afterthought.
Third-order effects
- If the pattern holds, assistive apps converge on layered sensory interfaces — camera plus audio plus touch — with the smartphone acting as a low-cost substitute for dedicated hardware like canes-with-sensors or wearable displays.
- Free accessibility apps double as distribution for Microsoft's vision models, seeding consumer trust and enterprise credibility (Azure captioning, support desks) from the same underlying technology.
The trend: Assistive vision software is evolving from single-channel narration toward multi-sensory interfaces that combine camera AI, spatial audio, and haptics on commodity phones.