eBay open sources HeadGaze, an ARKit-based tool that uses the iPhone X's TrueDepth camera to help visually impaired users interact with apps via head movements
Context & Ripple Effects
eBay's move turns the iPhone X's depth-sensing camera stack — the same TrueDepth hardware Occipital built a $499 headset around two years earlier — into an accessibility input device, and gives the code away rather than keeping it proprietary. That matters because head-movement control previously required dedicated assistive hardware; here it runs on a phone millions of people already own.
The release also predates the platform owners themselves treating camera-based input as an accessibility feature: Apple only shipped Eye Tracking at the OS level years later, and computer-vision assistance for blind users has since advanced through projects like Be My Eyes' GPT-4 image description. HeadGaze sits early in that arc — a marketplace company filling a gap the OS vendor hadn't yet addressed.
First-order effects
- iOS developers can now integrate head-gesture navigation into their apps at no cost, and visually impaired iPhone X users gain a hands-free input option that requires no additional hardware beyond the TrueDepth camera they already have.
Second-order effects
- eBay converts an internal accessibility project into brand and developer goodwill, pressuring other large app operators to either contribute their own assistive tooling or explain why they haven't.
Third-order effects
- The pattern this points toward — third-party apps proving camera-based assistive input before the platform vendor ships it natively — played out when Apple introduced Eye Tracking for iPad and iPhone in 2024, suggesting depth-sensor accessibility eventually migrates from app-layer hacks into the operating system itself.
The trend: Smartphone depth sensors are steadily being repurposed from AR novelties into assistive input layers, with open-source app-level tools arriving ahead of native OS support.