Amazon's iPhone App Uses Image Recognition to “See” Real-World Products You Want to Buy
Among the many things that make Amazon one of the most successful merchants in the history of merchandising is the zeal with which it removes every possible obstacle that might stand in the way of you buying something.
Context & Ripple Effects
This is the next step in a progression Amazon has been building since at least October 2010, when it added barcode scanning for price comparison to its iPhone app, and November 2011, when the Flow app brought augmented reality to barcode scanning and product search. What changes here is the removal of the last physical prerequisite: no barcode needed, just a photo of the product itself.
Amazon is not alone in this direction — The New York Times' Bits blog looked at Apple's Spot-the-Shopper technology back in late 2011 — but Amazon has the most direct incentive to win it, given its stated zeal for eliminating every obstacle between a shopper and a purchase. Pickup by Gizmodo and WSJ's Digits shows the feature landed as a mainstream consumer story, not a niche technical one.
First-order effects
- Shoppers can point an iPhone camera at any real-world product and buy it on Amazon without typing or scanning a barcode, collapsing the gap between seeing something in a store and ordering it.
- The feature deepens Amazon's showrooming advantage: brick-and-mortar retailers' shelves become a searchable catalog that routes sales straight to Amazon.
Second-order effects
- Rivals with mobile commerce ambitions — Apple among them, per its own spot-the-shopper work — face pressure to match camera-based product recognition or cede the physical-store-to-online funnel to Amazon.
- Physical retailers have more reason to resist in-store phone use or differentiate on service and immediacy, since price-and-buy comparison is now a single camera gesture away.
Third-order effects
- If image recognition holds up at scale, the camera replaces the keyboard and the barcode as the primary entry point to mobile shopping, and whoever owns the recognition layer owns the query — an early instance of AI capability compounding through distribution reach.
The trend: Mobile commerce is moving from typed search and barcode scans toward pointing a camera at any object, turning computer vision into the new front door of retail.