Google updates Now on Tap with text translations from any screen, search by QR or bar code, and “Discover mode” for getting a stream of related visual content
With Now on Tap, Android Marshmallow users can get quick help from Google without having to stop what they're doing.
Context & Ripple Effects
Now on Tap launched in 2015 as Google's bet that the assistant should read whatever is on screen rather than wait to be summoned — the original in-app answers and app-to-app navigation demo. The rollout stumbled out of the gate: Microsoft shipped an equivalent screen-context feature in Bing for Android first, as covered in Bing beating Now on Tap to the punch.
Since then Google has been stitching its separate screen-aware utilities back into the assistant: in-app translation arrived for Marshmallow users across 90 languages in late 2015, and Translate gained one-tap translation inside any Android app this past May. Today's update folds those capabilities directly into Now on Tap and adds QR/barcode search plus a Discover mode for related visual content.
First-order effects
- Android Marshmallow users get translation, QR/barcode lookup, and a stream of related visual content without leaving their current app — no more routing through the standalone Translate app for on-screen text.
- Google consolidates features it had been shipping piecemeal through Translate and the Google app into a single always-on screen-context surface, closing the gap opened when Microsoft shipped the equivalent Bing capability first.
Second-order effects
- Microsoft's Bing-for-Android screen-assist play now competes against a feature set that includes visual search and content discovery, not just text recognition — raising the bar for what counts as parity in the assistant race.
- Discover mode puts a passive content stream inside the assistant layer, prefiguring the feed-based surfaces Google later formalized in the search app's distinct appointment and personalized-news feeds.
Third-order effects
- If the pattern holds, the OS-level assistant becomes the aggregation point for discrete utilities — translation, visual search, discovery — shifting distribution power from individual apps to whoever controls the screen-context layer on Android.
The trend: Mobile assistants are absorbing standalone utilities like translation and visual search, turning the screen-aware assistant layer into the primary surface through which Google reaches users inside other apps.