Report: Snap Inc. is working on adding in-app lenses that can recognize and interact with landscapes, an extension of the current set which recognize faces
Snap, Inc. is working on an updated version of its in-app Snapchat lenses that would be able to recognize landscapes as well as faces …
Context & Ripple Effects
This report turned out to be a preview of Snap's rear-camera push: two months later, Snapchat shipped World Lenses, live filters for the back-facing camera that place AR elements like clouds and rainbows into real scenes — exactly the landscape-recognition capability described here. Face lenses had been the product's signature trick; recognizing environments was the unlock for everything behind the front camera.
The move also set up Snap's creator pipeline: Lens Studio arrived later that year to let anyone build AR lenses, followed by discovery tools and depth-aware features like a 3D camera mode and LiDAR-tuned lenses on newer iPhones.
First-order effects
- Snapchat users gain lenses that anchor AR effects to physical surroundings rather than only to detected faces, doubling the surface area of the camera the app can decorate.
- Snap's engineering focus shifts from face-mesh tracking alone to scene understanding, which its own later releases — World Lenses and depth-aware modes — depend on.
Second-order effects
- A scene-aware lens format gives third-party creators building in Lens Studio new canvas to design for, feeding the Lens Explorer marketplace with content that works anywhere, not just on faces.
- Rival social apps face pressure to match environment-anchored AR, pushing phone makers' depth-sensing hardware — culminating in Snap adopting iPhone 12 Pro's LiDAR scanner for immersive lenses — into the feature checklist.
Third-order effects
- If the pattern holds, the smartphone camera stops being an image capture device and becomes a perception layer: apps compete on how well they understand space, and AR distribution consolidates around whoever owns the lens creation and discovery stack.
- Hardware-dependent AR features like LiDAR-only lenses risk splitting the user base between devices that can render immersive effects and those that cannot, pressuring platforms to standardize depth sensing.
The trend: Social camera apps are evolving from face filters into spatial AR platforms, with each step — world lenses, creator tools, depth sensors — expanding computer vision from faces to full environments.