Apple to bring face-tracking to ARKit on iPhone X, giving devs access to color and depth from front cameras and real-time tracking
Lucas Matney / TechCrunch :
Context & Ripple Effects
With the iPhone X, Apple is opening the front camera's depth and color data to third-party developers through ARKit face tracking — the first time the phone's sensor hardware doubles as a developer platform rather than just a biometric unlock tool. The move lands amid a broader sensor build-out: reports of a rear-facing 3D laser system for future iPhones had already signaled that depth sensing was becoming central to Apple's AR strategy.
The framework cadence that followed confirms this was the opening move — ARKit 2 extended face tracking, ARKit 3 added real-time person occlusion, and ARKit 4 broadened depth capabilities and carried face tracking to more devices — making the iPhone X release the foundation layer for Apple's multi-year AR push.
First-order effects
- Developers gain real-time face tracking plus color and depth from the iPhone X's front cameras, enabling facially driven AR experiences that only work on Apple's newest device.
- iPhone X buyers get an immediate software advantage: the AR app catalog can now differentiate on hardware features older iPhones lack.
Second-order effects
- Android handset makers face pressure to match depth-sensing front cameras or concede the premium AR-app tier to iOS, since developers build where the sensor capability exists.
- Sensor suppliers gain a new demand driver as depth cameras shift from niche biometrics to a mainstream smartphone component Apple iterates on annually.
Third-order effects
- If the pattern holds, smartphones stratify by sensor depth rather than screen specs alone, with each ARKit release widening the gap between hardware generations — and Apple's reported plans for rear-facing 3D sensors point toward phones designed around AR capture, not just AR consumption.
The trend: Smartphone AR is shifting from software-only motion tracking to hardware-backed depth sensing, with Apple using annual sensor additions and framework updates to lock developers into its platform.