How Mobileye, Cruise, Waymo, and other self-driving system makers are simulating bad drivers, jaywalkers, and edge cases to train and test autonomous vehicles
Christopher Mims / Wall Street Journal :
Context & Ripple Effects
This piece sits mid-arc in a decade-long argument about how autonomous vehicles should learn to drive. As far back as 2015, Google was teaching its cars to cut corners and cross double-yellow lines so they'd behave more like humans — a recognition that perfectly obedient driving is itself a hazard. By 2022, after investors had poured an estimated ~$100B into self-driving startups with little to show for it, the industry's bottleneck was clear: rare, dangerous scenarios can't be collected on public roads at any reasonable pace.
Simulation is the answer that stuck. Rather than waiting for a jaywalker or an erratic driver to appear in front of a test vehicle, Mobileye, Waymo, Cruise, and their peers now manufacture those moments synthetically — and the approach has since escalated from scripted edge cases to Waymo using DeepMind's Genie 3 to generate entire digital worlds for training.
First-order effects
- For Mobileye, Waymo, and (before its robotaxi exit) Cruise, simulation converts edge-case testing from a years-long road exercise into a software pipeline — the same players whose vehicles struggled with mundane maneuvers like smooth stops back in 2018 can now rehearse bad drivers and jaywalkers on demand.
- It also moves liability off public streets: after Cruise's false-report scandal and $500,000 crash-related fine showed how costly real-world incidents are, synthetic testing lets these companies demonstrate behavior without accumulating new street-level failures.
Second-order effects
- Simulation capability becomes a competitive moat: rivals who can't generate convincing edge cases must burn capital on fleet miles instead, a burden that helped sink the economics behind the $100B startup wave.
- It also enables behavioral tuning that pure road data never could — the logical endpoint visible in Waymo's later push to make its cars "confidently assertive" enough to bend traffic laws and crowd pedestrians, something engineers can dial in only when they control the training environment.
Third-order effects
- If the pattern holds, autonomy splits between companies that own world-generation infrastructure and those renting it — Waymo's move to DeepMind's generative worlds suggests simulation becomes a foundation-model layer, not just a QA tool.
- Regulators and insurers will face growing pressure to validate systems trained largely on synthetic scenarios, since the traditional evidence base — accumulated public-road miles — no longer reflects how these behaviors were actually learned.
The trend: Autonomous vehicle development is shifting from accumulating real-world miles to manufacturing edge cases in simulation, with generative world models turning scenario creation into an infrastructure race.