UK-based startup Mantic ranked #8 in the Metaculus forecasting cup that asks entrants to predict 60 geopolitical events, the first time an AI made the top 10
And Beating Humans at It”
Context & Ripple Effects
Related coverage has tracked AI forecasting first in weather, including DeepMind's GraphCast beating conventional systems on three- to 10-day forecasts and broader efforts by the Met Office and major technology firms to extend forecast accuracy and range. Mantic brings that capability into a public benchmark for geopolitical judgment, where performance can be compared directly with people.
The result also gives context to the emergence of specialized geopolitical-forecasting vendors: Sooth Labs' effort to build forecasting models for businesses shows that prediction is becoming a product category rather than solely a research exercise.
First-order effects
- Mantic gains a credible external performance signal after placing eighth in Metaculus's 60-question geopolitical forecasting competition, marking the first top-10 finish by an AI entrant.
- Human forecasters and AI systems now have a shared, outcome-based benchmark in this competition, making their relative performance more visible to prospective users.
Second-order effects
- Forecasting startups can use independently scored results to differentiate from general-purpose AI tools, while incumbent research groups face pressure to show calibrated performance rather than persuasive outputs.
- Organizations considering geopolitical-risk tools are likely to place more weight on evaluation design, historical calibration, and human-versus-model comparisons when selecting providers.
Third-order effects
- If repeatable across competitions and real-world use cases, forecasting may shift toward hybrid workflows in which people set questions and interpret decisions while models supply continuously updated probability estimates.
- The durable competitive issue will be less whether an AI can make a plausible prediction than whether providers can demonstrate reliable calibration across changing events and disclose evaluation limits.
The trend: AI forecasting is moving from domain-specific prediction systems toward measurable decision-support products for uncertain, high-stakes events.