/
Navigation
Chronicles
Browse all articles
Explore
Semantic exploration
Research
Entity momentum
Nexus
Correlations & relationships
Story Arc
Topic evolution
Drift Map
Semantic trajectory animation
Posts
Analysis & commentary
Pulse API
Tech news intelligence API
Browse
Entities
Companies, people, products, technologies
Domains
Browse by publication source
Handles
Browse by social media handle
Detection
Concept Search
Semantic similarity search
High Impact Stories
Top coverage by position
Sentiment Analysis
Positive/negative coverage
Anomaly Detection
Unusual coverage patterns
Analysis
Rivalry Report
Compare two entities head-to-head
Semantic Pivots
Narrative discontinuities
Crisis Response
Event recovery patterns
Connected
Search: /
Command: ⌘K
Embeddings: large
TEXXR

Chronicles

The story behind the story

days · browse · Enter similar · o open

DeepMind says video models like Veo 3 could become general purpose foundation models for vision, like LLMs for text, using zero-shot “chain-of-frames” reasoning

Video models are zero-shot learners and reasoners.  Fascinating new paper from Google DeepMind which makes …

Simon Willison's Weblog Simon Willison

Context & Ripple Effects

DeepMind’s video work has progressed from business access to its initial Veo model to Veo 2’s longer, higher-resolution clips. This report extends that arc beyond generation: it argues that video models may learn visual structure and reason over it without task-specific training.

The claim arrives alongside DeepMind’s Genie 3, which generated interactive 3D worlds with short-term visual continuity, and a broader race to develop world models from video and robotics data. It matters because the competitive question shifts from video output quality to whether video-trained systems can transfer across vision tasks.

First-order effects

  • DeepMind positions Veo 3 as a prospective vision foundation model, making zero-shot chain-of-frames reasoning a central capability to validate rather than treating the model solely as a video generator.
  • Researchers and prospective users gain a concrete hypothesis to test: whether a video model’s learned temporal representations transfer reliably to visual reasoning tasks without fine-tuning.

Second-order effects

  • Rivals pursuing video and world models, including approaches such as Meta’s masked-video prediction model, face stronger incentives to demonstrate zero-shot transfer and temporal reasoning, not just generation or simulation quality.
  • If the capability holds across evaluations, demand for video data, multimodal evaluation suites, and inference systems able to process frame sequences would rise relative to tools optimized only for creating clips.

Third-order effects

  • The direction points toward a possible convergence of video generation, perception, and world modeling into shared visual base models; that outcome remains dependent on reproducible transfer beyond the reported reasoning setup.
  • As models are asked to reason from visual sequences, differentiation is likely to move toward data coverage, temporal consistency, and deployment cost—not only photorealistic video output.

The trend: Video models are being repositioned from media generators into general-purpose systems for learning and reasoning about the physical world.

Discussion

  • @priyankjaini Priyank Jaini on x
    Could video models be the path to general visual intelligence? In our new paper, we show that Veo3 has emergent zero-shot capabilities, solving complex tasks across the vision stack. Project page: https://video-zero-shot.github.io/ Paper: https://arxiv.org/... 🧵👇🏻 [image]
  • @thwiedemer Thaddäus Wiedemer on x
    Are we experiencing a ‘GPT moment’ in vision? Super excited to demonstrate the generality with which current video models can solve tasks from simple perception to visual reasoning! 🌐 https://video-zero-shot.github.io/
  • @simonwillison.net Simon Willison on bluesky
    Made some notes on the new DeepMind paper “Video models are zero-shot learners and reasoners” - it makes a convincing case that generative video models are to vision problems what LLMs were to NLP problems: single models that can solve a wide array of challenges simonwillison.net…
  • r/singularity r on reddit
    Video models are zero-shot learners and reasoners
  • r/singularity r on reddit
    Google's Veo 3 Demonstrates Chain-of-Frames behavior (like Chain-of-thought but for image frames).  Could diffusion models be the path …