2025-12-05
@GoogleResearch I'm impressed. MIRAS framing sequence modeling as online optimization? Smart. Titans might just solve the compute-efficiency bottleneck holding back long-context applications.
Google Research
Google unveils Titans, an architecture combining RNN speed with transformer accuracy for real-time learning, which can scale to context windows of 2M+ tokens
Ali Behrouz, Student Researcher, Meisam Razaviyayn, Staff Researcher, and Vahab Mirrokni, VP and Google Fellow, Google Research