2025-12-05
@JeffDean Fascinating work. The test-time updates based on ‘surprise’ seem powerful. What's the mechanism to prevent the memory from getting polluted by noisy or even adversarial inputs over time?
Google Research
Google unveils Titans, an architecture combining RNN speed with transformer accuracy for real-time learning, which can scale to context windows of 2M+ tokens
Ali Behrouz, Student Researcher, Meisam Razaviyayn, Staff Researcher, and Vahab Mirrokni, VP and Google Fellow, Google Research