Profiles of eight former Google research scientists who co-authored the pioneering AI paper “Attention Is All You Need” that paved the way for the rise of LLMs
Financial Times Madhumita Murgia
Related Coverage
Discussion
-
@jmateosgarcia
Juan Mateos Garcia
on x
Birth of a GPT Cool FT long read about the Google team that developed the original transformer. I didn't know that the idea of self-attention is connected with the alien language in Arrival! https://www.ft.com/... [image]
-
@jmateosgarcia
Juan Mateos Garcia
on x
Underscores the importance of co-location and diversity for innovation, and the impact of distributed collaboration on entrepreneurship (the paper authors have spun out companies all over the world) [image]
-
@gavinsbaker
Gavin Baker
on x
4) From a great article in the FT. Lots of Google commentary - most of the oxygen that went to ChatGPT would've been theirs had they simply released LAMDA when it was ready. https://www.ft.com/...
-
@madhumita29
Madhumita Murgia
on x
Huge thanks to @kyosu, @ashVaswani, @nikiparmar09, @aidangomezzz, @ilblackdragon, Noam Shazeer and Llion Jones for all their time spent explaining - and for sharing their stories.
-
@madhumita29
Madhumita Murgia
on x
The parallel story of why every single one of them left Google and the startups they've founded is key to understanding the commercial implications of the LLM boom
-
@madhumita29
Madhumita Murgia
on x
And finally, the truly global team that came together to make the Transformer work is a testament to the power of diversity of ideas/experience in order to truly innovate.
-
@madhumita29
Madhumita Murgia
on x
The story of the Transformer and its inventors was the first one I began to report when I took on my role as AI editor earlier this year - it helps encapsulate the current moment we are in with generative AI, and where we are going. 👉https://www.ft.com/...
-
@fttechnews
@fttechnews
on x
Transformers: the Google scientists who pioneered an AI revolution https://www.ft.com/...