Profiles of eight former Google research scientists who co-authored the pioneering AI paper “Attention Is All You Need” that paved the way for the rise of LLMs
Their paper paved the way for the rise of large language models. But all have since left the Silicon Valley giant Twitter: @jmateosgarcia , @gavinsbaker , @jmateosgarcia , @madhumita29 , @fttechnews , @madhumita29 , @madhumita29 , and @madhumita29 . Forums: Hacker News Twitter: Juan Mateos Garcia / @jmateosgarcia : Underscores the importance of co-location and diversity for innovation, and the impact of distributed collaboration on entrepreneurship (the paper authors have spun out companies all over the world) [image] Gavin Baker / @gavinsbaker : 4) From a great article in the FT. Lots of Google commentary - most of the oxygen that went to ChatGPT would've been theirs had they simply released LAMDA when it was ready. https://www.ft.com/... Juan Mateos Garcia / @jmateosgarcia : Birth of a GPT Cool FT long read about the Google team that developed the original transformer. I didn't know that the idea of self-attention is connected with the alien language in Arrival! https://www.ft.com/... [image] Madhumita Murgia / @madhumita29 : Huge thanks to @kyosu, @ashVaswani, @nikiparmar09, @aidangomezzz, @ilblackdragon, Noam Shazeer and Llion Jones for all their time spent explaining - and for sharing their stories. @fttechnews : Transformers: the Google scientists who pioneered an AI revolution https://www.ft.com/... Madhumita Murgia / @madhumita29 : The story of the Transformer and its inventors was the first one I began to report when I took on my role as AI editor earlier this year - it helps encapsulate the current moment we are in with generative AI, and where we are going. 👉https://www.ft.com/... Madhumita Murgia / @madhumita29 : The parallel story of why every single one of them left Google and the startups they've founded is key to understanding the commercial implications of the LLM boom Madhumita Murgia / @madhumita29 : And finally, the truly global team that came together to make the Transformer work is a testament to the power of diversity of ideas/experience in order to truly innovate. Forums: Hacker News : Transformers: The Google scientists who pioneered an AI revolution