An oral history from 19 current and former natural language processing researchers of the past five years, including how LLMs and ChatGPT disrupted their fields
There was one about using BERT to unredact the Mueller report, which is a terrible idea. It seemed like there was just a never-ending supply … Bluesky: @markriedl , @coocho , @melaniemitchell , and @quantamagazine . Mastodon: @davidschlangen@scholar.social . X: @johnpavlus LinkedIn: Margaret Mitchell and Kobi Leins . Forums: r/slatestarcodex Bluesky: Mark Riedl / @markriedl : This is a fantastic oral history of the last 10 years of NLP and AI. www.quantamagazine.org/when- chatgpt... Daria Dayter / @coocho : «It's sometimes confusing when we pretend that there's a scientific conversation happening, but some of the people in the conversation have a stake in a company that's potentially worth $50 billion.» — www.quantamagazine.org/when- chatgpt... Melanie Mitchell / @melaniemitchell : Very interesting oral history — interviews with some top NLP folks on the effects of GenAI on their field: — www.quantamagazine.org/when- chatgpt... @quantamagazine : What happens when AI upends an entire field? Where do the experts go? What do young people do? Researchers studying natural language processing were among the very first to find out. This is their story, told in their own words. www.quantamagazine.org/when- chatgpt... Mastodon: David Schlangen / @davidschlangen@scholar.social : This does a good job at describing what it felt like to live through the changes that the transformer and BERT brought to the field of NLP. — (I don't think I will ever forget the post-BERT EMNLP, where every presentation was “yeah, but our paper doesn't matter anymore, here's this new thing being 10% point absolute better.") … X: John Pavlus / @johnpavlus : “Something very significant has happened to the field. And also to people.” Natural language processing was ground zero for the emergence of LLMs—and modern AI. 19 scientists tell that story in their own words. My latest for @QuantaMagazine, in 5 acts https://www.quantamagazine.org/ ... LinkedIn: Margaret Mitchell : Great quote from Anna Rogers: “I was considering making yet another benchmark, but I stopped seeing the point of it. … Kobi Leins : Anna Rogers was ahead of her time when we co-authored a piece with Tim Baldwin for academics to consider the ethics of their uses of data in 2021: … Forums: r/slatestarcodex : When ChatGPT Broke an Entire Field: An Oral History | Quanta Magazine