Discussion

• @parkert Parker Thompson on threads

  I'm not sure I buy the idea that there's less lock in with SaaS APIs vs this closed source software you can run locally, but if it's good and cheap that might be enough.  —  RE: https://www.threads.net/...

• @carnage4life Dare Obasanjo on threads

  You can find @zuck's full post here https://www.facebook.com/...

• @carnage4life Dare Obasanjo on threads

  Mark Zuckerberg has shared a persuasive argument for why Open Source AI is the best choice for the technology industry versus closed source models.  He touches on why developers prefer it (customixability & avoiding lock-in), how it benefits Meta similar to its other Open Source …

• @lessin Sam Lessin on threads

  Open vs. closed isn't just a niche tech industry question, it is at the heart of economics, geopolitics, society... and as power / leverage / speed increases in all things, the framework choices matter more and more.  AI put a fine point on this, and glad @zuck calls it out direc…

• @moskov Dustin Moskovitz on threads

  Congrats to Meta on the release of the 405B Llama 3.  Zuck has written a comprehensive and intriguing note here, and I'd like to examine a few of the ideas in it critically later today.  First though, I want to clearly articulate my position …

• @zacchiro@mastodon.xyz Stefano Zacchiroli on mastodon

  Under the carpet of this article, Mark Zuckerberg is hiding the fact that—contrary to traditional free/open source software—the freedoms to study and modify #Llama models are asymmetric.  Meta can exercise both with much more ease than everyone else, because they are the only one…

• @justjoshinyou13 Josh You on x

  Mark Zuckerberg argues that it doesn't matter that China has access to open weights, because they will just steal weights anyway if they're closed. Pretty remarkable. [image]

• @elonmusk Elon Musk on x

  @yacineMTB I think the same thing about myself tbh

• @yacinemtb Kache on x

  zuck is really right about apple how many enemies can they make and continue to survive?

• @maximelabonne @maximelabonne on x

  I made the closed-source vs. open-weight models figure for this moment. [image]

• @ai_katana @ai_katana on x

  Mark Zuckerberg just posted his vision for Open Source AI, titled ‘Open Source AI Is the Path Forward.’ Here is a summary of the post: • Historical Parallel: AI development likened to the evolution of Unix to Linux; open source became more advanced, secure, and widely [image]

• @simonw Simon Willison on x

  On the one hand this letter from Zuck - titled “Open Source AI Is the Path Forward” - is a fascinating document that I expect to be very influential It does however look like we have lost the battle in terms of getting them to stop misusing the term Open Source!

• @tregraves_ Tre Graves on x

  Zuckerberg's vision for Meta's open-source AI strategy is spot on. By not relying on a cloud business and encouraging innovation on top of their models, Meta can lead the industry toward commoditization of AI. The benefits of open ecosystems are clear.

• @aravsrinivas Aravind Srinivas on x

  Well articulated by Zuck. Meta is the *only* profitable company that prints a lot of money without relying on a cloud business. And everything to gain by having others build and improve on top of your models. He also expects we are headed toward commoditization of these models. […

• @bgurley Bill Gurley on x

  Zuck (@finkd) weighs in on others attempting to use government to protect themselves and “capture” the AI market. This is hero stuff from Mr. Zuckerberg. Great for the entire entrepreneur/developer ecosystem. 🙏🙏🙏 [image]

• @teknium1 @teknium1 on x

  @SpencerKSchiff @tszzl Zuckerberg literally today made a huge blog about open source being the defacto future, they already have shown their architecture for video image speech to video image speech llama4, and theres more llama3 iterations to come

• @ylecun Yann LeCun on x

  Some details on Llama-3.1 at The Verge. “Meta releases the biggest and best open-source AI model yet: Llama 3.1 outperforms OpenAI and other rivals on certain benchmarks. Now, Mark Zuckerberg expects Meta's AI assistant to surpass ChatGPT's usage in the coming months.” [image]

• @lior_eth @lior_eth on x

  Unironically, Mark Zuckerberg is championing AI 100x more effectively than Sam Altman, Elon Musk, Google, etc. By giving *everyone in the world* access to a state of the art multimodal AI. Open source the platform, create the ecosystem. Will go down in history as a legend.

• @jack @jack on x

  this is the way https://about.fb.com/...

• @stanbaugh Rich Stanbaugh on x

  @tsarnick I am not a Zuckerberg fan... but I really appreciate his approach to open source AI. Kudos!

• @datadelaurier @datadelaurier on x

  @_xjdr I know right! He knows this is bigger than everyone. Zuckerberg truly understands that the only path to AGI/ASI that is aligned with all of humanity, is open source. Llama isn't controlled by one nation or organization, it belongs to mankind. The way it should be.

• @balajis Balaji on x

  @ylecun Note: Meta backs open source AI because it fits their business model. They get better recruits, they get an entire ecosystem built around Llama, and they hit the margins of closed AI competitors. That makes open sourcing sustainable. https://about.fb.com/... [image]

• @justin_trugman Justin Trugman on x

  It's reassuring to see powerful figures like Mark Zuckerberg consistently champion Open Source AI. In light of the EU, US Federal Government via Biden's Executive Order on AI Development, and California's Bill SB-1047 aiming to cripple the AI industry under the guise of AI [image…

• @kevinbankston Kevin Bankston on x

  I'm supportive of open model releases, and of experimentation with open licenses to address risks, but if it's not actually an open source license (and this one is not b/c of extensive use restrictions), don't call it open source. It's misleading. https://about.fb.com/...

• @erikvoorhees Erik Voorhees on x

  Good guy @meta 👏 We'll have these models live in https://venice.ai/ asap

• @paulg Paul Graham on x

  An eloquent manifesto from Zuck: https://about.fb.com/...

• r/singularity r on reddit

  Mark Zuckerberg argues that it doesn't matter that China has access to open weights, because they will just steal weights anyway if they're closed.

• r/ChatGPT r on reddit

  Mark Zuckerberg argues that it doesn't matter that China has access to open weights, because they will just steal weights anyway if they're closed.

• r/LocalLLaMA r on reddit

  Open Source AI Is the Path Forward - By Mark Zuckerberg, Founder and CEO

• @sundeep Sunny Madra on x

  Do not underestimate this. [image]

• @gabrielmbmb_ Gabriel Martín Blázquez on x

  The family of models Llama 3.1 has been just released! This release is huge for synthetic data as the new updated license is more permissive allowing to use the outputs to improve other LLMs! @dvilasuero and I cooked a small recipe with distilabel: https://github.com/...

• @kevinsxu Kevin Xu on x

  Lastly, Meta changed license terms to now allow output generated from Llama 3.1 series, including the 405B model, to train & improve your own models Such practice is prohibited by OpenAI This change will have far reaching implications https://x.com/...

• @ralphbrooks @ralphbrooks on x

  A permissive license makes it possible to use a GPT4 class model for synthetic data generation.

• @gfodor @gfodor on x

  Good lord he's going for the throat

• @cocktailpeanut @cocktailpeanut on x

  IMO this is the most important part. This is not only great for permissionless innovation, but also significant in that it sets the standard. Now any organization trying to hold on to restrictive license will be ignored and everyone incentivized to open up.

• @simonw Simon Willison on x

  I am so happy to see this, that license term really sat badly with me

• @zuck Mark Zuckerberg on threads

  Open Source AI is the Path Forward

• @timothybucksf Timothy Buck on threads

  My team was part of a really exciting set of announcements today!  We introduced the ability to imagine yourself 👨‍🚀.  We upgraded Meta AI to Llama 3.1, expanded to new languages and countries, and gave you the ability to edit images you've created (add, remove, change, etc).

• @crumbler Casey Newton on threads

  Meta's largest-ever AI model is here — and likely to give new life to the debate over whether AI development can be done more safely if it's open source.  I wrote about the trade-offs: https://www.platformer.news/ ...

• @benedictevans Benedict Evans on threads

  it appears the the latest version of Llama is large enough to be a ‘systemic risk’ under the EU's AI Act.  Open source, freely available to any startup that want to build on it.  Except... Tell me more about how these laws will make the EU a leader in AI. https://x.com/...

• @daveleebbg Dave Lee on threads

  Stuffing it into the world's most popular apps and getting usage isn't a strategic triumph  —  RE: https://www.threads.net/...

• @yannlecun Yann LeCun on threads

  💥BOOM 💥 Llama 3.1 is out 💥 405B, 70B, 8B versions.  Main takeaways: 1.  405B performance is on par with the best closed models.  2. Open/free weights and code, with a license that enables fine-tuning, distillation into other models, and deployment anywhere...

• @brandonlive Brandon Paddock on threads

  Open weights is great, but isn't open source and shouldn't be called that.  The “source” for a model would be the training code plus the training data.

• @deanwball Dean W. Ball on x

  Llama 3 405b is a “systemic risk” to society, according to the European Union and their AI Act. [image]

• @aiatmeta @aiatmeta on x

  We've also updated our license to allow developers to use the outputs from Llama models — including 405B — to improve other models for the first time. We're excited about how this will enable new advancements in the field through synthetic data generation and model distillation

• @karpathy Andrej Karpathy on x

  Huge congrats to @AIatMeta on the Llama 3.1 release!  Few notes: Today, with the 405B model release, is the first time that a frontier-capability LLM is available to everyone to work with and build on...I expect the closed model players (which imo have a role in the ecosystem too…

• @thejackobrien Jack O'Brien on x

  Open source surpassing the closed source AI models, what a time to be alive!

• @soumithchintala Soumith Chintala on x

  Why do 16k GPU jobs fail? The Llama3 paper has many cool details — but notably, has a huge infrastructure section that covers how we parallelize, keep things reliable, etc. We hit an overall 90% effective-training-time. https://ai.meta.com/... [image]

• @neil_chilson Neil Chilson on x

  Why are FTC & DOJ issuing statements w/ EU competition authorities discussing “risks” in the blazingly competitive, U.S.-built AI ecosystem? And on the same day that Meta turbocharges disruptive innovation with the first-ever frontier-level open source AI model? A 🧵 [image]

• @corbtt Kyle Corbitt on x

  Guys fine-tuned Llama 3.1 8B is completely cracked. Just ran it through our fine-tuning test suite and blows GPT-4o mini out of the water on every task. There has never been an open model this small, this good. [image]

• @marouane53 Marouane A. Lamharzi on x

  Can't believe Llama 3.1 (405B), a model as good as GPT-4 and Claude Sonnet 3.5, is open-source and free! Multilingual, 128K context, tool-use + agents. Never thought I'd say this, but thank you, Mark Zuckerberg, for Llama. This is an amazing moment for Open-Source AI.

• @natolambert Nathan Lambert on x

  Setting the record straight on Llama 3.1 not being truly open-source: * Revisiting Meta's AI strategy * Zuckerberg on open vs closed AI * Who the Llama 3.1 license doesn't serve * Implications of an open frontier model More on the technical details soon!

• @emollick Ethan Mollick on x

  Early days, but on vibes alone, on complex business writing and educational prompts, Llama 3.1 405B is quite good, but doesn't take a clear lead over the other frontier models. Of course, being open(ish), there may be rapid improvement on both models & prompting techniques soon.

• @pwendell Patrick Wendell on x

  Meta AI's Llama release today is really important, likely the most important open source AI announcement ever.  Many people don't understand why: 1.  The quality gap between the best proprietary and open models has effectively vanished.  No one really knew if this gap would get b…

• @keunwoochoi Keunwoo Choi on x

  i admit i underestimated how quickly the community (largely thanks to Meta, of course) could catch up OpenAI. impressive.

• @amuldotexe @amuldotexe on x

  @karpathy @AIatMeta Hypothesis: Maybe one of the coolest achievements of @ylecun might be to nudge someone as resourceful as Mark Zuckerberg to invest in making such high quality models open source for the greater good via @AIatMeta that's such a pragmatic far-reaching impact on …

• @basedbeffjezos @basedbeffjezos on x

  The goal was always to ban open source models that are competitive so that incumbent closed model makers could achieve regulatory capture. AI Safety is just a pretense for this. We can't let this bill pass in California. The future of OSS AI depends on it.

• @teortaxestex @teortaxestex on x

  Pretty insane that the cost of producing llama-3-405B, this behemoth, is like 40% of *Ant-Man and the Wasp: Quantumania* movie at most If I were Zuck, I'd have open sourced a $10B omnimodal AGI purely out of spite for the vast fortunes spent on normieslop as a matter of course [i…

• @aravsrinivas Aravind Srinivas on x

  Llama 3 8b was better than Llama 2 70b. There's no reason Llama 4 8 /70b (which will be natively multimodal with audio image and video) shouldn't be better than Llama 3.1 405b. Imagine that scenario where you will be able run a model better than GPT 4o (worth a billion or two

• @elonmusk Elon Musk on x

  @karpathy @AIatMeta It is impressive and Zuck does deserve credit for open-sourcing

• @andrewyng Andrew Ng on x

  Thank you Meta and the Llama team for your huge contributions to open-source! Llama 3.1 with increased context length and improved capabilities is a wonderful gift to everyone. I hope foolish regulations don't like California's proposed SB1047 don't stop such innovations.

• @emollick Ethan Mollick on x

  I spoke to companies in the last year who dropped a of money on Llama 2 powered systems because they were cheap to run, but took lots of engineering to make work well in more demanding applications APIs can be switched but there was a lot of work building around temporary limits

• @minchoi Min Choi on x

  Instant Intelligence is wild with Llama 3.1 8B + Groq 🤯 [video]

• @ramaswmysridhar Sridhar on x

  Excited to announce that Snowflake is teaming up with @AIatMeta Meta to bring Llama 3.1 405B, their largest and most powerful open source model, to Snowflake Cortex AI! 🚀 We've optimized this state-of-the-art model to run faster and more efficiently in Snowflake so our [image]

• @hingeloss Chris on x

  Compared leaked Llama 3.1 benchmarks with other leading models, very excited for the release! We can tier out models by price / 1M output tokens. O($0.10): 4o-mini and <10B param models. I think 4o-mini will still be best but a strong local 8B will unlock lots of applications. [i…

• @ahmad_al_dahle Ahmad Al-Dahle on x

  With today's launch of our Llama 3.1 collection of models we're making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here. [video]

• @ylecun Yann LeCun on x

  💥BOOM 💥 Llama 3.1 is out 💥 405B, 70B, 8B versions.  Main takeaways: 1.  405B performance is on par with the best closed models.  2. Open/free weights and code, with a license that enables fine-tuning, distillation into other models, and deployment anywhere.  3. 128k context lengt…

• @skirano Pietro Schirano on x

  With the introduction of Llama 3.1 405B, we now have an open-source model that beats the best closed-source one available today on selected benchmarks. What a time. [image]

• @matthewberman @matthewberman on x

  Tomorrow is a pivotal day in the world of AI, with the release of LLaMA 3.1 405b. Suddenly, the world will have access to an open-source model considered SOTA. It BEATS GPT4o on many benchmarks. What a time to be alive. [image]

• @togethercompute @togethercompute on x

  🚀 Excited to partner with Meta to bring Llama 3.1 models to Together Inference and Fine-tuning! Up to 80 tokens per second for Llama 3.1 405B and up to 400 tokens per second for Llama 3.1 8B, which is 1.9x to 4.5x faster than vLLM while maintaining full accuracy. [image]

• @alphasignalai Lior on x

  This might be the biggest moment for Open-Source AI. Meta just released Llama 3.1 and a 405 billion parameter model, the most sophisticated open model ever released. It already outperforms GPT-4o on several benchmarks. [video]

• @hingeloss Chris on x

  Meta trained a E2E speech experience with Llama 3.1 - pretty cool! This should equal real-time speech response. Audio encoder + adapter + LLM = audio in, text out Custom TTS model uses LLM embeddings to condition output - IMO elegant to stay in latent space and avoid phonemes. [i…

• @emollick Ethan Mollick on x

  All the current models are getting into a good grad school, especially in the humanities. This includes the small, open Llama 3.1 70B model. Nice gains over the previous generations. (Yes, human tests are never a great way to judge models, but still interesting) [image]

• @thom_wolf Thomas Wolf on x

  Among the most impressive aspect of the Llama 3.1 release is the accompanying research paper! Close to 100 pages of deep knowledge-sharing on LLMs like we havn't seen very often recently What a treat! It covers everything, pretrainining data, filtering, annealing, synthetic [imag…

• @astonzhangaz Aston Zhang on x

  Our Llama 3.1 405B is now openly available! After a year of dedicated effort, from project planning to launch reviews, we are thrilled to open-source the Llama 3 herd of models and share our findings through the paper: 🔹Llama 3.1 405B, continuously trained with a 128K context [im…

• @tobi Tobi Lutke on x

  An incredible gift from Meta & Zuck to all of us. Llama3.1 looks incredible. Congrats to the whole team behind it!

• @garymarcus Gary Marcus on x

  LLaMa 3 450B is huge.  Here's why: - Roughly as good as GPT-4, but open source.  - There goes OpenAI's business model - But it's not GPT-5 level either, despite truly massive resources... - Massive convergence on GPT-4 level models means massive price war, few profits for anyone …

• @mascobot @mascobot on x

  LLaMa 3.1 benchmarks side by side. This is truly a SOTA model. Beats GPT4 almost on every single benchmark. Continuously trained with a 128K context length. Pre-trained on 15.6T tokens (405B). The fine-tuning data includes publicly available instruction datasets, as well as [imag…

• @bbgoriginals @bbgoriginals on x

  Mark Zuckerberg says he wants to control his own tech “destiny” by releasing the largest open-source AI model ever, and avoiding the “soul-crushing” tactics of Apple. He speaks exclusively with @emilychangtv on The Circuit https://www.bloomberg.com/... [video]

• @_akhaliq @_akhaliq on x

  The Llama 3 Herd of Models Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. […

• @aiatmeta @aiatmeta on x

  With Llama 3.1, we evaluated performance on >150 benchmark datasets spanning a wide range of languages — in addition to extensive human evaluations in real-world scenarios. These results show that the 405B competes with leading closed source models like GPT-4, Claude 2 and Gemini…

• @metanewsroom @metanewsroom on x

  Meta AI is now multilingual, smarter and more creative: - Now available in 7 new languages and 22 countries 🌎 - New creative tools to help bring your visions to life as images 🎨 - You can now use our largest and most capable open-source model in Meta AI for help with more

• r/technology r on reddit

  Meta releases the biggest and best open-source AI model yet

• r/mlscaling r on reddit

  Llama 3.1 Paper