/
Navigation
Chronicles
Browse all articles
Explore
Semantic exploration
Research
Entity momentum
Nexus
Correlations & relationships
Story Arc
Topic evolution
Drift Map
Semantic trajectory animation
Posts
Analysis & commentary
Pulse API
Tech news intelligence API
Browse
Entities
Companies, people, products, technologies
Domains
Browse by publication source
Handles
Browse by social media handle
Detection
Concept Search
Semantic similarity search
High Impact Stories
Top coverage by position
Sentiment Analysis
Positive/negative coverage
Anomaly Detection
Unusual coverage patterns
Analysis
Rivalry Report
Compare two entities head-to-head
Semantic Pivots
Narrative discontinuities
Crisis Response
Event recovery patterns
Connected
Search: /
Command: ⌘K
Embeddings: large
TEXXR

Chronicles

The story behind the story

days · browse · Enter similar · o open

Meta releases Llama 2, its open-source LLM with double the context length, for free for research and commercial use, and expands its Microsoft partnership

Recent breakthroughs in AI, and generative AI in particular, have captured the public's imagination and demonstrated what those developing …

Meta

Discussion

  • @scribandotcom@mastodon.social @scribandotcom@mastodon.social on mastodon
    So “OpenAI” isn't open, but Meta's Llama 2...is.  —  Weird world we live in these days.
  • @ylecun Yann LeCun on x
    This is huge: Llama-v2 is open source, with a license that authorizes commercial use! This is going to change the landscape of the LLM market. Llama-v2 is available on Microsoft Azure and will be available on AWS, Hugging Face and other providers Pretrained and fine-tuned...
  • @kyliebytes Kylie Robison on x
    Meta's new A.I. is an open-source breakthrough with fine print to freeze out competitors https://fortune.com/... [image]
  • @minimaxir Max Woolf on x
    The new Llama 2 model has an additional licensing requirement which prevents use if you have >700M MAUs, which is an oddly high number. OpenAI's ChatGPT hit 100 million MAUs in January, and has gone down since. It's essentially a “Amazon and Google don't use this k thx.” [image]
  • @giffmana Lucas Beyer on x
    Ah yes, the well known “except you, FAANG” clause that's so common in *open source* licenses like GPL, MIT, BSD, Apache2, ... Here I go again, this can't be for real lol [image]
  • @drjimfan @drjimfan on x
    The long-awaited sequel, Llama-2 is announced today! It's the best OSS model we have now. ▸ Tiers: 7B, 13B, 70B. Context: 4K ▸ 70B is close to GPT-3.5 on reasoning tasks, but there is a significant gap on coding benchmarks. It's on par or better than PaLM-540B on most benchmarks,…
  • @can @can on x
    what so LLaMa is now just Llama?
  • @natolambert Nathan Lambert on x
    people saying llama v2 is overrated because it's not as good at specific tasks forgot that open models are going to improve at a way faster rate because of community engagement.
  • @swyx @swyx on x
    Found Llama 2's new default system prompt """ You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please... [ima…
  • @artificialguybr @artificialguybr on x
    In less than two weeks we will have an open-source model running locally that will be better than ChatGPT 3.5 This is pretty crazy.
  • @mascobot Marco Mascorro on x
    ✨NEW LAUNCH! LLaMA2 chat API & open-source playground💫: We're releasing tools that make it easy to test @meta's latest LLM & add it to your own app with @replicatehq. Playground: https://llama2.ai/ Live chat API here: https://replicate.com/... Repos & instructions below:
  • @rihardjarc Rihard Jarc on x
    The companies that stand to benefit most from Generative AI are not the ones that own the LLM models. The models are already becoming a commodity (today's $META LLaMa OS release adds to the fire). The real value is in the companies that have distribution for Generative AI use...
  • @erikvoorhees Erik Voorhees on x
    So many are focused on “slowing down” or “regulating” AI. Far more important for it to simply be open source at the base layers. Good job @Meta 👏
  • @amasad Amjad Masad on x
    It's so baffling why all big OSS models do not train on enough code. Not only does it make coding performance better (obviously) — it makes all performance better to train on lots of code (perhaps a 70B can take all code in the world).
  • @perrymetzger Perry E. Metzger on x
    Meta is fully open sourcing Llama 2! This is totally awesome! More open source models means better research, better understanding, and amazing long term benefits to society. [image]
  • @soumithchintala Soumith Chintala on x
    LLaMa-2 from @MetaAI is here! Open weights, free for research and commercial use. Pre-trained on 2T tokens. Fine-tuned too (unlike v1). 🔥🔥🔥 Lets gooo.... https://ai.meta.com/llama/ The paper lists the amazing authors who worked to make this happen night and day. Be sure to thank.…
  • @alistairmbarr Alistair Barr on x
    A big difference between Llama 1 and Llama 2: Meta is no longer saying what training data it used https://www.businessinsider.com/ ... via @businessinsider
  • @rajko_rad Rajko Radovanović on x
    0/9🚨We worked with @replicatehq to make @MetaAI's LLaMa-v2 immediately available to play with and embed in your apps🎁 We also took LLaMa-v2 for a spin, found examples where 13B outperforms chatGPT 3.5 (175B), and not! More context, links and examples below 👇🧵
  • @replicatehq @replicatehq on x
    LLaMA v2 was just announced. And it's live on Replicate. LLaMA v2 is the latest open source model from Meta. v2 was trained on more data than v1 (~2 trillion tokens) and supports context windows up to 4k tokens. https://replicate.com/... We think it's on par with GPT-3.5 ⬇️
  • @timsweeneyepic Tim Sweeney on x
    A huge step forward for AI and for open source by Meta! We can see Team Open forming around AI in real-time thanks to the work of university research groups, to Stability AI, and now to Meta. Ironically, OpenAI is closed.
  • @schrep Mike Schroepfer on x
    This is indeed huge news in the world of AI! So excited to see this out in the world!
  • @alexandr_wang Alexandr Wang on x
    With @MetaAI's the launch of Llama 2—@scale_ai will also be: 🌎 open-sourcing scale-llm-engine, our library for hosting and fine-tuning open-source LLMs ⚡️ releasing the fastest way to fine-tune Llama 2 💼 launching Scale Custom LLMs for enterprises Read more in 🧵 [image]
  • @theemozilla @theemozilla on x
    LLaMA 2 uses the same embedding logic as LLaMA 1, which means all the context length extension work will port right over ✌️
  • @drjimfan @drjimfan on x
    You'll soon see lots of “Llama just dethroned ChatGPT” or “OpenAI is so done” posts on Twitter. Before your timeline gets flooded, I'll share my notes: ▸ Llama-2 likely costs $20M+ to train. Meta has done an incredible service to the community by releasing the model with a commer…
  • @clefourrier @clefourrier on x
    Curious to know how Llama-2 models compare to other LLMs? 🦙 👀⚖️ Check it out on the Open LLM Leaderboard! https://huggingface.co/... We re-ran the 7B, 7B-chat, 13B, 13B-chat, 70B-chat, and the 70B will be there soon ✨ (I can already spy with my little eye a new top model 🚀) [imag…
  • @drewhouston Drew Houston on x
    Proud to partner with @Meta on the LLaMA 2 launch and invest in open source AI!
  • @karpathy Andrej Karpathy on x
    Huge day indeed for AI and LLMs, congrats to Meta 👏 This is now the most capable LLM available directly as weights to anyone from researchers to companies. The models look quite strong, e.g. Table 4 in the paper: MMLU is good to look at, the 70B model is just below GPT-3.5. But H…
  • @sharifshameem Sharif Shameem on x
    Interesting how LLAMA 2 was pretrained for 2T tokens yet somehow even the 7B model size isn't fully saturated yet? if you showed someone these loss curves with no labels, they'd say “keep training!” [image]
  • @immad @immad on x
    Meta launches open source LLM (Llama 2). They also have a ChatGPT style interface so you can play with it yourself: https://www.llama2.ai/ Interesting strategy from Meta/FB to go “scorched earth” on LLMs. Do you think it will work?
  • @krishnanrohit Rohit on x
    The licensing hit that Llama 2 creates might stop big tech from buying a startup built on Llama 2, because of the user count and restrictions on using Llama outputs to train other LLMs.
  • @simonw Simon Willison on x
    The thing I most wanted to see someone do with Llama 2 is figure out the prompts needed for a robust implementation of the reAct pattern, so it can be used as an alternative to OpenAI Functions My notes on that from a few months ago: https://til.simonwillison.net/ ...
  • @jffwng @jffwng on x
    - Paper: https://ai.meta.com/... - Blog: https://about.fb.com/... - Website (Download): https://ai.meta.com/llama/ - Github: https://github.com/... - HF Gradio demo: https://huggingface.co/... [image]
  • @film_girl Christina Warren on x
    This is absolutely huge. For months I've been arguing that the sleeping giant in AI isn't Google, but Meta. This is massive. https://about.fb.com/...
  • @boztank Boz on x
    Llama 2 is open source and available free today for developers, researchers, and entrepreneurs. We're excited to partner with Azure, AWS, Hugging Face and more to deliver this to all of you. https://ai.meta.com/llama/
  • @clementdelangue @clementdelangue on x
    Awesome to see @Meta release Llama2's weights with a permissive license for commercial use: https://huggingface.co/... They've been increasing their footprint in open-source AI a lot recently with over 600 models on Hugging Face like MusicGen, Galactica, Wav2Vec and many others..…
  • @abacaj Anton on x
    Meta really did it, they released a high performing 70B model as open source. Let the data gen begin
  • @natolambert Nathan Lambert on x
    Excited to share my analysis of the LLAMA2 model. In short, this model and paper are incredibly well done. Meta has stepped up the level for open-source and signaled another path for the future of LLMs. Influencers are now right with “equals chatgpt”. https://www.interconnects.ai…
  • @mikeisaac @mikeisaac on x
    open sourcing their AI model is a big deal. it gives developers the power to do whatever they want with the code — for good or ill — and is essentially the opposite approach Open AI and Google are taking Zuckerberg maintains a philosophy that open = better on AI [image]
  • @mreflow Matt Wolfe on x
    So Microsoft is partnered with OpenAI on their closed-source LLM and they're now partnering with Meta to release an open-source LLM with Llama 2? I love that things are moving towards more open-source. I'm just really confused by where Microsoft is going with all this?
  • @pitdesi Sheel Mohnot on x
    Meta and Microsoft teaming up - Meta's AI model Llama 2 will available on Azure Zuck's IG post reminds me of Windows XP [image]
  • @sarthakgh Sar Haribhakti on x
    Remember how the White House didn't invite Meta to their precious AI meeting ? They are going to regret that real quick
  • @km Kanyi Maqubela on x
    LLaMa 2 pre-trained on 7B, 13B and 70B parameters, fully open source. Suspect a lot of companies' customized & proprietary fine-tuning will sit right on top of here.
  • @mattshumer_ Matt Shumer on x
    LLaMA 2 by @Meta - now available! - Commercial use ✅ - Insanely capable - 7-70B parameters! It looks like we finally have a worthy open-source ChatGPT competitor. Main page: https://ai.meta.com/llama/ Tech details: https://ai.meta.com/... Research paper: https://ai.meta.com/... […
  • @swyx @swyx on x
    That was fast - Llama 2 is out! and cleared for commercial use! and *destroys* Falcon 40B on @DanHendrycks 's MMLU and other top benchmarks They really meant it when they said “imminently” lol. Scheduled a @latentspacepod at 3pm PT - join @FanaHOVA and I (and a potential guest 👀)…
  • @bornsteinmatt Matt Bornstein on x
    The release of LLaMA v2 could be a watershed moment for open source LLMs. We got early access, and even 13b is competitive with GPT-3.5 for many tasks (!), especially creative tasks Try it at https://llama2.ai/ and on @replicatehq at https://replicate.com/...!
  • @younesbelkada Younes on x
    Llama-2 just got released by @Meta AI and you can already use it in the @huggingface ecosystem. How to fine-tune the model on your own data? We release a simple fine-tuning script for single & multi-gpu to get you ready in few lines of code https://gist.github.com/... [image]
  • @lgrammel Lars Grammel on x
    Llama 2 makes me pretty excited about the future of open source LLMs. This could be the stable diffusion moment for LLMs, especially since you can use it commercially. https://ai.meta.com/llama/
  • @_philschmid Philipp Schmid on x
    LLaMA 2 released! 🚨🔔 @Meta just released LLaMa 2 the next iteration of LLaMA with a commercial-friendly license.🤯😍 LLaMA 2 comes in 3 different sizes, 7B, 13B, and 70B. The 7B & 13B use the same architecture as LLaMA 1 and are a 1-to-1 replacement for commercial use🔥 🧵1/4 [image]
  • @mascobot Marco Mascorro on x
    LLaMA2 Live Demo: [video]
  • @parkerortolani Parker Ortolani on threads
    Seems like we are heading towards a future where you choose a local LLM for your computer the same way you choose a default browser.  The question now is how Apple chooses to approach them on the Mac....
  • @edmundlee Ed Lee on threads
    Serious provocation: Can someone use this to create a platform where Llama2, chatgpt and Bard challenge each other in a Turing test?
  • @satyanadella Satya Nadella on threads
    What a great day to join Threads!  We're thrilled to expand our AI partnership with Meta, as we bring their Llama family of large language models to Azure, and deliver on our vision to be the...
  • @parkerortolani Parker Ortolani on threads
    Who woulda thought Meta's AI would be more open than the one called OpenAI lol
  • @zuck Mark Zuckerberg on threads
    Open sourcing Llama 2 today.  What do you want to see researchers and businesses build with our next-gen large language model?
  • r/MachineLearning r on reddit
    [Discussion] Meta open sources llama-2 and tie up with MSFT
  • r/LocalLLaMA r on reddit
    LLaMA 2 is here
  • r/MachineLearning r on reddit
    [N] Llama 2 is here
  • r/singularity r on reddit
    Meta just released Llama 2!  Very big news
  • @qualcomm @qualcomm on x
    We're working with @Meta to optimize LLaMA #AI #LLMs to run completely on-device — smartphones, PCs, XR, auto, and IoT. Learn how this allows developers to reduce cloud costs and provide users with more private, reliable, and personalized experiences. https://ai.meta.com/llama/
  • @synopsi Rasty Turek on x
    This is even bigger than the llama 2 announcement itself. On device model will widely open up the world of opportunities. https://www.cnbc.com/...
  • @scobleizer Robert Scoble on x
    You get an LLM and you get an LLM and you get an LLM.
  • @kristinaparts Kristina Partsinevelos on x
    BREAKING: Meta announces its large language model, Llama V2, will be free and available for commercial uses. Qualcomm announcing it make Llama 2-based AI apps available on flagship smartphones and PCs starting from 2024 onwards. $QCOMM $META
  • @bobodtech Bob O'Donnell on x
    This is indeed big news from @Qualcomm as they announced a partnership with @Meta to bring #GenerativeAI onto @Snapdragon-powered devices through running LlaMA 2 models on device...
  • @tacocohen Taco Cohen on x
    Llama-2 is coming to your phone: https://www.qualcomm.com/...
  • @vishvanands Vishvanand Subramanian on threads
    Zuck is subtly escalating Meta's war with Apple by integrating Llama 2 natively in Windows.  Windows already had an edge with NVIDIA's ecosystem support, but now it will optimize for running Meta's...