Apple researchers share OpenELM, a family of LLMs with 270M to 3B parameters, designed to run on-device, and pre-trained and fine-tuned on public datasets
OpenELM extends an Apple research track that had already paired an Apple-silicon-focused MLX framework with larger multimodal work in MM1. The release makes the smaller-model, endpoint-oriented side of that work easier to evaluate independently.
The significance is architectural rather than product-level: Apple is documenting a path for language models constrained by local compute, ahead of its later disclosure of a roughly 3B-parameter on-device Apple Intelligence model alongside server-side models.
First-order effects
Researchers and developers gain a publicly described family of compact Apple language models, spanning 270M to 3B parameters, for evaluating on-device deployment and fine-tuning on public data.
Apple broadens its visible AI research stack from tooling and large multimodal models to small language models suited to local execution.
Second-order effects
The release gives device-model developers and competing platform teams a concrete Apple reference point for the quality-versus-size trade-off in local language models.
It strengthens the case for building AI features around a mix of endpoint models and larger remote models, an approach Apple later formalized with separate on-device and server language models.
Third-order effects
If compact models continue to improve, AI differentiation will increasingly depend on hardware-aware model design, deployment tooling, and integration with devices—not solely on access to the largest models.
The likely durable architecture is hybrid: local models can handle tasks that fit device constraints, while cloud capacity remains relevant for workloads requiring larger models or more compute.
The trend: OpenELM is one data point in the shift toward hybrid AI architectures that treat efficient on-device inference as a strategic complement to cloud-scale models.
Of course they are. Baked-in, moderately capable LLMs on devices is the future and Apple knows it. Mangy garbage unicorns like Perplexity, and poorly run API call providers like OAI are not. https://www.macrumors.com/...
Amazing to see @Apple join the open source party. They released some Open Source Efficient LLMs (OpenELM) 270M to 3B. Trained on approx 2T public datasets (refineweb, red pajama, dolma and pile) And of course available on @huggingface https://huggingface.co/...
Apple released their LLMs and they're terrible, OMG. Why would they choose to embarrass themselves publicly instead of pretending to be smartasses who keep the best for themselves? [image]
@simonw What's most fascinating to me is how they've just been methodically planning this for a while - getting Mac's & iDevices with dedicated hardware for this way before actually starting on models and libraries. That's some long term foresight
CoreNet looks to be the parent project - brand new on GitHub as of a few hours ago, “a library for training deep neural networks” Includes: - OpenELM: a brand new LLM with open training data - CatLIP: a CLIP-like model with more efficient training? More: https://github.com/...
This work was one of the last works that was done by my team when I was working at Apple. A lot of credit to @sacmehtauw whose dedication was the key to this project. Main point behind here is to show as a contributor to the AI community we play our role to be fully open.
This is the best documentation I could find of the OpenELM training data - it looks like the bulk of it comes from RefinedWeb, RedPajama, The Pile and Dolma https://github.com/...
Apple appear to have just released a huge volume of fascinating ML and LLM work in one go, I'm still trying to get my head around what they've published here
OpenELM: a family of Open-source Efficient Language Models Welcome Apple Inc. in the family of open-source LLM trainers! 🤯 https://huggingface.co/... And together with a new library: CoreNet https://github.com/...
Apple presents OpenELM - An efficient LM family with open-source training and inference framework - Performs on par with OLMo while requiring 2x fewer pre-training tokens repo: https://github.com/... hf: https://huggingface.co/... abs: https://arxiv.org/... [image]
Two new AI releases by Apple today: 🧚♀️ OpenELM, a set of small (270M-3B) efficient language models. Weights on the Hub: Pretrained: https://huggingface.co/... Instruct: https://huggingface.co/... 👷♀️ CoreNet, a training library used to train OpenELM: https://github.com/...
Cool new work from some colleagues at Apple: more accurate LLMs with fewer parameters and fewer pre-training tokens. Also has MLX support out of the box! Code here: https://github.com/...
Apple presents OpenELM An Efficient Language Model Family with Open-source Training and Inference Framework The reproducibility and transparency of large language models are crucial for advancing open research, ensuring the trustworthiness of results, and [image]