Alibaba releases Qwen3-Next, a new model architecture optimized for long-context understanding, large parameter scale, and better computational efficiency
the FUTURE of efficient LLMs is here! 🔹 80B params, but only 3B activated per token → 10x cheaper training, 10x faster inference than Qwen3-32B.(esp. @ 32K+ context!) 🔹Hybrid Architecture: Gated DeltaNet + Gated Attention → best of speed & [image] Emad / @emostaque : Fast ✅ Cheap ✅ Good ✅ I would estimate this cost < $500k of compute to train & outperforms pretty much any model from last year Lots of interesting tech choices in here, will be very suitable for continuous RL & more Hybrid makes a lot of sense as well @kimmonismus : Holy moly, Qwen is cooking! Qwen-3-Next-90b-A3b is next level efficiency [image] Forums: Hacker News : Qwen3-Next
🚀 Introducing Qwen3-Next-80B-A3B — the FUTURE of efficient LLMs is here! 🔹 80B params, but only 3B activated per token → 10x cheaper training, 10x faster inference than Qwen3-32B.(esp. @ 32K+ context!) 🔹Hybrid Architecture: Gated DeltaNet + Gated Attention → best of speed & [imag…
Fast ✅ Cheap ✅ Good ✅ I would estimate this cost < $500k of compute to train & outperforms pretty much any model from last year Lots of interesting tech choices in here, will be very suitable for continuous RL & more Hybrid makes a lot of sense as well