Intel says its next-gen Lunar Lake laptop chips will have 100+ TOPS of performance in AI tasks and elements of Microsoft's Copilot will soon run locally on PCs
A while back, I took a bit of a swipe at Axios, which I felt … Hilbert Hagedoorn / Guru3D :Intel Previews Lunar Lake with Enhanced AI Capabilities at Vision 2024 Phoronix : Intel HID Driver Ready For Arrow Lake & Lunar Lake Laptops With Linux 6.9 TrendForce Insights : [News] Battle in AI PCs: Exploring Intel, AMD, and Qualcomm Chips'AI Computing PowerKazim Ali Alvi / Windows Report : Vision 2024: Intel launches Gaudi 3 accelerator and next-gen Lunar Lake, CEO shares future strategy Btarunr / TechPowerUp : Intel Confirms Core Ultra “Lunar Lake” Packs 45 TOPS NPU, Coming This YearMark Anthony Ramirez / Laptop Mag : 'Before competitors ship their first chips, we're launching our second.': Intel CEO touts ‘3x the AI performance’ for upcoming Lunar Lake chips Paul Thurrott / Thurrott : Intel Claims Big AI Performance Gains in Next Core Ultra Chips João Carrasqueira / XDA Developers : Intel promises 100 TOPS of AI performance for its next-gen processors Pradeep Viswav / MSPoweruser : Upcoming Intel Lunar Lake processors for PCs will deliver up to 100 TOPS of AI performance Paul Alcorn / Tom's Hardware : Intel debuts Gaudi 3, set for Q3 mass production, claiming up to 1.7x the training performance, 50% more inference, and 40% better efficiency than Nvidia's H100 X:Ryan Shrout / @ryanshrout : The announcements from @intel at Vision today are critically important to the success of the products division of the company going forward. With Lunar Lake, the client division expects to get back leadership across most/all workload categories, with AI performance being the... [image] @inteledge : Our partnership with @Dell is taking off 🚀 Purpose-built to take on today's demanding AI workloads, the Intel Gaudi 3 #AI Accelerator in Dell's PowerEdge XE9680 is poised to help enterprises harness the full potential of AI everywhere, from #edge to cloud. Daniel Newman / @danielnewmanuv : 40 Million AI PC shipped in 2024 is a solid out the gate advantage. Intel is first at scale. Tech leadership and performance will be closely watched as Qualcomm and AMD ramp volume. I think a lot are underestimating the stickiness of Intel in the channel. Disruption will happen... Helen Yu / @yuhelenyu : Have you ever seen AI PCs in action? Bring your AI Vision goggles and come along with me on an exhilarating tour with Rajshree Sankaran at @Intel Ocotillo Fab. As Pat aptly put it: “Intel will unleash the power of our data, accelerate our productivity, enable our workforce,... [video] @iancutress : Significant IPC updates with @intel Lunar Lake. Ideal for thin and light, samples already going to partners. [image] David Altavilla / @davealtavilla : Here's #LunarLake! @Intel CEO @PGelsinger holds LL high, promising big gains and 45 TOPS NPU perf for #AI PCs this year, in time for holiday shoppers. $INTC #Vision2024 [image] Michelle Johnston Holthaus / @mjholthaus : .@PGelsinger shared exciting news in today's #IntelVision keynote - our next processor family, Lunar Lake, will have 3x AI performance on both the GPU and NPU. AND, it will have more than 100 platform TOPS and more than 45 NPU TOPS. Absolutely incredible. [image] Anshel Sag / @anshelsag : .@PGelsinger announces Lunar Lake with over 100 TOPS of platform #AI performance. Shows off a Lunar Lake SoC on stage and says to expect significant gains. #IntelVision24 [image]
Tom's HardwarePaul Alcorn
Context & Ripple Effects
Intel’s AI push had just extended from data-center accelerators with the Gaudi 3 launch to the PC processor roadmap, making Lunar Lake the client-side part of a broader compute strategy.
Subsequent coverage made the architecture’s division of labor clearer, describing Lunar Lake’s 48-TOPS NPU alongside its CPU and integrated GPU gains. That distinction matters because the 100+ TOPS claim is for the overall platform, not the NPU alone.
First-order effects
Intel can market Lunar Lake around AI throughput across the full chip, while its NPU’s more-than-45-TOPS rating becomes the concrete on-device AI capability for laptop buyers and PC makers.
Running elements of Copilot locally creates a path for Microsoft features to use PC silicon directly rather than relying entirely on remote processing; the announcement does not specify which features will move.
Second-order effects
AI-PC comparisons will increasingly need to separate NPU TOPS from total platform TOPS. AMD’s later 50-TOPS Ryzen AI NPU announcement shows how quickly NPU performance became a competitive headline metric.
Laptop makers and software partners gain an incentive to design features around CPU, GPU, and NPU workloads rather than treating AI capability as a single-chip benchmark.
Third-order effects
If local AI features become a durable purchase criterion, laptop processors will compete as heterogeneous systems whose software support and workload placement matter as much as peak CPU performance.
The market may split between chips that meet the practical requirements for premium local AI experiences and those that do not, as later illustrated by Arrow Lake models that missed Copilot+ requirements.
The trend: AI PCs are shifting the laptop silicon race toward coordinated CPU, GPU, and NPU performance tied to locally executed software features.
The announcements from @intel at Vision today are critically important to the success of the products division of the company going forward. With Lunar Lake, the client division expects to get back leadership across most/all workload categories, with AI performance being the... […
Our partnership with @Dell is taking off 🚀 Purpose-built to take on today's demanding AI workloads, the Intel Gaudi 3 #AI Accelerator in Dell's PowerEdge XE9680 is poised to help enterprises harness the full potential of AI everywhere, from #edge to cloud.
40 Million AI PC shipped in 2024 is a solid out the gate advantage. Intel is first at scale. Tech leadership and performance will be closely watched as Qualcomm and AMD ramp volume. I think a lot are underestimating the stickiness of Intel in the channel. Disruption will happen..…
.@PGelsinger shared exciting news in today's #IntelVision keynote - our next processor family, Lunar Lake, will have 3x AI performance on both the GPU and NPU. AND, it will have more than 100 platform TOPS and more than 45 NPU TOPS. Absolutely incredible. [image]
Here's #LunarLake! @Intel CEO @PGelsinger holds LL high, promising big gains and 45 TOPS NPU perf for #AI PCs this year, in time for holiday shoppers. $INTC #Vision2024 [image]
Have you ever seen AI PCs in action? Bring your AI Vision goggles and come along with me on an exhilarating tour with Rajshree Sankaran at @Intel Ocotillo Fab. As Pat aptly put it: “Intel will unleash the power of our data, accelerate our productivity, enable our workforce,... [v…
.@PGelsinger announces Lunar Lake with over 100 TOPS of platform #AI performance. Shows off a Lunar Lake SoC on stage and says to expect significant gains. #IntelVision24 [image]
Emphasizing that @Dell is “working hard to meet the demand and make AI adoption really easy for these enterprise customers,” the company's founder finished his brief talk with a plea for @intel CEO Pat Gelsinger. “What we need is more Gaudi 3 in volume.” https://www.crn.com/...
The person (I'm under the impression) that pushed through Xeon Scalable was formerly at Staples and Gillette. I always wondered what about product naming razors and stationery made you an expert in semiconductor enterprise marketing. He now works at AMD. [image]
Using large language model-based generative AI solutions to enhance productivity. Learn about an on-prem, secure, #IntelXeon and Gaudi-powered solution built in collaboration with Articul8, a partner company, and how Intel has already been using it in the fabs. #IntelVision [imag…
Intel is providing you the flexibility to deploy the AI system YOU need in your enterprise. The AI NIC is a network interface card, providing optimized Ethernet-based network connectivity for training and inference on the largest AI clusters. https://www.intel.com/... [image]
Alright, the Gaudi3 whitepaper doesn't seem to be in an ideal shape. An overlapping table somewhere, a page with only two words, and... spot the accidental swastika too
I'm not sure why Intel was so keen to talk FP8 FLOPS for Gaudi3 The more impressive spec IMHO is BF16/FP16 perf. #Intel blows #Nvidia and #AMD out of the water at half precision. You can find my full two-page write up @theregister here: ⬇️ https://www.theregister.com/ ... [image]
OK - it's official, @PGelsinger is dancing on stage with Gaudi 3. Introducing @intel's latest AI accelerator -across the board incredible numbers related to perf per watt and perf per dollar - training and inference. Available as a mezz card, PCIe card or a baseboard.... [image]
“Overall, I don't think Intel is getting as much credit as they deserve, primarily for what their foundry business will be bringing in,” says @PatrickMoorhead on $INTC's new Gaudi 3 AI chip announcement. “It gets much more interesting when they bring an AI GPU to market in 2025.”…
Granite Rapids will FUNDAMENTALLY change the way AI will be implemented in the enterprise. ⭐ On stage at #IntelVision, @PGelsinger ran a 70 billion parameter 4-bit model entirely on Xeon in just 86 milliseconds. https://www.intel.com/... [image]
The TLDR is that it isn't a zero sum game . @intel Gaudi 3 (and 2 for that matter) is a compelling part but there is a lot of software and ecosystem work to gain adoption and make it “market competitive” with @Nvidia. The claims on efficiency and speed are definitely noteworthy..…
@IanCutress @intel Official comment from Habana: “Our methodology was to use only IPs that were already proven in silicon before we tape out. At the time we taped out Gaudi3 there was simply no available physical layers that were validated to meet our standards,” COO Eitan Medina…
The potential impact of Gaudi3 on nvidia? The performance is probably less critical than its developer ecosystem and the software abstractions that make Gaudi 3 accessible for AI workloads. Over time, as layers of abstraction move up the stack and Intel delivers on the promise of…
Together, we are making AI accessible for enterprises at the edge. By leveraging Retrieval Augmentation, we empower organizations to develop unique solutions, propelling businesses into an AI-driven future. Learn more ⬇️ #IntelVision
Whitepaper is now live. It's certainly more detailed than previous Gaudi disclosures! I'm sending questions back to the Intel team, mostly clarifications on exact numbers etc
🎤We've got some of the brightest minds in business and tech at #IntelVision 2024 ready to share insights on how AI is powering business optimization. We're bringing #AI everywhere with @intel #silicon, #software, and services. Watch here: https://www.linkedin.com/... #Intel [imag…
📞Calling all global enterprises looking to deploy GenAI. Intel's Gaudi 3 AI accelerator delivers 50% better inference and 40% better power efficiency than Nvidia H100 - at a fraction of the cost. [image]
The #IntelGaudi 3 #AI accelerator offers a highly competitive alternative to NVIDIA's H100 with higher performance, increased scalability, and PyTorch integration. Explore more key product benefits. https://www.intel.com/... [video]
.@intel said its upcoming Gaudi 3 AI accelerator chip can best Nvidia's powerful H100 GPU for training large language models and offer similar or, in some cases, better performance than the rival's memory-rich H200 for large language model inferencing. https://www.crn.com/...
Tbh I got lots of flack for backing the Intel chips on a technical basis but good chips are good chips and they have done a huge amount of work on open XLa, sycl-CUDA conversion and building out openVINO etc. definitely check out the dev cloud and build stuff for NPUs too [image]
Gaudi3 out, looks like a much beefier version of Gaudi2 + emphasis on interconnect, a bit like TPUs. Quoted numbers are fp8 which is non trivial at the moment, but supposedly pytorch compatible (native pytorch ops or intermediate like ONNX ?) https://www.nextplatform.com/ ...
Announced at #IntelVision, Gaudi 3 offers an open-source AI software stack for better #GenerativeAI performance and is projected to average 1.5x faster time-to-train. Learn more ⬇️ #LLM #Intel #IntelGaudi
At #IntelVision, it was announced that Intel is dropping the Xeon Scalable Processor branding going forward. 6th gen will simply be called Xeon 6. It's a good change. Warning, it's not retroactive (like Wi-Fi was). SPR is still 4th Gen Xeon SP, EMR is still 5th Gen Xeon SP. [imag…
Developing open, secure GenAI systems that deliver best-in-class ease of deployment, performance and value enabled by retrieval-augmented. @Intel, @SAP, @RedHat, @VMware and others are committed to developing an open platform for enterprise AI. https://www.intel.com/... [image]
. @intel just took the wraps off its new #Gaudi3 #AI accelerator and announced the #Xeon6 line-up, comprised of both Sierra Forest and Granite Rapids-based chips, at #Vision2024. Some highlights and thoughts available over on @Forbes for those interested. https://www.forbes.com/.…
I just asked Intel's CEO @PGelsinger about Gaudi 3 cost, he said “it's not a little below, but a lot below” Nvidia's offering. Much like Nvidia, Intel not giving exact pricing today but shows how they plan to compete. $INTC $NVDA
At #IntelVision, customers shared their successes with Gaudi accelerators and their commitment to Intel's enterprise AI approach. Read the thread to learn about improved productivity, simplified deployments, and accelerated revenue generation from Intel's solutions. [image]
Open, secure, turnkey solutions to deploy GenAI using your own data make the difference between successful deployments and AI failures. Intel is working with the ecosystem to provide a “secure easy button” for enterprise AI. Learn more. https://www.intel.com/... [image]
“We are excited to be adding Gaudi 3 AI Accelerators to our PowerEdge XE9680 lineup this year! It's a game-changer. Gaudi 3 strengthens our partnership by addressing customer infrastructure needs, reducing TCO and easing deployment.” -@MichaelDell #IntelVision [image]
Told you so, Gaudi3 also way lower TCO, particularly with the Ethernet interconnect (3.7 Tb/s) vs custom which ramps pricing for pods. Will be pretty easily available too, lots of diffusion transformers everywhere... Good job team @HabanaLabs 👏 [image]
The Gaudi 3 $INTC will start shipping later in 2024, and Intel says it has already received commitments from Dell $DELL, Super Micro $SMCI, HP Enterprise $HPE, and Lenovo to build Gaudi 3 systems and servers.
🌐 The Dell #PowerEdge XE9680 takes a giant leap in #AI & HPC with @intel Gaudi 3 AI Accelerator! 🚀 Dive into our blog to see how it's reshaping the future of #GenAI acceleration, offering unparalleled support for complex workloads: https://www.dell.com/...
The #IntelVision keynote with CEO @PGelsinger has kicked off! Follow along as Intel unleashes enterprise AI with Gaudi 3, AI open systems strategy and new customer wins: https://www.intel.com/... [image]
The Gaudi 3 AI accelerator is composed of two compute dies, which are identical, while one is rotated for packaging and build the interconnect. The schematics by Intel are not correct, but simplified to show the I/O with 24x 200GbE, PCIe 5.0 x16 and Media Engine. [image]