AMD launches its Instinct MI325X GPU to compete with Nvidia's upcoming Blackwell chips and says production will start in 2024, but doesn't disclose its pricing

AMD launched a new artificial-intelligence chip on Thursday that is taking direct aim at Nvidia's data center graphics processors, known as GPUs.

CNBC 2024-10-11 Kif Leswing

Context & Ripple Effects

AMD had already laid out a yearly data-center GPU cadence centered on MI325X and said it was accelerating accelerator releases. This launch turns that roadmap into a product aimed at the same data-center GPU segment as Nvidia's forthcoming Blackwell generation.

It also extends AMD's progression from the MI300 accelerator family preview to the MI300X/MI300A launch, making the MI325X the next test of whether a faster refresh cycle can strengthen its position in AI infrastructure.

First-order effects

AMD adds the MI325X as its current competitive offering against Nvidia's upcoming Blackwell data-center GPUs, with production planned to begin in 2024.
Prospective data-center buyers gain another named accelerator option, but cannot yet assess its purchase economics because AMD has not disclosed pricing.

Second-order effects

Nvidia faces a more explicit challenge at its next product transition, while AMD must convert its claimed positioning into production availability and customer adoption.
Server and cloud buyers evaluating AI capacity may time procurement around the competing launch cycles, increasing the importance of platform compatibility and total system cost alongside chip performance.

Third-order effects

If AMD sustains the stated annual cadence, AI accelerator competition could shift from isolated flagship launches toward recurring, closely timed platform refreshes.
That pattern would make the surrounding software and system ecosystem a more durable differentiator, not just peak GPU specifications, as buyers weigh heterogeneous compute options.

The trend: The MI325X is one data point in the shift toward faster, more regularly scheduled AI-accelerator generations competing for data-center capacity.

Discussion

@benbajarin Ben Bajarin on x
As optomistic as I am on @AMD's server CPU parts, the accellerator effort is their most strategic. Below is the outline for Mi325x. • Mi325 offers 1.3 times more memory bandwidth compared to competitors • Enhanced AI performance with the new Mi325 model • Mi325 leverages
@hpc_guru @hpc_guru on x
.@AMD #MI350 CDNA4 #GPU in 2H2025 will be a generational performance leap over CDNA3 o 7x #AI compute o 1.5x memory bandwidth and capacity o Improved network o FP6 and FP4 datatypes [image]
@beth_kindig Beth Kindig on x
AMD $AMD launched its MI325X GPU with mass production set to commence this quarter, with vendors such as Super Micro $SMCI shipping MI325X-equipped AI servers in Q1 2025. $NVDA
@firstadopter Tae Kim on x
The competitive gamesmanship in the chip industry is entertaining. I'm certain the GB200 customer tweets just days before the MI325X announcement was not coincidental.
@hpc_guru @hpc_guru on x
@LisaSu @AMD On the #GPU front, @AMDInstinct #MI300 claims up to 30% higher performance than the Nvidia #H100 Launch of #MI325X - 256GB HBM3E- OCP compliant platform - claim up to 1.4x inference over #H200 Close to par with H200 on #AI training perf on Llama-2 70B #AI #HPC [image…
@iancutress @iancutress on x
@AMD First @AMD CDNA4 product is MI355X. ▶️ 9.2 PetaOPs for FP4 ▶️ 4.6 PetaOPs for FP8 ▶️ 2.3 PetaOPs for FP16 [image]
@amd @amd on x
AMD continues executing its annual cadence of AI accelerators with the launch of the AMD Instinct MI325X accelerator today. We're also excited to share an early look of the next-gen AMD Instinct MI350 series accelerators, extending generative AI performance leadership. [image]
@iancutress @iancutress on x
@AMD Unofficially, the hbm stacks are still 288gb. I bet it's because of memory down bins - allows for better supply and support at the expense of capacity. Hbm3e is hard to get in volume, hard to validate too. Giving some wiggle room helps
@iancutress @iancutress on x
@AMD @googlecloud Yes, it's 256gb hbm3e, not the 288gb they announced earlier this year. Reason? Compute to mem is better suited, officially.
@amd @amd on x
Say hello to the AMD Instinct MI325X accelerator - Extending our leadership in generative AI. ✅ Built on the AMD CDNA3 architecture ✅ Industry-leading 256GB of HBM3E memory ✅ System availability from @Dell, @HPE, @Lenovodc, @Supermicro_SMCI and other providers starting in Q1 [ima…
@aschilling Andreas Schilling on x
Found an Instinct MI325X with HBM3E. Unfortunately only with the cooler attached. [image]
@iancutress @iancutress on x
@AMD @googlecloud Close up. Looks the same, but more mem, faster mem, higher core frequency [image]
@iancutress @iancutress on x
@AMD ... MI350 in 2H25. ▶️ 3nm ▶️ 288gb HBM3e ▶️ CDNA4 ▶️ FP4/FP6 [image]
@cnbc @cnbc on x
AMD CEO Lisa Su discusses the company launching a new AI chip on Thursday that is taking direct aim at Nvidia's data center graphics processors, known as GPUs. Read more: https://www.cnbc.com/... [video]
@dylanonchips @dylanonchips on x
.@AMD said its forthcoming 256-GB Instinct MI325X GPU can outperform @Nvidia's 141-GB H200 processor on AI inference workloads and vowed that the next-generation MI350 accelerator chips will improve performance by magnitudes. https://www.crn.com/...
@cudahandbook Nicholas Wilt on x
I added the CUDA features for MCP7, back when GPUs were integrated into the northbridge. The fundamental problem w APUs is that any GPU work is bookended by launch latency on the one hand and waiting for the GPU to finish on the other.
@never_released @never_released on x
I'm told that's inaccurate, but that future APUs are more a gen to gen decision instead of shipping every time
@patrickmoorhead Patrick Moorhead on x
So @satyanadella said: 'we're very excited about your roadmap' Performance Per Dollar Per Watt. That's a very big statement. I don't perceive that as a typical throwaway executive speak line. $AMD $MSFT
@patrickmoorhead Patrick Moorhead on x
AMD Instinct MI325X launches today. Same platform as MI300. (Drop in). Compare to H100. Big perf claims on inference. Production Q4, which likely means Q1 customer rollout. Oracle on stage talking how it integrates AMD GPUs. $AMD $ORCL [image]
@patrickmoorhead Patrick Moorhead on x
What's next? MI350 in 2H25. Updated architecture (CDNA4). Better support for lower bit rate. Huge performance claims. Also platform drop in for MI3X products. @satyanadella support interview. $AMD $MSFT [image]
@ryansmithat Ryan Smith on x
“BTW: Instinct MI300A with Zen CCDs will not have a successor.” I'm not surprised. Still, that's unfortunate. I would have liked to see what AMD could have done. Over a decade after HSA/Fusion fizzled out, and most products still don't offer better CPU/GPU interoperability.
@sasamarinkovic Saša Marinković on x
40% more inference performance than @nvidia H200! @AMD MI325X [image]
@aschilling Andreas Schilling on x
Downgrading Instinct MI325X from 288 to 256 GB seams to be a choice to have some room for steering the manufacturing of it. Instinct MI355X will arrive with 288 GB - for now. It's a 2H 2025 product, so we will see. BTW: Instinct MI300A with Zen CCDs will not have a successor. [im…
@patrickmoorhead Patrick Moorhead on x
Wow! Meta announces that is has installed 1.5M Epyc processors. All live traffic for Llama 405b runs EXCLUSIVELY on MI300X. 🔥 $AMD $META [image]
@benbajarin Ben Bajarin on x
Here is MI325X. I figured wattage was higher from MI300 and MI325 comes in at 1000W. [image]
@benbajarin Ben Bajarin on x
Here is MI325X. I figured wattage was higher from MI300 and MI325 comes in at 1000W.
r/artificial r on reddit
One-Minute Daily AI News 10/10/2024
r/gadgets r on reddit
AMD launches AI chip to rival Nvidia's Blackwell | AMD launched a new artificial-intelligence chip on Thursday that is taking direct aim at Nvidia's data center graphics processors.
r/technews r on reddit
AMD launches AI chip to rival Nvidia's Blackwell
r/technology r on reddit
AMD launches AI chip to rival Nvidia's Blackwell
Phoronix Michael Larabel on x
AMD EPYC 9965 “Turin Dense” Delivers Better Performance/Power Efficiency vs. AmpereOne 192-Core ARM CPU
@patrickmoorhead Patrick Moorhead on x
So what do AMD's announcements mean competitively to Nvidia and Intel? My first and quick reaction..... AMD looks like it increased the distance between itself and Intel with Epyc server CPUs. AMD currently has 50-60% market share with the hyoerscalers and I don't see that [image…

Chronicles