Microsoft announces the Maia 100 chip for Azure clients, already in testing for its Bing and Office AI tools, and Cobalt, a chip for servers, launching in 2024
Software giant seeks to reduce dependence on outside suppliers in two key growth areas.
Context & Ripple Effects
Microsoft’s move extends Azure’s earlier break from an Intel-only server approach, including its reported use of Xilinx co-processors in 2018. Maia and Cobalt bring that diversification in-house across AI acceleration and general server compute.
The announcement became an execution path rather than a one-off: Cobalt 100 was later slated for an Azure public preview, while a second-generation Maia accelerator shows the AI-chip effort continued beyond the initial deployment.
First-order effects
- Microsoft can test Maia 100 against its own Bing and Office AI workloads while preparing it for Azure clients, creating a direct in-house alternative for part of its AI compute demand.
- Cobalt gives Azure a Microsoft-designed server chip scheduled for 2024, broadening the infrastructure components Microsoft controls.
Second-order effects
- Azure must validate and expose new hardware options to customers, making software compatibility, deployment tooling, and workload placement more important alongside raw chip performance.
- Outside chip suppliers face a narrower share of Microsoft’s addressable infrastructure demand where Maia and Cobalt are deployed, even as Azure retains a mixed hardware estate.
Third-order effects
- If Microsoft sustains successive chip generations, cloud competition shifts further toward vertically integrated stacks in which proprietary silicon is tuned to first-party services and cloud offerings.
- The likely durable outcome is heterogeneous data-center compute: customers and providers will increasingly choose among specialized accelerators and server processors rather than rely on a single architecture.
The trend: This is an early instance of hyperscalers turning AI infrastructure from a purchased component market into an integrated hardware-and-cloud-service strategy.
Related: Integrated AI Stack · Heterogeneous AI compute · AI hardware strategy split · Azure · Microsoft unveils Maia 200 · Cobalt 100 Azure public preview
Related Coverage
- With a systems approach to chips, Microsoft aims to tailor everything ‘from silicon to service’ to meet AI demand Microsoft · Jake Siegel
- Welcoming Mistral, Phi, Jais, Code Llama, NVIDIA Nemotron, and more to the Azure AI Model Catalog Microsoft Tech Community · Rashaud Savage
- Microsoft Infrastructure - AI & CPU Custom Silicon Maia 100, Athena, Cobalt 100 SemiAnalysis
- Microsoft Ignite 2023: AI transformation and the technology driving change The Official Microsoft Blog · Frank X. Shaw
- Microsoft is finally making custom chips — and they're all about AI The Verge · Tom Warren
- Microsoft announces custom AI chip that could compete with Nvidia CNBC · Jordan Novet
- Microsoft debuts its own chips for enterprise AI: ‘Maia’ and ‘Cobalt’ VentureBeat · Shubham Sharma
- Key takeaways from Microsoft Ignite 2023 TechCircle · Shraddha Goled
- Microsoft reveals custom chips to power AI workloads on Azure Tech Monitor · Matthew Gooding
- Microsoft's Strategic Shift: Embracing Smaller Language Models with Phi-2 Analytics India Magazine · Pritam Bordoloi
- Microsoft Designs Custom AI and ARM Chips for Enhanced Cloud Services WinBuzzer · Luke Jones
- Microsoft's Azure Maia AI chip and Cobalt CPU planned for 2024, powering tons of copilots The Decoder · Matthias Bastian
- Microsoft introduces its own chips for AI, with eye on cost Reuters · Stephen Nellis
- Microsoft is starting to produce custom CPUs Ghacks · Emre Çitak
- Microsoft enters the AI chips market to challenge Nvidia Silicon Republic · Leigh Mc Gowran
- Microsoft Maia AI chip ‘last puzzle piece’ for infrastructure systems Cointelegraph · Savannah Fortis
- Microsoft enters the chip game with its own Arm processors for AI and computing workloads Windows Central · Zac Bowden
- Microsoft looks to free itself from GPU shackles by designing custom AI chips TechCrunch · Kyle Wiggers
- Microsoft unveils first in-house AI and cloud chips in trend towards custom silicon South China Morning Post
- Microsoft Unveils Azure Cobalt CPU: A New Era in Cloud Computing and AI Cryptopolitan · Brenda Kanana
- New NVIDIA H100, H200 Tensor Core GPU Instances Coming to Microsoft Azure to Accelerate AI Workloads NVIDIA · Dave Salvator
- Microsoft Reveals Custom 128-Core Arm Datacenter CPU, Massive Maia 100 GPU Designed for AI Tom's Hardware · Andrew E. Freedman
- Microsoft debuts its own AI chips Axios · Ina Fried
- AMD Brings New AI and Compute Capabilities to Microsoft Customers Advanced Micro Devices, Inc.
- Microsoft partners with Arm for in-house cloud CPUs UKTN · George Simister
- Cloud roundup: Microsoft unveils its first AI chip Light Reading · Kelsey Kusterer Ziser
- Microsoft Reveals Its First Custom Processors ExtremeTech · Ryan Whitwam
- Microsoft introduces its own chips for AI iTnews · Stephen Nellis
- Microsoft Azure delivers purpose-built cloud infrastructure in the era of AI Microsoft Azure Blog · Omar Khan
- Microsoft Launches Custom AI Chips, As Competition Heats Up With Nvidia And Google Forbes · Brian Bushard
- Microsoft to boost ChatGPT performance with in-house AI chips Nikkei Asia · Naoki Watanabe
- Microsoft Azure Is The First Cloud Service To Feature AMD Instinct MI300X, 4th Gen EPYC VMs In Q1 2024 Wccftech · Hassan Mujtaba
- First dedicated AI accelerators and in-house Arm processors unveiled for Microsoft Azure SiliconANGLE · Mike Wheatley
- Ignite 2023: Microsoft Announces Two Custom AI Chipsets for the Cloud Thurrott · Paul Thurrott
- Microsoft launches AI chips as developers seek Nvidia alternatives Financial Times · Tim Bradshaw
- Today at #MSIgnite we're unveiling the first generation of Microsoft's custom silicon as part of our holistic systems approach to co-designing hardware and software. … Rani Borkar
- Microsoft introduces its own chips for AI, with eye on cost Hacker News
- Microsoft is fine avoiding China as U.S. considers national security implications, CEO Satya Nadella says CNBC · Jordan Novet
- GitHub Aims to Expand Copilot Scope and Reach in 2024 DevOps.com · Mike Vizard
- Exclusive: Mat Honan grabbed Satya Nadella for a chat while the Microsoft CEO was on a whirlwind tour of developers last week. … Niall Firth
- Last week, Microsoft CEO Satya Nadella showed up unannounced at two developers' conferences hosted by OpenAI and GitHub. … Mat Honan
Discussion
-
@tomwarrenuk
Tom Warren
on threads
Microsoft CEO Satya Nadella says Microsoft's new Cobalt CPU is “the fastest of any cloud provider.” That's quite the claim. I look forward to the benchmarks in 2024 https://www.theverge.com/...
-
@firstadopter
Tae Kim
on threads
Microsoft tells Barron's its Azure Maia AI chip is manufactured on a 5-nanometer process and has 105 billion transistors https://www.barrons.com/...
-
@austinnotduncan
Austin Evans
on threads
Microsoft making custom CPUs and GPUs is a big deal. Give this a few years and we might see trickle down to consumer devices.
-
@greengart
Avi Greengart
on threads
.@microsoft is designing its own custom silicon for #AI in Azure (reducing reliance on Nvidia) and an Arm processor for general purpose computing, also in its cloud infrastructure. Microsoft has designed silicon before (it collaborates with Qualcomm for Ssurface Arm processors, …
-
@daniel_rubino
Daniel Rubino
on threads
Microsoft is making its own ARM chips 👀 ... for servers and AI 😴 https://www.windowscentral.com/ ... #Microsoft
-
@maryjofoley
Mary Jo Foley
on x
MS CEO Nadella announces 2 new Microsoft-developed chips at #MSIgnite. “Maia” is an AI accelerator and “Cobalt” is a general-purpose Arm chip (which customers can get access to via VMs next year): https://www.directionsonmicrosoft.com/ ... [image]
-
@microsoft
@microsoft
on x
We are announcing new innovations across our datacenter fleet, including the latest AI optimized silicon from our industry partners and two new Microsoft-designed chips. #MSIgnite https://news.microsoft.com/... [video]
-
@scottgu
Scott Guthrie
on x
Microsoft has reimagined our infrastructure with an end-to-end systems approach to meet our customer's unique AI and cloud needs. With the launch of our new AI Accelerator, Azure Maia, and cloud native CPU, Azure Cobalt, alongside our continued partnerships with silicon...
-
@migueldeicaza
Miguel de Icaza
on x
This is what I worked on while at Microsoft Finally public: https://www.theverge.com/...
-
@andrewcurran_
Andrew Curran
on x
This used to be called Project Athena, AMD was more involved initially. Looks like they settled on ‘Maia 100’ as the name, or, in full, the ‘Maia AI Accelerator’. Coming to Bing in 2024. [image]
-
@dylan522p
Dylan Patel
on x
Microsoft Infrastructure - AI & CPU Custom Silicon Maia 100 M100, Athena, Cobalt 100 Specifications, Volumes, GPT-4 performance, Next Generation Timing / Name, Backend Design Partner $NVDA $AMD $AMZN $MSFT $MRVL $INTC $GOOG $GOOGL https://www.semianalysis.com/ ...
-
@jordannovet
Jordan Novet
on x
Microsoft's first AI chip is here: the Maia 100 will support sub-8bit floating-point precision, enabling fast training and compute also Microsoft has its own Arm chip, the Cobalt 100, that is performing better than existing Arm chips in Azure https://www.cnbc.com/...
-
@patrickmoorhead
Patrick Moorhead
on x
Microsoft Takes “Shock And Awe” Approach To New Azure Custom And Merchant Silicon For AI And General Purpose Workloads At #MSIgnite, Microsoft went all “shock and awe” in one of the biggest displays I have seen from a CSP in a while. Custom-silicon: 1/ Microsoft Azure Maia AI... …
-
@jordannovet
Jordan Novet
on x
interesting that OpenAI got a chance to participate on the Maia chip development
-
@tomwarren
Tom Warren
on x
Microsoft is finally making custom chips — and they're all about AI. Say hello to Microsoft's own Cobalt CPU and its Maia AI chip. Full details on Microsoft's custom silicon here: https://www.theverge.com/... [image]
-
@benbajarin
Ben Bajarin
on x
As predicted. As I like to say, those serious about platforms need to be serious about silicon. Strategically, very important for @Microsoft.
-
r/LocalLLaMA
r
on reddit
Microsoft announced the Maia 100 AI Accelerator Chip. It's also expanding the use of the AMD MI300 in it's datacenters. Is this the beginning of the end of CUDA dominance?
-
r/AMD_Stock
r
on reddit
Microsoft is finally making custom chips — and they're all about AI
-
r/technews
r
on reddit
Microsoft is finally making custom chips — and they're all about AI
-
r/technology
r
on reddit
Microsoft announces custom AI chip that could compete with Nvidia
-
r/AMD_Stock
r
on reddit
Microsoft Infrastructure - AI & CPU Custom Silicon Maia 100 M100, Athena, Cobalt 100
-
r/AMD_Technology_Bets
r
on reddit
Microsoft announces custom AI chip that could compete with Nvidia
-
r/wallstreetbets
r
on reddit
Microsoft's own AI chip independence from Nvidia
-
@trengriffin
Tren Griffin
on x
Satya Nadella: “The mobile era was fantastic. It made ubiquitous consumption of services. It didn't translate into ubiquitous creation of services. The last time there was a broad spread of productivity because of information technology was the PC.” https://www.technologyreview.c…
-
@modestproposal1
@modestproposal1
on x
finally a chance to hear what nadella and msft think about AI. they've been notably quiet on the topic.
-
@fxshaw
Frank X. Shaw
on x
“Behind Microsoft CEO Satya Nadella's push to get AI tools in developers' hands” good one from @mat https://www.technologyreview.com/ ...