Microsoft’s new AI chip makes it less reliant on Nvidia’s GPUs

Microsoft’s Maia 300 chip. | Image: Microsoft Microsoft is announcing its third-generation Maia in-house AI chip today, designed to be the “primary AI inference system” for Microsoft’s products and services. Maia 300 not only improves the cost and efficiency of running AI workloads in the cloud, it’s also more capable of handling the latest reasoning models and agentic tasks. Maia 300 will start being rolled out to production in 2027, and it has been designed with efficiency in mind. “We expect Maia 300 to deliver 40 percent more tokens per megawatt compared to leading GPU-based systems,” says Scott Guthrie, executive vice president of Microsoft’s cloud group. “And in a full 96-acceler … Read the full story at The Verge.

Microsoft is announcing its third-generation Maia in-house AI chip today, designed to be the “primary AI inference system” for Microsoft’s products and services. Maia 300 not only improves the cost and efficiency of running AI workloads in the cloud, it’s also more capable of handling the latest reasoning models and agentic tasks. Maia 300 will start being rolled out to production in 2027, and it has been designed with efficiency in mind. “We expect Maia 300 to deliver 40 percent more tokens per megawatt compared to leading GPU-based systems,” says Scott Guthrie, executive vice president of Microsoft’s cloud group.

“And in a full 96-accelerator configuration, it delivers up to 7x the rack-scale token throughput of Maia 200.” These efficiency improvements will allow Microsoft to rely mainly on its in-house AI chips soon, instead of ones from Nvidia and AMD. “We will scale our Azure Maia family to multi-gigawatt