Get the latest ideas from Dwarkesh Patel.
Plus the best new takeaways about artificial intelligence from other top podcasts — read in minutes, not hours.
or
By continuing, you agree to podbrain's Terms and Privacy Policy.
Satya Nadella, CEO of Microsoft, and Scott Guthrie, Microsoft's EVP of Cloud and AI, are interviewed by Dwarkesh Patel, founder of SemiAnalysis, during a tour of Microsoft's new Fairwater 2 data center in Atlanta - currently the most powerful data center in the world.
The conversation covers Microsoft's massive AI infrastructure buildout, their strategic partnership with OpenAI, competition in the coding agent market, and the company's approach to building both hyperscale cloud services and their own AI models through MAI (Microsoft AI).
Nadella discusses the transition from traditional software business models to AI-intensive operations, the geopolitical implications of AI sovereignty, and Microsoft's strategy for maintaining competitive advantage in an increasingly crowded AI landscape.
Microsoft's Unprecedented Data Center Scale and Network Architecture
The Fairwater 2 facility contains network optics equivalent to all of Azure from 2.5 years ago, with approximately 5 million network connections enabling massive model parallelism across sites.
Microsoft has pursued a strategy to '10x the training capacity every 18 to 24 months' while building fungible infrastructure that can adapt to different workloads and model architectures.
The facility connects via petabit networks to Fairwater 4 under construction and extends to Milwaukee data centers, creating a campus designed for superpods and cross-site training jobs.
AI as Cognitive Amplifier Rather Than Mystical Intelligence
Nadella embraces Raj Reddy's metaphor that AI serves as 'a cognitive amplifier and a guardian angel' - a tool rather than mystical superintelligence.
'Even what has been happening in the last 70 years of computing has also been a march that has helped us move' - Nadella frames AI as evolutionary rather than revolutionary.
The Industrial Revolution took 70 years for economic growth to manifest, suggesting AI's true economic impact may require similar diffusion timelines despite faster technological advancement.
GitHub's Dominance in AI-Generated Code Despite Fierce Competition
GitHub Copilot faces intense competition from Cursor, Claude Code, and Codex, with revenues now roughly equal around $1 billion each according to analyst estimates.
'GitHub is at an all-time high in terms of repo creation, PRs' as all AI coding tools ultimately store their generated code on GitHub's platform.
Microsoft plans to turn GitHub into 'agent HQ' - a control plane offering multiple AI agents (Codex, Claude, Cognition, Grok) in one subscription package.
GitHub gains 'one developer joining per second' with 80% automatically entering GitHub Copilot workflows, creating natural funnel effects.
Microsoft's Strategic Pause on Data Center Expansion
Microsoft paused some data center construction to avoid being 'stuck with massive scale of one generation' given rapid hardware evolution from GB200s to GB300s to Rubin architectures.
'We didn't want to just be a hoster for one company' - Microsoft pivoted from building primarily for OpenAI to serving diverse hyperscale workloads.
The company now pursues multiple capacity strategies: built-to-suite, leases, and 'GPUs as a service' through partnerships with Iris Energy, Nebius, and Lambda Labs.
OpenAI Partnership Terms and Intellectual Property Rights
Microsoft has 'IP rights to all OpenAI technology except consumer hardware' with access to system-level innovations and microarchitecture designs.
OpenAI's API business remains Azure-exclusive for seven years, while their SaaS business (ChatGPT) can run anywhere with some exceptions for custom integrations.
'We gave them a bunch of IP as well to bootstrap them' - the partnership involves bidirectional technology sharing beyond just Microsoft's infrastructure investment.
MAI Models and Microsoft's Dual-Track AI Strategy
Microsoft's MAI model debuted at 913 on LM Arena using only 15,000 H100s, demonstrating efficient scaling potential for future iterations.
'The last thing I don't want to do is use my flops in a way that is just duplicative and doesn't add much value' - MAI focuses on product optimization and research rather than replicating OpenAI capabilities.
The next MAI release will be an 'Omni model' combining Microsoft's work in audio, image, and text capabilities with personality optimization for Copilot.
AI Sovereignty and Global Technology Competition
'The United States is 4% of the world's population, 25% of the GDP, and 50% of the market cap' - ratios Nadella believes must be preserved through continued tech leadership.
Microsoft has built sovereign clouds in France and Germany with key management services and confidential computing to address European data residency requirements.
'Trust in American tech is probably the most important feature. It's not even the model capability, maybe' - trust becomes the key differentiator against Chinese competition.
From Dwarkesh Patel. Get a note like this from every new episode.