Jensen Huang – TPU competition, why we should sell chips to China, & Nvidia’s supply chain moat

Key Takeaways

• •

  Nvidia’s moat is managing the entire AI ecosystem

  “The fact that Nvidia's downstream supply chain and our downstream demand is so large, they're willing to make the investment upstream. And so, if you look at GTC and people are marveled by the scale of GTC, it's the entire universe of AI all in one place. I bring them together so that the downstream could see the upstream, the upstream could see the downstream, and all of them could see all the advances in AI.”

• •

  Agents will exponentially increase software tool usage

  “I think the number of agents are going to grow exponentially. The number of tool users are going to grow exponentially. And it's very likely that the number of instances of all these tools are going to skyrocket. Today we're limited by the number of engineers. Tomorrow, those engineers are going to be supported by a bunch of agents. And we're going to be exploring out the design space like you've never seen explored before.”

• •

  Physical infrastructure is the hardest scaling bottleneck

  “At some level, the instantaneous demand is greater than the supply upstream and downstream in the world. And it could be at any instance, we could be limited by the number of plumbers, which actually happens. I actually went to the hardest one. Yeah, plumbers and electricians. And the reason for that is because, if we're too far apart, the industry swarms it.”

• •

  Massive purchase commitments ensure long-term supply

  “If our next several years is a trillion dollars in scale, we have the supply chain to do it. Without our reach, the velocity of our business, just as there's cash flow, there's supply chain flow, there are turns. Nobody is going to build a supply chain for an architecture if the architecture, the business turns is low. Our ability to sustain the scale is only because our downstream demand is so great.”

• •

  Nvidia views itself as an electron-to-token factory

  “The input is electron, the output is tokens. That is in the middle, Nvidia. And our job is to do as much as necessary, as little as possible to enable that transformation to be done at incredible capabilities. Making that token, it's like making one molecule more valuable than another molecule. Making one token more valuable than another. The amount of artistry, engineering, science, invention that goes into making that token valuable, obviously we're watching it happening in real time.”

Episode Description

I asked Jensen about TPU competition, Nvidia’s lock on the ever more bottlenecked supply chain needed to make advanced chips, whether we should be selling AI chips to China, why Nvidia doesn’t just become a hyperscaler, how it makes its investments, and much more. Enjoy! Watch on YouTube; read the transcript. Sponsors * Crusoe’s cloud runs on state-of-the-art Blackwell GPUs, with Vera Rubin deployment scheduled for later this year. But hardware is only part of the story—for inference, Crusoe’s MemoryAlloy tech implements a cluster-wide KV cache, delivering up to 10x faster TTFT and 5x better throughput than vLLM. Learn more at crusoe.ai/dwarkesh * Cursor helped me build an AI co-researcher over the course of a weekend. Now I have an AI agent that I can collaborate with in Google Docs via inline comment threads! And while other agentic coding tools feel like a total black-box, Cursor let me stay on top of the full implementation. You can try my co-researcher out at github.com/dwarkeshsp/ai_coworker, or get started on your own Cursor project today at cursor.com/dwarkesh * Jane Street spent ~20,000 GPU hours training backdoors into 3 different language models, then challenged my audience to find the triggers. They received some clever solutions—like comparing the base and fine-tuned versions and extrapolating any differences to reveal the hidden backdoor—but no one was able to solve all 3. So if open problems like this excite you, Jane Street is hiring. Learn more at janestreet.com/dwarkesh Timestamps (00:00:00) – Is Nvidia’s biggest moat its grip on scarce supply chains? (00:16:25) – Will TPUs break Nvidia’s hold on AI compute? (00:41:06) – Why doesn’t Nvidia become a hyperscaler? (00:57:36) – Should we be selling AI chips to China? (01:35:06) – Why doesn’t Nvidia make multiple different chip architectures? Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe