Overview
In this deep dive into the mechanics of the AI revolution, Gavin Baker joins Patrick O'Shaughnessy to dissect the 'Great Game' being played between hyperscalers and chip manufacturers. Baker argues that the industry recently narrowly avoided a stagnation period; while waiting for Nvidia's complex Blackwell chips, the emergence of 'reasoning' models (like o1) introduced new scaling laws based on verified rewards, effectively saving the progress curve. He posits that AI has fundamentally shifted the tech valuation paradigm: for the first time, being the low-cost producer matters, a dynamic currently favoring Google's TPUs but likely to shift toward XAI and Nvidia's merchant silicon in 2026.
The conversation extends beyond silicon into the existential risks for software companies. Baker warns that high-margin SaaS incumbents are repeating the mistakes of brick-and-mortar retailers by refusing to accept the lower gross margin structure of AI agents, leaving them vulnerable to disruption. The dialogue concludes with a futuristic yet first-principles case for space-based data centers and a personal reflection on investing as a competitive search for hidden truths through history and current events.
Sections
Meta-Level Observations
Synthesized patterns regarding industry dynamics and geopolitical implications.
- The 'Verified Rewards' Flywheel: Reasoning models allow labs to verify outcomes (did the code run? did the math balance?), creating a data flywheel that didn't exist with creative writing models. This reintroduces 'increasing returns to scale' for labs that can harness this feedback loop.
- Geopolitics of Chip Lag: The gap between Western frontier models and Chinese open source is set to widen significantly because Chinese labs cannot access Blackwell-class compute. While they could emulate older chips, the specific complexity of Blackwell makes the 'compute gap' insurmountable for the next generation.
- The 'Usefulness' Handoff: The industry is nearing a point of diminishing returns on raw intelligence for consumer applications. The value curve must shift from 'smarter models' to 'longer context/reliable agents' (usefulness) to bridge the gap before AI can achieve scientific breakthroughs (curing cancer).
Future Forecasts
Specific predictions made by Gavin Baker regarding technology and market movements.
- XAI will release the first model trained on Nvidia Blackwell chips, likely in early 2026.
- Google will eventually bring its silicon design entirely in-house, moving away from its partnership with Broadcom to capture the ~50% gross margins currently paid to them.
- A 'Bear Case' for AI Compute: Edge AI on smartphones (Apple) becomes 'good enough' (115 IQ at 30 tokens/sec), significantly reducing the demand for massive cloud-based inference.
Lessons for Investors & Builders
Takeaways derived from Baker's experience and observations.
- Investing is the search for hidden truths found at the intersection of history and current events. True alpha comes from identifying these truths before the pari-mutuel system of the market prices them in.
- Empathy and humility are critical professional traits. Baker cites his time cleaning toilets as a housekeeper as pivotal in shaping how he treats founders and service workers, contrasting it with the arrogance often found in finance.
- Don't judge the capability of a technology based on its free tier. Most skeptics judge AI based on '10-year-old' free models rather than the 'adult' paid versions.
Memorable Quotes
Verbatim excerpts capturing the essence of the conversation.
- To a large degree open AI runs on Twitter vibes... I just think AI happens on X.
- With software, anything you can specify, you can automate. With AI, anything you can verify, you can automate.
- I'm amazed at how many famous and August investors are reaching really definitive conclusions about AI... based on the free tier.
- Whatever AI needs to keep growing and advancing, it gets. Have you ever seen public opinion change so fast in the United States on any issue has nuclear power?