EP. 105 · 03.07.2026 · 1:02:33
ATTENTION, MIXTURES, AND THE ARCHITECTURE OF GEMINI
with Noam Shazeer
Video coming soon
AI ResearchAI1:02:33
ABOUT THIS EPISODE
THE CONVERSATION
Noam Shazeer joins the DAO podcast to discuss attention, mixtures, and the architecture of gemini — and what it means for the trajectory of artificial intelligence over the next decade.
GUESTS
ON THE ROUNDTABLE
N
NOAM SHAZEER
Co-lead, Gemini, Google
Co-author of Attention Is All You Need and co-founder of Character.AI. Now back at Google leading Gemini.
RELATED EPISODES
EP. 1432:07:11
THE TAO OF INNOVATION: STEVEN HOFFMAN ON BUILDING GLOBAL STARTUPS
with Steven Hoffman (Captain Hoff)
EP. 1441:15:33
CHINA'S AI UNDERDOGS: STARTUP LESSONS FROM BEIJING TO SHENZHEN
with Li Xiaohua
EP. 1421:42:08
THE AI INFRASTRUCTURE BUBBLE: CAPEX, GPU CLUSTERS, AND THE NEW RAILROADS
with Lin Wei & Marcus Cho