Lex Fridman · the podbrain notes ·
10 min read

Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games | Lex Fridman Podcast

The episode features Demis Hassabis, leader of Google DeepMind and Nobel Prize winner, in his second appearance on the podcast. Demis is recognized as one of the most brilliant minds working on understanding and building intelligence while exploring fundamental mysteries of the universe.

Lex Fridman Lex Fridman
Subscribe to Notes Upgrade
Lex Fridman episode thumbnail: Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games | Lex Fridman Podcast
Lex Fridman
Key Takeaways
  1. 01

    "Any pattern that can be generated or found in nature can be efficiently discovered and modeled by a classical learning algorithm" - Demis Hassabis' Nobel Prize lecture conjecture

  2. 02

    Natural systems have structure shaped by evolutionary processes, making them learnable - "survival of the stablest" principle applies beyond biological evolution

  3. 03

    Veo 3 video generation demonstrates surprising physics understanding by modeling fluids and materials from YouTube videos alone, suggesting lower-dimensional manifolds in reality

  4. 04

    AlphaFold proves proteins folding in milliseconds can be computationally solved, showing nature's problems aren't random but structured and tractable

  5. 05

    "I think information is primary. Information is the most fundamental unit of the universe, more fundamental than energy and matter" - Demis

  6. 06

    Demis estimates 50% chance of AGI by 2030, defining it as matching all cognitive functions of the human brain with consistency across domains

  7. 07

    "There's no such thing as failure really as long as you are picking experiments and hypotheses that meaningfully split the hypothesis space" - Demis on research methodology

  8. 08

    Energy abundance through fusion or advanced solar could solve water scarcity, enable space travel as "bus service," and end resource constraints - "radical abundance era"

Get the latest ideas from Lex Fridman.

Plus the best new takeaways about science from other top podcasts — read in minutes, not hours.

or

By continuing, you agree to podbrain's Terms and Privacy Policy.

These notes may contain occasional inaccuracies. Learn how podbrain notes are made

The episode features Demis Hassabis, leader of Google DeepMind and Nobel Prize winner, in his second appearance on the podcast. Demis is recognized as one of the most brilliant minds working on understanding and building intelligence while exploring fundamental mysteries of the universe.

The conversation begins with Demis' Nobel Prize lecture conjecture that any natural pattern can be efficiently modeled by classical learning algorithms, spanning biology, chemistry, physics, cosmology, and neuroscience. This provocative claim stems from AlphaGo and AlphaFold's success in modeling high-dimensional combinatorial spaces.

Discussion explores whether classical computers can model chaotic systems, fluid dynamics, and even consciousness itself, with Demis proposing a new complexity class for learnable natural systems. The conversation touches on P versus NP, the nature of reality as informational, and whether AGI breakthroughs will require new architectures beyond current scaling.

Later topics include video game design, Google's competitive position in AI, the future of human-AI interaction, concerns about job displacement, and the philosophical implications of consciousness and substrate. Demis shares his vision of post-AGI society with energy abundance and discusses the responsibilities of stewarding transformative technology.

Natural Patterns and Classical Computation

Demis' Nobel Prize lecture proposed the conjecture: "Any pattern that can be generated or found in nature can be efficiently discovered and modeled by a classical learning algorithm"

AlphaGo and AlphaFold demonstrate building models of combinatorially high-dimensional spaces that would be intractable through brute force enumeration - "there wouldn't be enough time in the time of the universe" - Demis

Natural systems have structure because they were subject to evolutionary processes that shaped them, making patterns learnable by neural networks through what Demis calls "survival of the stablest"

"If you think about geological times, the shape of mountains being shaped by weathering processes over thousands of years, the orbits of planets, shapes of asteroids - these have all survived processes that acted on them many times" - Demis

Manmade or abstract problems like factorizing large numbers may require quantum computers if there's no pattern to learn, but most natural systems of interest have evolved structure

P Equals NP and Complexity Theory

Demis is working in spare time with colleagues on defining a new complexity class for problems solvable by neural network processes mapped onto natural systems with structure

"I think information is primary. Information is the most fundamental unit of the universe, more fundamental than energy and matter. I think of the universe as a kind of informational system" - Demis

If the universe is informational, then P equals NP becomes a physics question that could help solve fundamental questions about reality

Current AI systems prove classical Turing machines can go far beyond previous expectations - "a lot of people would've thought maybe 10, 20 years ago that was decades away, or maybe you would need quantum machines" - Demis

"We haven't really even scratched the surface yet of what classical systems could do. AGI being built on a neural network system on top of a classical computer would be the ultimate expression of that" - Demis

Veo 3 and Physics Understanding

Veo video generation model can model liquids, materials, and specular lighting surprisingly well by extracting underlying structure from YouTube videos

"I used to write physics engines and graphics engines in my early days in gaming, and I know it's just so painstakingly hard to build programs that can do that" - Demis on fluid dynamics in Veo

Fluid dynamics and Navier-Stokes equations traditionally thought intractable on classical systems, yet Veo models them through passive observation without embodied interaction

"Perhaps there is some kind of lower dimensional manifold that can be learned if we actually fully understood what's going on under the hood. That's maybe true of most of reality" - Demis

Veo 3 challenges the assumption that embodied AI systems are required for understanding physical world - "it seems like you can understand it through passive observation, which is pretty surprising" - Demis

Video Games and Open World Design

Demis envisions AI-generated open world games where systems dynamically create content and narrative around player choices, beyond simple A-B branching or random generation

"Games like Theme Park that I worked on where everybody's game experience would be unique to them because you are kind of co-creating the game" - Demis on early open world design

With vibe coding improvements, Demis hopes to personally create games in spare time, alongside working on physics theory as post-AGI projects

"In the '90s and early 2000s, we weren't just making games, we felt we were creating a new entertainment medium where you as the player were co-creating the story" - Demis

Video games represent fusion of cutting-edge technology with artistic design - "all of the most interesting technical advances were happening in gaming" in the 1990s, including AI, graphics, physics engines, and GPUs

AlphaEvolve and Evolutionary Search

AlphaEvolve combines LLMs proposing solutions with evolutionary computing to find novel regions of search space, representing promising hybrid approach

"You've got the model of the underlying dynamics of the system, and then if you want to discover something new, you need some kind of search process on top" - Demis

Traditional evolutionary computing in the 1990s-2000s could never evolve new emergent properties, only subsets of input properties, but foundation models may overcome this limitation

"Naturally evolution clearly did evolve new capabilities from bacteria to where we are now. So clearly it must be possible with evolutionary systems to generate new patterns and new emergent properties" - Demis

Evolution as search process running over physics substrate for four billion years of computational time generated incredible rich diversity

Virtual Cell and Scientific Discovery

Demis has dreamed of modeling a complete cell for 25 years, discussing with Nobel laureate Paul Nurse since the 1990s about requirements for useful in silico experiments

"Maybe you could 100X speed up experiments by doing most of it in silico, the search in silico, and then you do the validation step in the wet lab. That's the dream" - Demis

AlphaFold provides static 3D protein structures; AlphaFold 3 models pairwise interactions; next steps include modeling whole pathways like TOR pathway involved in cancer, then eventually full yeast cell

Yeast cell chosen as target because it's simplest single-cell organism that's also a full organism, and very well understood scientifically

Modeling different temporal scales in cells requires hierarchical systems or multiple simulated systems that can interact at different temporal dynamics

Goal is to model at protein level rather than atomic level to capture relevant dynamics without over-modeling quantum mechanical aspects

Research Taste and Scientific Creativity

"Taste or judgment is what separates the great scientists from the good scientists. All professional scientists are good technically, but do you have the taste to sniff out what the right direction is" - Demis

"It's harder to come up with a conjecture, a really good conjecture than it is to solve it. We may have systems soon that can solve pretty hard conjectures, but could a system come up with a conjecture worthy of study" - Demis

True creativity requires leaps of imagination like Einstein had with special and general relativity - current systems cannot make such conceptual breakthroughs

Good conjectures split the hypothesis space in two, where learning something useful whether true or false, and are falsifiable with available technologies

"There's no such thing as failure really as long as you are picking experiments and hypotheses that meaningfully split the hypothesis space" - Demis on research methodology

AGI Timeline and Definition

Demis estimates 50% chance of AGI by 2030, defining it as matching all cognitive functions the brain has with consistency across domains, not jagged intelligence

Testing AGI would involve tens of thousands of cognitive tasks humans can do, plus giving world's top experts in each field a month or two to find obvious flaws

"Lighthouse moments" for AGI would include inventing new conjectures like Einstein did with special relativity, or inventing a game as deep and elegant as Go

Back-test proposal: give system knowledge cutoff of 1900 and see if it could come up with special and general relativity like Einstein did

Current systems have missing capabilities in true invention and creativity - "they're good if you give them very specific instructions, but if you give them a very vague high-level instruction that wouldn't work currently" - Demis

Scaling Laws and Research Breakthroughs

Scaling continues across three dimensions: pre-training, post-training, and inference time compute, with room for growth in all areas

"It's kind of 50/50 whether new things are needed or whether the scaling of the existing stuff is gonna be enough. We are pushing both of those as hard as possible" - Demis

About half of Google DeepMind resources dedicated to new blue sky ideas, half to scaling current capabilities to maximum

"I would back us to be the place that does that breakthrough if some new breakthrough is required. I actually quite like it when the terrain gets harder because then it veers more from just engineering to true research" - Demis

"Maybe 80-90% of the breakthroughs that underpins modern AI field today was from originally Google Brain, Google Research, and DeepMind" - Demis on research track record

Energy, Fusion, and Type I Civilization

Demis bets on fusion and solar as primary future energy sources, with solar being "the fusion reactor in the sky" requiring better batteries and transmission

AI systems could help with plasma containment for fusion reactors, reactor design, new solar materials, room temperature superconductors, and optimal batteries within next five years

"If energy is kind of free and renewable and clean, then that solves a whole bunch of other problems. Water access problem goes away because you can just use desalination" - Demis

Free energy enables unlimited rocket fuel by separating seawater into hydrogen and oxygen, combined with self-landing rockets could create "bus service to space"

"For the first time in human history, we wouldn't be resource constrained. It's not zero sum. This radical abundance era where there's plenty of resources to go around" - Demis

Demis would not be surprised if humanity reaches Type I Kardashev scale civilization within 100 years given energy breakthroughs

Google DeepMind's Competitive Position

Google went from "losing" to winning in LLM products within a year through incredible team led by Koray, Jeff Dean, and Oriol, plus research culture combining Google Brain and DeepMind

"Relentless progress along with relentless shipping of that progress" has been key to success in unbelievably competitive space

Google DeepMind operates as startup within large company, fighting to cut away bureaucracy while maintaining responsible practices for billions of users

"There's very few places in the world you can do incredible world-class research on one hand and then plug it in and improve billions of people's lives the next day" - Demis

Demis brings product design skills from 1990s game development, combining cutting-edge technology with user experience - "I love the combination of cutting-edge research and then being applied in a product"

Programming Jobs and AI Displacement

Programming and math turned out easier for AI than expected because synthetic data can be created and verified, contrary to earlier assumptions about "harder skills"

"People who embrace these technologies become almost at one with them will become sort of superhumanly productive. The great programmers will be even better, 10X even what they are today" - Demis

Top programmers will have advantages in specifying architecture, guiding coding assistants, and checking code quality for foreseeable future

"Anytime where there's a lot of disruption and change, we've had this many times in human history with the internet, mobile, industrial revolution. It's gonna be one of those eras" - Demis

Impact will be "probably 10 times the impact the industrial revolution had but 10 times faster as well. Instead of a hundred years, it takes 10 years" - Demis

Demis encourages top economists and philosophers to think about societal effects and solutions like universal basic provision where increased productivity gets distributed

Consciousness and Substrate Dependence

Demis disagrees with Roger Penrose on quantum consciousness, noting no convincing mechanisms found for quantum behavior in brain despite good neuroscientist collaborations

"My betting is there is that it's mostly just classical computing going on in the brain, which suggests that all the phenomena are modelable or mimicable by a classical computer" - Demis

"One of the best definitions I like of consciousness is it's the way information feels when we process it" - Demis

We assume others are conscious for two reasons: same behavior and same substrate. With AI on silicon, we can't rely on substrate similarity even if behavior matches

Neural interfaces like Neuralink might eventually let us feel what it's like to compute on silicon, potentially bridging the consciousness gap between substrates

"We've never had to confront that before" - the challenge of radical empathy with different substrate, similar to empathizing with plants or other life forms

P Doom and Existential Risk

"I don't have a p doom number. The reason I don't is because I think it would imply a level of precision that is not there" - Demis on probability of doom

"It's definitely non-zero and it's probably non-negligible. So that in itself is pretty sobering. My view is it's just hugely uncertain" - Demis

Given uncertainty but huge stakes both ways, "the only rational, sensible approach is to proceed with cautious optimism" - Demis

Risks operate over different timescales: bad actors using technology for harmful ends (near-term) versus autonomous AGI control problems (longer-term), both equally important

"How does one restrict bad actors access to these powerful systems but enable access at the same time to good actors to maximally build on top. It's a pretty tricky problem" - Demis

AI could help with early warning on bad actor use cases in bio or nuclear domains, but only if the AI itself is reliable - "it's a sort of interlocking problem"

Von Neumann, Manhattan Project, and Collaboration

John von Neumann foresaw that computers would be more impactful than nuclear weapons, predicting "10 times at least of the industrial revolution" impact - Demis agrees

Von Neumann talked about learning machines as "grown rather than programmed" in the 1950s, presaging modern AI approaches

The maniac by Benjamin Labatut explores the double-edged sword of discovery through von Neumann's life and work

"We need to approach it with whatever you wanna call it, a spiritual dimension or humanist dimension. This idea of a soul, what makes us human, the spark that we have" - Demis

Demis hopes for CERN-like collaborative model for final AGI steps rather than Manhattan Project-style weapons race between states

"At least on the scientific level, it's important for the researchers to keep in touch and keep close to each other" despite difficult geopolitical climate - Demis

Lex Fridman
From Lex Fridman. Get a note like this from every new episode.
Subscribe to Notes Upgrade

Books Mentioned

winning by LLM products within a year through incredible team led by Koray
Taste Buds and Molecules by Francois Chartier (2011)

What's the secret relationship between the strawberry and the pineapple? Between mint and Sauvignon Blanc? Thyme and lamb? Rosemary and Riesling? In Taste Buds and Molecules, sommelier François Charti...

What Was Going On by Jennifer Warner (2013) Taste of Tremé by Todd-Michael St. Pierre (2006)

Down-home recipes celebrating the flavors, culture, and spirit of the most vibrant and historic neighborhood in the Big Easy Bordering its touristy French Quarter twin, the Treme neighborhood is the t...

The Bench by Meghan The Duchess of Sussex (2021) Engineering Plus by Arthur Maurice Greene (1926) The Effects of National Culture and Safety Culture in Liner Shipping by Chaur-luh Tsai (2017) Motivation to Work by Frederick Herzberg (2017)

Quality work that fosters job satisfaction and health enjoys top priority in industry all over the world. This was not always so. Until recently analysis of job attitudes focused primarily on human re...

East Side Story by Louis Auchincloss (2004)

For his 60th novel, the author follows the fortunes of the Scottish Carnochans, who prospered on New York's Upper East Side in the 19th century. This is a loving and wicked look at New York's own....

Modernism's Other Work by Lisa Siraganian (2011)

Modernism's Other Work challenges deeply held critical beliefs about the meaning-in particular the political meaning-of modernism's commitment to the work of art as an object detached from the world. ...

Collected papers by Sigmund Freud (1906)

These notes may contain occasional inaccuracies. Learn how podbrain notes are made

0 / 0
Link copied