Machine Learning Street Talk (MLST)

The Day AI Solves My Puzzles Is The Day I Worry (Prof. Cristopher Moore)

Donnerstag, 4. September 2025 · 1 h 35

MP3

Shownotes

We are joined by Cristopher Moore, a professor at the Santa Fe Institute with a diverse background in physics, computer science, and machine learning.

The conversation begins with Cristopher, who calls himself a "frog" explaining that he prefers to dive deep into specific, concrete problems rather than taking a high-level "bird's-eye view".

They explore why current AI models, like transformers, are so surprisingly effective. Cristopher argues it's because the real world isn't random; it's full of rich structures, patterns, and hierarchies that these models can learn to exploit, even if we don't fully understand how.

**SPONSORS**
Take the Prolific human data survey - prolific.com/humandatasurvey?utm_source=mlst and be the first to see the results and benchmark their practices against the wider community!
---
cyber•Fund cyber.fund/?utm_source=mlst is a founder-led investment firm accelerating the cybernetic economy.
Oct SF conference - dagihouse.com/?utm_source=mlst - Joscha Bach keynoting(!) + OAI, Anthropic, NVDA,++
Hiring a SF VC Principal: talent.cyber.fund/companies/cyber-fund-2/jobs/…
Submit investment deck: cyber.fund/contact?utm_source=mlst
***

Cristopher Moore:
sites.santafe.edu/~moore

TOC:
- Introduction
- Meet Christopher Moore: A Frog in the World of Science
- The Limits of Transformers and Real-World Data
- Intelligence as Creative Problem-Solving
- Grounding, Meaning, and Shared Reality
- The Nature of Creativity and Aesthetics
- Computational Irreducibility and Universality
- Turing Completeness, Recursion, and Intelligence
- The Universe Through a Computational Lens
- Algorithmic Justice and the Need for Transparency

TRANSCRIPT: app.rescript.info/public/share/VRe2uQSvKZOm0oI…

Filmed at DISI (Diverse Intelligences Summer Institute)
disi.org

REFS:
The Nature of computation [Chris Moore]
nature-of-computation.org

Birds and Frogs [Freeman Dyson]
ams.org/notices/200902/rtx090200212p.pdf

Replica Theory [Parisi et al]
arxiv.org/pdf/1409.2722

Janossy pooling [Fabian Fuchs]
fabianfuchsml.github.io/equilibriumaggregation

Cracking the cryptic [YT channel]
youtube.com/c/CrackingTheCryptic

Sudoko Bench [Sakana]
sakana.ai/sudoku-bench

Fractured entangled representations “phylogenetic locking in comment” [Kumar/Stanley]
arxiv.org/pdf/2505.11581 (see our shows on this)

The War Against Cliché: [Martin Amis]
amazon.com/War-Against-Cliche-Reviews-1971-200…

Rule 110 (CA)
mathworld.wolfram.com/Rule150.html

Universality in Elementary Cellular Automata [Matt Cooke]
wpmedia.wolfram.com/sites/13/2018/02/15-1-1.pdf

Small Semi-Weakly Universal Turing Machines [Damien Woods]
tilde.ini.uzh.ch/users/tneary/public_html/Wood…

COMPUTING MACHINERY AND INTELLIGENCE [Turing, 1950]
courses.cs.umbc.edu/471/papers/turing.pdf

Comment on Space Time as a causal set [Moore, 88]
sites.santafe.edu/~moore/comment.pdf

Recursion Theory on the Reals and Continuous-time Computation [Moore, 96]

0:00 / 0:00