The Information Bottleneck

Sara Hooker on the End of Static AI

Mittwoch, 16. September 2026 · 1 h 36

MP3

Shownotes

What comes after scaling?

We talk with Sara Hooker, co-founder and CEO of Adaptation Lab, about why the next generation of AI may look very different from today's static models. Sara argues that models should continuously adapt to new tasks, data, users, and environments—and that doing this efficiently will require rethinking much more than fine-tuning.
We discuss continual learning, AutoScientist and automated research, why non-verifiable tasks may become the next major bottleneck, and why interfaces could be as important as the models themselves. We also get into open vs. closed models, distillation and Chinese AI labs, AI regulation and safety, cybersecurity and biorisk, AI companionship, and what may eventually come after Transformers and tokenization.
Topics
• Continuous learning and adaptive AI
• Fine-tuning, memory, and AutoScientist
• AI agents and automated research
• Non-verifiable tasks and human feedback
• Adaptive interfaces
• Open vs. closed models and distillation
• AI safety, regulation, cyber risk, and biorisk
• AI companionship and persuasion
• The limits of Transformers
• Multilingual models and tokenization
Chapters
— Introduction
— Why start another AI lab? The return of research
— What continuous learning actually means
— Should every company have its own adapting model?
— Fine-tuning and platforms like Tinker
— AutoScientist and automated optimization
— Can AI really improve its own research?
— The problem of non-verifiable tasks
— Human feedback and the limits of exponential progress
— Why the AI interface matters
— Distillation, China, and open models
— Open-model licensing
— Will open models catch closed models?
— AI regulation and compute thresholds
— AI safety and agent failures
— Biorisk vs. cybersecurity
— Persuasion, AI companionship, and overlooked risks
— Where will AI have the biggest real-world impact?
— What is missing from current AI architectures?
— Neurosymbolic AI
— Multilingual models and tokenization
— Byte-level models and alternatives to tokenization
— Closing

Music
• "Kid Kodi" - Blue Dot Sessions - via Free Music Archive - CC BY-NC 4.0

0:00 / 0:00