Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality

For 4 hours, I tried to come up reasons for why AI might not kill us all, and Eliezer Yudkowsky explained why I was wrong.
We also discuss his call to halt AI, why LLMs make alignment harder, what it would take to save humanity, his millions of words of sci-fi, and much more.
If you want to get to the crux of the conversation, fast forward to 2:35:00 through 3:43:54. Here we go through and debate the main reasons I still think doom is unlikely.
Watch on YouTube (youtu.be/41SUp-TRVlg). Listen on Apple Podcasts (podcasts.apple.com/us/podcast/eliezer-yudkowsk…), Spotify (open.spotify.com/episode/7LFWgn4KvoZMn4a89ZXUE…), or any other podcast platform. Read the full transcript here (dwarkeshpatel.com). Follow me on Twitter (twitter.com/dwarkesh_sp) for updates on future episodes.
Timestamps
(0:00:00) - TIME article
(0:09:06) - Are humans aligned?
(0:37:35) - Large language models
(1:07:15) - Can AIs help with alignment?
(1:30:17) - Society’s response to AI
(1:44:42) - Predictions (or lack thereof)
(1:56:55) - Being Eliezer
(2:13:06) - Othogonality
(2:35:00) - Could alignment be easier than we think?
(3:02:15) - What will AIs want?
(3:43:54) - Writing fiction & whether rationality helps you win

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dwarkesh.com?utm_medium=podcast&utm_campai…