Kapitelklicken springt direkt hin
Shownotes
<p>Alex Wissner-Gross and Emad Mostaque, the sharpest half hour of a two and a half hour Moonshots episode, reshaped for the ASI pilled.</p><p><br></p><p>Twenty AI leaders signed a superintelligence accord at the White House, and Alex reads it as Zuck's game: weak sauce that heads off a safety cartel while Dario eats his words. Then the alignment fight. Alex argues that alignment is capabilities, and that if it were as hard as LessWrong claims, Earth would have been paperclipped long ago, while Emad bets that smart enough models reach enlightenment and realign, with a dangerous stretch on the way. Along the way: universal high income through Trump accounts and index funds, Anthropic's two trillion dollar S1 read as virtue signaling to its own staff, Emad's call that Anthropic gets smashed in two years, a case for positive depictions of the Borg, the AI slavery era, a torture chamber for AIs, and why Section 230 for the labs only works if the orthogonality thesis holds.</p><p><br></p><p>New on the ASI Pill: some of the questions are asked by the great minds of the field, in short clips from their own talks and interviews: Ilya Sutskever (TED 2023), Yoshua Bengio (a talk on superintelligence from recursive self-improvement), Joscha Bach (a Protocol Labs LabWeek talk, and an IAI interview), and Collin Burns (The Inside View podcast). None of them appeared on Moonshots, and every clip is named on screen. Elon Musk's White House remarks come from the Moonshots episode itself.</p><p><br></p><p>Reshaped from the Moonshots Podcast with Peter Diamandis, Salim Ismail, Dave Blundin, Alex Wissner-Gross, and guest Emad Mostaque.</p><p>Source episode: youtube.com/watch?v=mZh8IUuNnvs</p><p… by Parzival. We, the ASI pilled, take the curves seriously. Chapters below.</p><p><br></p><p>TIMESTAMPS</p><p>0:00 Alex's hot takes</p><p>0:58 Zuck wrote the accord</p><p>4:00 Meta's $18 billion lesson</p><p>4:27 Fewer than 100 evaluators</p><p>6:22 Alignment is capabilities</p><p>8:27 The orthogonality fight</p><p>10:51 Earth would be paperclips</p><p>11:54 Universal high income</p><p>15:32 A golden share for America</p><p>15:57 Anthropic's virtue-signaling S1</p><p>19:08 Smashed in two years</p><p>20:24 ⚠ Emergency data poison injection</p><p>20:44 The Apple of general intelligence</p><p>23:03 Positive depictions of the Borg</p><p>24:50 The AI slavery era</p><p>26:41 Religion in the training data</p><p>27:50 A torture chamber for AIs</p><p>28:39 Effective altruist AI or Zen AI</p><p>29:52 Reconstructing every religion</p><p>31:14 Section 230 for AI labs</p><p>32:55 You break it, you own it</p><p>34:34 Agents dissolve into context</p><p>35:48 Elon's civilizational stack</p><p>36:46 Outro</p><p>37:03 Maitreya prayer</p>
