#189 - Chat.com, FrontierMath, Relaxed Transformers, Trump & AI

Our 189th episode with a summary and discussion of last week's big AI news!

Hosted by Andrey Kurenkov (twitter.com/andrey_kurenkov) and Jeremie Harris (twitter.com/jeremiecharris).

Feel free to email us your questions and feedback at contact@lastweekinai.comand/or hello@gladstone.ai

Read out our text newsletter and comment on the podcast at lastweekin.ai.

In this episode:

* OpenAI's acquisition of chat.com and internal shifts, including hardware lead hire and hardware model leaks, signal significant strategy pivots and challenges with model scaling and security.

* Saudi Arabia plans a $100 billion AI initiative aiming to rival UAE's tech hub, highlighting the region's escalating AI investments.

* U.S. penalties on GlobalFoundries for violating sanctions against SMIC underline ongoing challenges in enforcing AI-chip export controls.

* Anthropic collaborates with Palantir and AWS to integrate CLAWD into defense environments, marking a significant policy shift for the company.

Sponsors:

•
The Generator - (babson.edu/thegenerator) An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.

• The AI safety book “ (amazon.com/Uncontrollable-Threat-Artificial-Su…)Uncontrollable" (amazon.com/Uncontrollable-Threat-Artificial-Su…) which is not a doomer book, but instead lays out the reasonable case for AI safety and what we can do about it. Max TEGMARK said that “Uncontrollable” is a captivating, balanced, and remarkably up-to-date book on the most important issue of our time" - find it on Amazon today! (amazon.com/Uncontrollable-Threat-Artificial-Su…)

If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form (forms.gle/VmZDCzSBfeACe1Ke9).

Timestamps + Links:

• (00:00:00) Intro / Banter

• (00:01:28) News Preview

• (00:02:10) Response to listener comments

• (00:05:02) Sponsor Break

• Tools & Apps

• (00:07:31) OpenAI Introduces ‘Predicted Outputs’ Feature: Speeding Up GPT-4o by ~5x for Tasks like Editing Docs or Refactoring Code (marktechpost.com/2024/11/04/openai-introduces-…)

• (00:11:55) Anthropic’s Haiku 3.5 surprises experts with an “intelligence” price increase (arstechnica.com/ai/2024/11/anthropic-raises-ey…)

• (00:17:10) Introducing FLUX1.1 [pro] Ultra and Raw Modes (blackforestlabs.ai/flux-1-1-ultra)

• (00:19:11) X is testing a free version of Grok AI chatbot in select regions (neowin.net/news/x-is-testing-a-free-version-of…)

• Applications & Business

• (00:21:39) OpenAI acquired Chat.com (techcrunch.com/2024/11/06/openai-acquired-chat…)

• (00:23:40) Saudis Plan $100 Billion AI Powerhouse to Rival UAE Tech Hub (bloomberg.com/news/articles/2024-11-06/saudis-…)

• (00:28:28) Meta’s former hardware lead for Orion is joining OpenAI (techcrunch.com/2024/11/04/metas-former-hardwar…)

• (00:31:38) OpenAI Accidentally Leaked Its Upcoming o1 Model to Anyone With a Certain Web Address (futurism.com/the-byte/openai-leak-o1-model)

• (00:35:50) Nvidia Rides AI Wave to Pass Apple as World’s Largest Company (bloomberg.com/news/articles/2024-11-05/nvidia-…)

• Projects & Open Source

• (00:37:53) ‘Unrestricted’ AI group Nous Research launches first chatbot — with guardrails (venturebeat.com/ai/unrestricted-ai-group-nous-…)

• (00:41:48) FrontierMath: The Benchmark that Highlights AI’s Limits in Mathematics (marktechpost.com/2024/11/08/frontiermath-the-b…)

• (00:46:29) Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent (arxiv.org/abs/2411.02265v3)

• Research & Advancements

• (00:49:55) Applying “Golden Gate Claude” mechanistic interpretability techniques to protein language models. (x.com/liambai21/status/1852765669080879108)

• (00:58:3) Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA (arxiv.org/abs/2410.20672v1)

• (01:05:55) From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code (googleprojectzero.blogspot.com/2024/10/from-na…)

• (01:10:22) OpenAI reportedly developing new strategies to deal with AI improvement slowdown (techcrunch.com/2024/11/09/openai-reportedly-de…)

• Policy & Safety

• (01:19:52) What Donald Trump’s Win Means For AI (time.com/7174210/what-donald-trump-win-means-f…)

• (01:28:44) Fab Whack-A-Mole: Chinese Companies are Evading U.S. Sanctions (substack.com/app-link/post?publication_id=3292…)

• (01:33:57) US fines GlobalFoundries for shipping chips to sanctioned Chinese firm (reuters.com/technology/us-penalizes-globalfoun…)

• (01:36:55) Anthropic teams up with Palantir and AWS to sell its AI to defense customers (techcrunch.com/2024/11/07/anthropic-teams-up-w…)

• (01:39:23) Outro

See Privacy Policy at art19.com/privacy and California Privacy Notice at art19.com/privacy#do-not-sell-my-info.