#206 - Llama 4, Nova Act, xAI buys X, PaperBench

Our 206th episode with a summary and discussion of last week's big AI news!

Recorded on 04/07/2025

Try out the Astrocade demo here (astrocade.com)! astrocade.com

Hosted by Andrey Kurenkov (twitter.com/andrey_kurenkov) and Jeremie Harris (twitter.com/jeremiecharris).

Feel free to email us your questions and feedback at contact@lastweekinai.comand/or hello@gladstone.ai

Read out our text newsletter and comment on the podcast at lastweekin.ai.

Join our Discord here! (discord.gg/nTyezGSKwP) discord.gg/nTyezGSKwP

In this episode:

• Meta releases LlAMA-4, a series of advanced large language models, sparking debate on performance and release timing, with models featuring up to 2 trillion parameters for different configurations and applications.

• Amazon's AGI Lab debuts NOVA Act, an AI agent for web browser control, boasting competitive benchmarking against OpenAI's and Anthropic's best agents.

• OpenAI's image generation capabilities and ongoing financing developments, notably a $40 billion funding round led by SoftBank, highlight significant advancements and strategic shifts in the tech giant’s operations.

Timestamps + Links:

• (00:00:00) Intro / Banter

Tools & Apps

• (00:01:46) Meta releases Llama 4, a new crop of flagship AI models (techcrunch.com/2025/04/05/meta-releases-llama-…)

• (00:13:55) Amazon unveils Nova Act, an AI agent that can control a web browser (techcrunch.com/2025/03/31/amazon-unveils-nova-…)

• (00:17:06) Alibaba Preparing for Flagship AI Model Release as Soon as April (bloomberg.com/news/articles/2025-04-01/alibaba…)

• (00:17:59) Runway releases an impressive new video-generating AI model (techcrunch.com/2025/03/31/runway-releases-an-i…)

• (00:19:10) Adobe launches Premiere Pro’s generative AI video extender (theverge.com/news/641270/adobe-premiere-pro-ge…)

• (00:20:54) OpenAI prepares reasoning slider and memory update for ChatGPT users (testingcatalog.com/openai-prepares-reasoning-s…)

Applications & Business

• (00:21:28) Nvidia H20 Chips: $16 Billion Orders from ByteDance, Alibaba, and Tencent (thehansindia.com/tech/nvidia-h20-chips-16-bill…)

• (00:24:45) Elon Musk sells X for $33 billion to his own AI startup company xAI (globalnews.ca/news/11104574/elon-musk-sells-x-…)

• (00:28:00) SoftBank dethroned Microsoft as OpenAI's largest investor, pushing the ChatGPT maker's market cap to $300 billion — but reportedly buried itself in debt (windowscentral.com/software-apps/softbank-deth…)

• (00:30:48) DeepMind is holding back release of AI research to give Google an edge (arstechnica.com/ai/2025/04/deepmind-is-holding…)

• (00:34:06) SMIC Is Rumored To Complete 5nm Chip Development By 2025; Costs Could Be Up To 50 Percent Higher Than TSMC’s Version Due To The Use Of Older-Generation Equipment (wccftech.com/smic-5nm-development-completed-in…)

• (00:36:04) Google-backed Isomorphic Labs raises $600m to advance AI drug discovery (pharmaceutical-technology.com/news/google-back…)

Research & Advancements

• (00:38:03) PaperBench: Evaluating AI's Ability to Replicate AI Research (arxiv.org/abs/2504.01848v1)

• (00:43:50) Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domains (arxiv.org/abs/2503.23829)

• (00:48:39) Inference-Time Scaling for Complex Tasks: Where We Stand and What Lies Ahead (arxiv.org/abs/2504.00294v1)

• (00:54:34) Overtrained Language Models Are Harder to Fine-Tune (arxiv.org/abs/2503.19206)

Policy & Safety

• (00:58:28) Taking a responsible path to AGI (deepmind.google/discover/blog/taking-a-respons…)

• (01:02:32) This A.I. Forecast Predicts Storms Ahead (nytimes.com/2025/04/03/technology/ai-futures-p…)

• (01:06:24) The Secrets and Misdirection Behind Sam Altman’s Firing From OpenAI (wsj.com/tech/ai/the-real-story-behind-sam-altm…)

See Privacy Policy at art19.com/privacy and California Privacy Notice at art19.com/privacy#do-not-sell-my-info.