#238 - GPT 5.4 mini, OpenAI Pivot, Mamba 3, Attention Residuals

Our 238th episode with a summary and discussion of last week's big AI news!
Recorded on 03/18/2026
Hosted by Andrey Kurenkov (twitter.com/andrey_kurenkov) and Jeremie Harris (linkedin.com/in/jeremieharris)
Feel free to email us your questions and feedback at andreyvkurenkov@gmail.com and/or hello@gladstone.ai
Read out our text newsletter and comment on the podcast at lastweekin.ai
In this episode:
* OpenAI released GPT-5.4 mini and nano with 400k-token context windows, higher per-token prices but claimed token-efficiency gains in Codex; nano is API-only and pitched for high-volume classification/data extraction despite a major price increase.
* Mistral open-sourced the Small 4 model family (MoE, 119B total/6B active) combining reasoning, multimodal, and coding-agent capabilities, and announced Forge to help businesses train or post-train custom models.
* Agent “operating system” competition intensified with Meta’s acquired Manus launching a local Mac agent, Nvidia announcing NeMo/“Open Shell” sandboxed agent runtime, and Nvidia also unveiling DLSS 5 plus major hardware forecasts including Groq LPU integration.
* Business and safety updates included OpenAI shifting focus toward productivity/enterprise amid competition, Microsoft reorganizing Copilot and frontier-model efforts, Meta delaying its next model, China-linked ByteDance deploying large Nvidia clusters abroad, and new safety work on steganography, chain-of-thought faithfulness, fine-tuning defenses, cyber-attack evals, and constitution/spec compliance.
A thank you to our current sponsors:
• Box - visit Box.com/AI to learn more
• ODSC AI - go to odsc.ai/east and use promo code LWAI for an additional 15% off your pass to ODSC AI East 2026.
• Factor - head to factormeals.com/lwai50off and use code lwai50off to get 50 percent off and free breakfast for a year

Timestamps:
• (00:00:10) Intro / Banter
• (00:01:56) News Preview
• Tools & Apps
• (00:02:39) OpenAI ships GPT-5.4 mini and nano, faster and more capable but up to 4x pricier (the-decoder.com/openai-ships-gpt-5-4-mini-and-…)
• (00:08:04) Mistral's new Small 4 model punches above its weight with 128 expert modules (the-decoder.com/mistrals-new-small-4-model-pun…)
• (00:14:03) Meta's Manus launches 'My Computer' to turn your Mac into an AI agent - 9to5Mac (9to5mac.com/2026/03/17/metas-manus-launches-my…)
• (00:17:57) NVIDIA Announces NemoClaw for the OpenClaw Community | NVIDIA Newsroom (nvidianews.nvidia.com/news/nvidia-announces-ne…) + Nvidia boosts knowledge work with Open Agent Development Platform (nvidianews.nvidia.com/news/ai-agents)
• (00:24:09) DLSS 5 looks like a real-time generative AI filter for video games | The Verge (theverge.com/news/895472/nvidia-dlss5-generati…)
• (00:26:36) OpenAI to Launch ChatGPT 'Adult Mode' Despite Warnings From Its Own Advisers - CNET (cnet.com/tech/services-and-software/openai-cha…)
• Applications & Business
• (00:33:46) OpenAI Reportedly Pivoting to a Focus on Business and Productivity Only (gizmodo.com/openai-reportedly-pivoting-to-a-fo…)
• (00:41:25) Nvidia GTC 2026: CEO Jensen Huang sees $1 trillion in orders for Blackwell and Vera Rubin through ’27 (cnbc.com/2026/03/16/nvidia-gtc-2026-ceo-jensen…)
• (00:45:44) Mistral launches Forge to help enterprises build their own AI models (computerworld.com/article/4146860/mistral-laun…)
• (00:54:17) China's ByteDance gets access to top Nvidia AI chips, WSJ reports (reuters.com/world/asia-pacific/chinas-bytedanc…)
• (00:57:57) Meta Delays Rollout of New A.I. Model After Performance Concerns (nytimes.com/2026/03/12/technology/meta-avocado…)
• (01:02:50) Microsoft Shakes Up AI Division As Copilot Falls Behind Google and OpenAI (trendingtopics.eu/microsoft-shakes-up-ai-divis…)
• Policy & Safety
• (01:07:26) A Decision-Theoretic Formalisation of Steganography With Applications to LLM Monitoring (arxiv.org/abs/2602.23163)
• (01:13:09) Reasoning Theater: Disentangling Model Beliefs from Chain-of-Thought (arxiv.org/abs/2603.05488)
• (01:18:29) In-Training Defenses against Emergent Misalignment in Language Models (arxiv.org/abs/2508.06249)
• (01:23:07) How do frontier AI agents perform in multi-step cyber-attack scenarios? (aisi.gov.uk/blog/how-do-frontier-ai-agents-per…)
• (01:25:20) Eval awareness in Claude Opus 4.6’s BrowseComp performance (anthropic.com/engineering/eval-awareness-brows…)
• (01:29:49) Introducing Bloom: an open source tool for automated behavioral evaluations (alignment.anthropic.com/2025/bloom-auto-evals)
• (01:32:26) How well do models follow their constitutions? (lesswrong.com/posts/Tk4SF8qFdMrzGJGGw/how-well…)
• (01:37:11) Nvidia’s H200 License Stirs Security Concern Among Top Democrats (bloomberg.com/news/articles/2026-03-16/nvidia-…)
• Research & Advancements
• (01:40:050) [2603.15031] Attention Residuals (arxiv.org/abs/2603.15031)
• (01:47:11) Mamba-3: Improved Sequence Modeling using State Space Principles (arxiv.org/pdf/2603.15569)

See Privacy Policy at art19.com/privacy and California Privacy Notice at art19.com/privacy#do-not-sell-my-info.