- wöchentlichErscheinungsrhythmus
- 12 mintypische Länge
- vor 5 Tagenletzte Folge
Folgenzu den neuesten
Dean Ball on open models and government control
Watching history unfold between Anthropic and the Department of War (DoW) it has been obvious to me that this could be a major turning point in perspectives on open models, but one that’ll take years to be obvious. As AI becomes more powerf
Olmo Hybrid and future LLM architectures
So-called hybrid architectures are far from new in open-weight models these days. We now have the recent Qwen 3.5 (https://qwen.ai/blog?id=qwen3.5) (previewed by Qwen3-Next (https://qwen.ai/blog?id=e34c4305036ce60d55a0791b170337c2b70ae51d&f
How much does distillation really matter for Chinese LLMs?
Distillation has been one of the most frequent topics of discussion in the broader US-China and technological diffusion story for AI. Distillation is a term with many definitions — the colloquial one today is using a stronger AI model’s out
Opus 4.6, Codex 5.3, and the post-benchmark era
Last Thursday, February 5th, both OpenAI and Anthropic unveiled the next iterations of their models designed as coding assistants, GPT-5.3-Codex (https://openai.com/index/introducing-gpt-5-3-codex/) and Claude Opus 4.6 (https://www.anthropi
Why Nvidia builds open models with Bryan Catanzaro
One of the big stories of 2025 for me was how Nvidia massively stepped up their open model program — more releases, higher quality models, joining a small handful of companies releasing datasets, etc. In this interview, I sat down with one
Thoughts on the job market in the age of LLMs
There’s a pervasive, mutual challenge in the job market today for people working in (or wanting to work in) the cutting edge of AI. On the hiring side, it often feels impossible to close, or even get interest from, the candidates you want.
Arcee AI goes all-in on open models built in the U.S.
Arcee AI (https://www.arcee.ai/) is a the startup I’ve found to be taking the most real approach to monetizing their open models. With a bunch of experience (and revenue) in the past in post-training open models for specific customer domain
Get Good at Agents
Two weeks ago, I wrote a review (https://www.interconnects.ai/p/claude-code-hits-different) of how Claude Code is taking the AI world by storm, saying that “software engineering is going to look very different by the end of 2026." That arti
Use multiple models
I’ll start by explaining my current AI stack and how it’s changed in recent months. For chat, I’m using a mix of: * GPT 5.2 Thinking / Pro: My most frequent AI use is getting information. This is often a detail about a paper I’m remembering
Claude Code Hits Different
There is an incredible amount of hype for Claude Code with Opus 4.5 across the web right now, which I for better or worse entirely agree with. Having used coding agents extensively for the past 6-9 months, where it felt like sometimes OpenA
Open models: Hot or Not with Nathan Lambert & Florian Brand
Nathan sits down with Florian, our open model analyst to get spicy into debates of which labs won and lost momentum in open models of 2025. Reflection 70B, Huawei repackaging someone else's model as their own, the fall of Llama — no drama i
New Talk: Building Olmo 3 Think
It’s finally here! The public (and most complete) version of my talk covering every stage of the process to build Olmo 3 (https://www.interconnects.ai/p/olmo-3-americas-truly-open-reasoning) Think (slides (https://docs.google.com/presentati
Olmo 3: America’s truly open reasoning models
We present Olmo 3, our next family of fully open, leading language models. This family of 7B and 32B models represents: * The best 32B base model. * The best 7B Western-origin thinking & instruct models. * The first 32B (or larger) fully op
Why AI writing is mid
First, on the topic of writing, the polished, and more importantly printed, version of my RLHF Book (https://rlhfbook.com/) is available for pre-order. It’s 50% off for a limited time, you can pre-order it here (https://hubs.la/Q03TsMHv0)!
Interview: Ant Group's open model ambitions
This is the first of a handful of interviews I’m doing with teams building the best open language models of the world. In 2025, the open model ecosystem has changed incredibly (https://www.interconnects.ai/p/state-of-open-models-2025). It’s
5 Thoughts on Kimi K2 Thinking
First, congrats to the Moonshot AI team, one of the 6 “AI Tigers (https://qz.com/china-six-tigers-ai-startup-zhipu-moonshot-minimax-01ai-1851768509)” in China, on the awesome release of Kimi K2 Thinking (https://moonshotai.github.io/Kimi-K2
Burning out
One of the obvious topics of the Valley today is how hard everyone works (https://www.nytimes.com/2025/09/28/business/996-hustle-culture-tech.html). We’re inundated with comments on “The Great Lock In”, 996 (https://jasmi.news/i/174127733/)
How to scale RL
Two quick housekeeping items before I get to the post.1. I’ll be in SF this week for the PyTorch conference (22-23), AI Infra Summit (21st), and other local events. Come say hi.2. I launched a new Substack AI bundle with 8 of my favorite pu
The State of Open Models
This talk covers everything that’s happened this year in the open model landscape — DeepSeek kickstarting the Chinese open model norms, Llama’s fade, Qwen’s dominance, GPT-OSS — and what comes next. It is my attempt to share what people nee
Thoughts on The Curve
I spent the weekend debating AI timelines, among other things, at The Curve conference. This translates as spending the weekend thinking about the trajectory of AI progress with a mix of DC and SF types. This is a worthwhile event that serv
ChatGPT: The Agentic App
Ever since ChatGPT exploded in popularity, there has been a looming “how” to its monetization plans. Much has been said about shopping and advertising as the likely paths, especially with Fidji Simo joining (https://openai.com/index/leaders
Thinking, Searching, and Acting
The weaknesses of today’s best models are far from those of the original ChatGPT — we see they lack speed, we fear superhuman persuasion, and we aspire for our models to be more autonomous. These models are all reasoning models that have lo
Coding as the epicenter of AI progress and the path to general agents
Coding, due to its breadth of use-cases, is arguably the last tractable, general domain of continued progress for frontier models that most people can interface with. This is a bold claim, so let’s consider some of the other crucial capabil
On China's open source AI trajectory
Hello everyone! I’m coming back online after two weeks of vacation. Thankfully it coincided with some of the slowest weeks of the year in the AI space. I’m excited to get back to writing and (soon) share projects that’ll wrap up in the last
Ranking the Chinese Open Model Builders
The Chinese AI ecosystem has taken the AI world by storm this summer with an unrelenting pace of stellar open model releases. The flagship releases that got the most Western media coverage are the likes of Qwen 3 (https://www.interconnects.
Contra Dwarkesh on Continual Learning
Dwarkesh Patel (https://substack.com/profile/4281466-dwarkesh-patel)’s now well-read post (https://www.dwarkesh.com/p/timelines-june-2025) on why he is extending his AI timelines focuses on the idea of continual learning. If you ask me, wha
GPT-5 and the arc of progress
If you want a video version of this, check out the last 20 minutes of the livestream reaction (https://www.youtube.com/watch?v=oOtHtK7YK2g) (edit, fixed link) I did with Will Brown of Prime Intellect and Swyx of Smol AI & Latent Space. GPT-
gpt-oss: OpenAI validates the open ecosystem (finally)
OpenAI released two open-weight, text-only reasoning models today, both mixture of experts (MoE) sized to run efficiently on a range of hardware from consumer GPUs to the cloud. These models have the Apache 2.0 license, so they’re available
Towards American Truly Open Models: The ATOM Project
I’m very excited to share a substantial project on invigorating investment in open language models and AI research in the U.S. The ATOM (American Truly Open Models) Project (https://www.atomproject.ai/) is the mature evolution of my origina
Interviewing Ross Taylor on the state of AI: Chinese open models, scaling reasoning, useful tools, and what comes next
I’m excited to welcome Ross Taylor back on the podcast (and sorry for the lack of episodes in general – I have a lot going on!). The first time (https://www.interconnects.ai/p/interviewing-ross-taylor-on-llm-reasoning) Ross came on we focus
