Kapitelklicken springt direkt hin
Shownotes
Austin and Vik react to OpenAI's Jalapeño announcement at Hot Chips. Plus extra spicy questions like should OpenAI sell it, how much of this was AI-written RTL, and where is Anthropic's chip?
Key Takeaways:
- The chip's core design philosophy is "dark silicon is cheaper than idle accelerators" — using one balanced chip and power-gating unused blocks is more efficient than a two-chip (e.g. GPU + LPU) solution.
- The unprecedented nine-month RTL-to-tapeout cycle was enabled by AI for EDA tools, serving as a wake-up call that small, expert teams can now develop Rubin-class chips in under a year.
- Jalapeño's key innovation is a NUMA-style architecture that gives each accelerator a local HBM slice, solving the memory contention that throttles performance in unified memory systems.
- OpenAI chose Broadcom's ESUN for its scale-up network to connect 128 chips in the rack at 600 GB/s and up to 2,048 chips across 16 racks at 200G --- all scale up!
- The design's "regret factor" principle justifies generality — the opportunity cost of being unable to support a future model is far higher than the marginal cost of adding hardware flexibility upfront.
Chapters:
Hot Chips Reaction
Designing for User Experience
A Generalized Inference Chip
The Foundry-IDM Analogy
The 'Regret Factor'
The 9-Month Design Cycle
Challenging the Two-Chip Solution
Solving HBM Underutilization
The NUMA Architecture Solution
System-Level ESUN Networking
Dark Silicon vs. Idle Accelerators
A Wake-Up Call for the Industry
Where's Anthropic's Chip?
Follow Chipstrat:
Newsletter: chipstrat.com
X: x.com/chipstrat
Follow Vik:
Newsletter: viksnewsletter.com
X: x.com/vikramskr
Follow Semi Doped:
Get more of Austin and Vik daily, free: daily.semidoped.com
