alphalist.CTO Podcast - For CTOs and Technical Leaders· Folge 142

#142 Why LLMs Need Their Own Programming Language: From Assembly to AI with Vaibhav Gupta // Co-founder @ BAML

Donnerstag, 16. Juli 2026 · 1 h 05

MP3

Shownotes

From HoloLens assembly to AI: Vaibhav Gupta on why LLMs need their own language, and how BAML makes them type-safe and shippable at agent speed.
BROUGHT TO YOU BY: Blocks (blocks.cloud/alphalist?utm_source=alphalist&am…)

A decade building computer vision and writing assembly at Microsoft (HoloLens), Google, and D.E. Shaw, then a from-scratch bet on a programming language built for LLMs. Vaibhav Gupta joins Tobi to explain why probabilistic compute needs its own tooling, what "shipping at agent speed" actually requires, and why the world's appetite for software is mathematically infinite.

Chapters:
— Intro
— From HoloLens to D.E. Shaw: a decade in computer vision and assembly
— Starting from scratch, and the YC pivot ("500K to not build a Slack competitor")
— Falling in love with coding — and bricking a few machines along the way
— His first AI moment: the GPT-3.5 wake-up call
— Code as a means to an end — why 90% of the job is plumbing
— Why he decided to build a language: first principles and BAML
— LLMs as a new compute primitive
— What BAML actually is — embedded, type-safe, callable from any language
— The business model and the "data trench"
— When AI ships code you didn't ask for — and why CI/CD breaks in an agent loop
— Live demo: function versioning and locking the codebase
— Why no one else competes here — Protobuf, Thrift, and Google's playbook
— Getting started: the BAML "hello world" (live coding)
— Everything is a function — type safety that runs in Rust
— Shipping at agent speed = trust plus granular control
— Visualizing code instead of reading it
— Where to start with BAML (docs.boundaryml.com → Agents MD)
— The mathematically infinite appetite for software
— Why we'll have 10x more builders — and why "English isn't a programming language"
— The future of SaaS: PaaS, harnesses, and customer-defined models
— Will design matter more in an agent world?
— The "time travel" decorator: advice to his 2017 self
— Outro

Quotes:
— "BAML's a new thing that exists because we have a new compute primitive in the form of LLMs." (verbatim)
— "90% of software engineering — well, in most jobs, 100% of software engineering is plumbing… And AI just takes that 90%, just makes it go away."
— "We can now generate code at machine speed… But we still cannot ship code at machine speed."
— "English can't go down to assembly… And the minute you add that to English, what have you done? You've built a new programming language."
— "I don't think we've yet found a company that hasn't found that I can make more money if I write more code."

--
OUR SPONSORS

Blocks (blocks.cloud/alphalist?utm_source=alphalist&am…)
Save at least 20% on your AWS costs with AI-powered optimization and enterprise discounts. Get your free Cloud Check at blocks.cloud/alphalist.

0:00 / 0:00