Microsoft Distinguished Eng: Why And How To Port Your Entire Codebase to Rust | Stephen Toub

Stephen Toub is a Distinguished Engineer at Microsoft who single-handledly rewrote the GitHub Copilot runtime (400,000-line codebase) in Rust. We talked about why/how he did it, how Rust compared with other languages, and everything he learned in the process.

• My ergonomic keyboard project I mentioned, you can follow along here: read.compose.llc
• The Kickstarter page for it: kickstarter.com/projects/ryanlpeterman/compose…

Podcast links:

• YouTube: youtube.com/watch?v=PLMOVlZC4eU
• Apple: podcasts.apple.com/us/podcast/the-peterman-pod…
• Transcript: developing.dev/p/e073-stephen-toub

Thank you to this episode's sponsor for supporting my work:

• WorkOS: makes your app Enterprise Ready with easy to use APIs to add SSO, SCIM, RBAC, and more in just a few lines of code, check them out at workos.com

Timestamps:

(00:00) Intro
(01:06) Why the Copilot runtime needed a Rust port
(05:38) Why he chose Rust
(11:28) Discussing rollout strategies
(21:57) How he caught regressions
(32:08) Guiding the agents
(42:11) Catching regressions before prod
(45:16) Which models he used
(50:03) The end benefit and costs
(01:03:24) When to do a full rewrite
(01:06:40) Career learnings on the way to Distinguished
(01:16:00) Top technical book recommendation
(01:17:49) Advice for young engineers
(01:21:00) Outro

Where to find Stephen:

• GitHub: github.com/stephentoub
• X: twitter.com/stephentoub
• LinkedIn: linkedin.com/in/stephen-toub-75979745

Where to find Ryan:

• Newsletter: developing.dev
• X/Twitter: x.com/ryanlpeterman
• LinkedIn: linkedin.com/in/ryanlpeterman
• Threads: threads.com/@ryanlpeterman
• Instagram: instagram.com/ryanlpeterman
• TikTok: tiktok.com/@ryanlpeterman

Referenced in this episode:

• Stephen Toub’s post on porting the GitHub Copilot runtime to Rust: github.blog/ai-and-ml/generative-ai/migrating-…
• Jarred Sumner’s post on porting Bun to Rust: bun.com/blog/bun-in-rust
• Code: The Hidden Language of Computer Hardware and Software: charlespetzold.com/code/index.html