Cover von Embedded AI Podcast

Technologie

Embedded AI Podcast

von Embedded AI Podcast

Website RSS

A podcast about using AI in embedded systems -- either as part of your product, or during development.

Folgen

  1. E26 Making Embedded AI Safe: Functional Safety in Embedded ML Systems

    Ryan and Luca welcome back Sebastian Boblest and Marco Mader Mendes from Bosch to discuss the challenges of deploying AI in safety-critical embedded systems. The conversation explores two key aspects: ensuring the generated code itself is s

  2. E25 Running Deep Neural Networks on Microcontrollers with Mark Deutel and Dr. Axel Plinge

    We talk with Mark Deutel and Dr. Axel Plinge from Fraunhofer IIS about the art and science of running AI models on resource-constrained devices. Mark walks us through his PhD work on getting neural networks to run on microcontrollers with j

  3. E24 Practical Local LLMs: Hardware, Tools, and Trade-offs

    We explore the resurgence of self-hosted LLMs and why they're worth considering despite the convenience of frontier models. From data privacy concerns to cost management and consistent performance, there are solid reasons to run your own mo

  4. E23 How LLMs Tick

    Ryan and Luca pull back the curtain on large language models, explaining what's really happening when you chat with an AI. They break down tokenization, context windows, and the stateless nature of LLMs—revealing why these tools aren't actu

  5. E22 deploying models on small microcontrollers

    We talk with Sebastian Boblest and Marco Mader Mendes from Bosch about the surprisingly challenging art of deploying AI models on resource-constrained embedded devices. They share insights from their work on ETAS Embedded AI Coder, a tool t

  6. E21 AI security research and AI security

    Ryan and Luca tackle the hot topic of AI-driven security research, sparked by the release (and brief containment) of Anthropic's Mythos tool. Ryan, drawing on his 20+ years in cybersecurity, delivers a surprisingly reassuring message: if yo

  7. E20: "AI Will Take My Job :-( " - Why Your Job Is (Probably) Safe

    We tackle the elephant in the room: will AI take our jobs? Spoiler alert - probably not, but your job will definitely change shape. Ryan and Luca dig into what software development actually is (hint: it's not just mashing keyboards), why em

  8. E19: SDD frameworks, and WhittleSpec - Rethinking AI-Assisted Development with Feedback Loops

    Luca unveils WhittleSpec, his new open-source framework for AI-assisted development that challenges the waterfall assumptions baked into most coding tools. Born from frustration with frameworks like SpecKit that treat specifications as stat

  9. E18: Shawn Hymel on Edge AI - NPUs, Deployment Challenges, and the Future of Embedded ML

    Ryan and Luca sit down with Shawn Hymel, an educator and course creator focused on edge AI and embedded systems. We explore what's changed in the past few years—from basic keyword spotting to full object detection on microcontrollers, thank

  10. E17: Switching Providers - Insulating Yourself from AI Vendor Lock-in

    Ryan and Luca tackle a challenge many AI users are facing: what happens when your AI provider starts acting up? Drawing from recent experiences with Anthropic's capacity issues, secret billing practices, and model degradation, we explore pr

  11. E16 Running LLMs Locally: Privacy, Performance, and Practical Trade-offs

    We explore what it really means to run AI models locally instead of relying on cloud providers like OpenAI or Anthropic. From powerful desktop setups with dual NVIDIA RTX 3090s to tiny models running on embedded systems, we cover the full s

  12. E15 Julia Imlauer on introducing AI into organizations

    We talk with Julia Imlauer, Director for AI Strategy and Development, about the practical realities of introducing Gen AI tools into engineering organizations. Julia shares her experience training engineers and management across multiple co

  13. E14 Kwabena Ageyman on OpenMV

    We sit down with Kwabena Ageyman, co-founder of OpenMV, to explore how microcontrollers have evolved from simple 8-bit chips to AI-capable systems that rival desktop computers. Kwabena walks us through OpenMV's journey from the CMU Cam days

  14. E13 Ryan visits Luca (and they talk abut spec-driven development)

    For E13 we recorded live in Luca's garden in Munich, with Ryan dropping by ahead of Embedded World week. Ryan and Luca talk about spec-driven development in the AI era: where the discipline came from, what changes when an LLM is doing the t

  15. E12 Learning AI-powered development with Jacob Beningo

    We sit down with Jacob Beningo, a real-time embedded systems consultant with 20 years of experience, to talk about what we've learned teaching engineers to use AI in their development workflows. Turns out, the hard part isn't getting AI to

  16. E11 debugging embedded systems using AI

    Ryan and Luca explore practical techniques for using AI to debug embedded systems -- from analyzing breadboard photos to parsing UART output and managing complex debugging workflows. LLMs work best as force multipliers rather than replaceme

  17. E10 TDD and AI

    Is test-driven development still relevant when AI can generate thousands of lines of code from a prompt? Ryan argues TDD was designed for human limitations -- if AI can generate complete systems, why write tests first? Luca pushes back: tes

  18. E09 AI Systems Engineering with Darwin Sanoy

    In this episode, Ryan and Luca sit down with Darwin Sanoy from GitLab to explore the intersection of systems engineering, embedded development, and AI. Darwin brings a wealth of experience from his work in ISO 26262 certification and MIT Sy

  19. E08 - AI-Powered Pipelines with Joe Schneider

    In this episode, we sit down with Joe Schneider, founder of Dojo5 and creator of the EmbedOps framework, to explore how AI is transforming embedded development pipelines. We discuss the practical applications of AI in CI/CD workflows—from s

  20. E07 - Embedd, and using AI safely, with Michael Lazarenko

    In this episode, Ryan and Luca sit down with Michael Lazarenko, co-founder of Embedd, to discuss the real-world challenges of using AI in embedded systems development. Michael shares his journey from manufacturing physical devices to buildi

  21. E06 integrating AI into embedded products with Souvik Pal

    In this episode, Ryan and Luca welcome their first proper guest, Souvik Pal, Chief Product Officer at FyeLabs. Souvik shares his eight years of experience helping customers bring embedded AI projects to life, walking us through two fascinat

  22. E05 Context Management

    In this episode, Ryan and Luca explore one of the most practical aspects of working with LLMs: context management. They discuss what tokens are, how context windows work, and why managing context often matters more than crafting perfect pro

  23. E04 Crossover with the Agile Embedded Podcast

    In this special crossover episode, Luca brings together his two podcasting worlds: the Agile Embedded Podcast with Jeff Gable and the Embedded AI Podcast with Ryan Torvik. What starts as Jeff admitting he's still a "noob" with LLMs turns in

  24. E03 Agentic Workflow Shootout: How We Actually Code With AI (Autumn 2025 Edition)

    In this episode, Ryan and Luca dive into their real-world AI coding workflows, sharing the tricks, tools, and hard-learned lessons from their daily development work. They compare their approaches to using AI agents like Claude Code and disc

  25. E02 RAG for Embedded Systems Development: When Retrieval Augmented Generation Makes Sense (and When It Doesn't)

    Ryan and Luca explore Retrieval Augmented Generation (RAG) and its practical applications in embedded development. After Ryan's recent discussions at the Embedded Systems Summit, we dive into what RAG actually is: a system that chunks docum

  26. E01 what is Embedded AI all about?

    Welcome to the inaugural episode of the Embedded AI Podcast! Ryan and Luca kick things off by exploring the fascinating intersection of AI and embedded systems. From fog computing (AI happening everywhere around us - in coffee shops, traffi

0:00 / 0:00