Why LLMs Keep Missing This One Thing | Jason Ganz

Can LLMs replace structured systems to scale enterprises?

Jason Ganz, Senior Manager DX at dbt Labs (getdbt.com), joins Simon Maple to unpack why, despite the rapid rise of AI systems, enterprises still rely on structured data for consistency and reliable decision making.

They also discuss:
• the invisible edge cases LLMs can’t see
• difference between software engineering and data engineering in AI
• the mismatch between AI output and business logic
• what the data engineer of the future actually does

AI Native Dev (ainativedev.io), powered by Tessl (tessl.io) and our global dev community, is your go-to podcast for solutions in software development in the age of AI. Tune in as we engage with engineers, founders, and open-source innovators to talk all things AI, security, and development.

Connect with us here:
1. Jason Ganz (LinkedIn)- linkedin.com/in/jasnonaz
2. Jason Ganz (X)- x.com/jasnonaz
3. dbt Labs- getdbt.com (x.com/jasnonaz)
4. dbt Fusion engine- getdbt.com/product/fusion
5. dbt Community- getdbt.com/community
6. Simon Maple- linkedin.com/in/simonmaple
7. Tessl- linkedin.com/company/tesslio
8. AI Native Dev- linkedin.com/showcase/ai-native-dev

00:00 Trailer
01:01 Introduction
01:41 dbt Labs
04:39 Data engineers
07:39 LLMs understanding
13:15 AI isn’t as lazy as humans
15:29 Problem: the scaffolding to get data
17:38 Best contextual results
19:40 Dealing with security
25:00 Structured data
27:37 Problems with LLMs and data
29:47 Exact numbers
32:10 Hallucinations
34:28 Human validation
36:20 MCP servers
39:09 UX bottlenecks
42:27 Quality of data
44:00 The future of data engineers
47:02 getdbt.com
48:09 Outro