Ep 12: EleutherAI's Aran Komatsuzaki on Open-Source Models' Future and Thought Cloning

Jacob and Jordan sit down with EleutherAI's Aran Komatsuzaki to discuss the future of open-source models, thought cloning, his work on GPT-J and more.

0:00 intro
01:06 Aran’s background
02:58 starting work on gpt-j
05:49 gathering data for Lion and gpt-j
08:51 history of EleutherAI
11:16 open vs. closed-source models
19:06 how will open-source models be used going forward
21:33 thought cloning
25:51 building AI models that understand video
29:35 one model to rule them all
31:58 influence of academia in the LLM space
34:33 over-hyped/under-hyped
38:01 Aran’s thoughts on AGI

With your co-hosts:
@jasoncwarner
- Former CTO GitHub, VP Eng Heroku & Canonical
@ericabrescia
- Former COO Github, Founder Bitnami (acq’d by VMWare)
@patrickachase
- Partner at Redpoint, Former ML Engineer LinkedIn
@jacobeffron
- Partner at Redpoint, Former PM Flatiron Health
@jordan_segall
- Partner at Redpoint

Jacob is an AI investor at Redpoint Ventures. He's led Redpoint's investments in companies like Abridge, Physical Intelligence & Legora. Follow Jacob on Twitter (@jacobeffron).

On Unsupervised Learning we probe the sharpest minds in AI in search for the truth about what's real today, what will be real in the future and what it all means for businesses and the world. If you're a builder, researcher or investor navigating the AI world, this podcast will help you deconstruct and understand the most important breakthroughs and see a clearer picture of reality. Subscribe to this show to stay up to date on our latest episodes.