HOAI 1: The Chatbot in Your Laptop - Run AI on Your Own Computer, No Cloud Required

Your next chatbot doesn't need the cloud. Mikah Sargent installs a free app, downloads an AI model, turns off the Wi-Fi, and keeps right on chatting, all on an ordinary computer. Along the way, he explains how to read a model listing, including what the size and "Q4" labels mean, so you can pick a model that runs well on your own machine. Then the local model goes head-to-head with a cloud assistant to see where it holds up and where it falls short.

Host: Mikah Sargent (twit.tv/people/mikah-sargent)

Download or subscribe to Hands-On AI at twit.tv/shows/hands-on-ai

Want access to the ad-free audio and video and exclusive features? Become a member of Club TWiT today! twit.tv/clubtwit

Club TWiT (twit.tv/clubtwit) members can discuss this episode and leave feedback in the Club TWiT Discord (twit.memberful.com/account/discord/authorize).