Episode 16: Med-PaLM or Facepalm? A Second Opinion On LLMs In Healthcare (feat. Roxana Daneshjou), August 28, 2023

Alex and Emily are taking another stab at Google and other companies' aspirations to be part of the healthcare system - this time with the expertise of Stanford incoming assistant professor of dermatology and biomedical data science Roxana Daneshjou (profiles.stanford.edu/roxana-daneshjou). A look at the gap between medical licensing examination questions and real life, and the inherently two-tiered system that might emerge if LLMs are brought into the diagnostic process.
References:
Google blog post describing Med-PaLM (sites.research.google/med-palm)
Nature: Large language models encode clinical knowledge (nature.com/articles/s41586-023-06291-2)
Politico: Microsoft teaming up with Epic Systems to integrate generative AI into electronic medical records software (politico.com/newsletters/future-pulse/2023/08/…)
MedRXiv: Beyond the hype: large language models propagate race-based medicine (medrxiv.org/content/10.1101/2023.07.03.2329219…) (Omiye, Daneshjou, et al)
Fresh AI hell:
Fake summaries of fake reviews (engadget.com/amazon-begins-rolling-out-ai-gene…)
bsky.app/profile/hypervisible.bsky.social/post…
School administrators asking ChatGPT which books they have to remove (popsci.com/technology/iowa-chatgpt-book-ban) from school libraries, given Iowa’s book ban

Mason City Globe Gazette: “Each of these texts was reviewed using AI software (globegazette.com/news/local/book-ban-implement…) to determine if it contains a depiction of a sex act. Based on this review, there are 19 texts that will be removed from our 7-12 school library collections and stored in the Administrative Center while we await further guidance or clarity.”
Loquacity and Visible Emotion: ChatGPT as a Policy Advisor (papers.ssrn.com/sol3/papers.cfm?abstract_id=45…)
Written by authors at the Bank of Italy
AI generated school bus routes get students home at 10pm (wdrb.com/news/education/jcps-bus-routes-genera…)
Lethal AI generated mushroom-hunting books (mastodon.world/@rosamundi/110909701501300643)
How would RBG respond? (linkedin.com/feed/update/urn:li:activity:71007…)
Check out future streams on Twitch (twitch.tv/dair_institute). Meanwhile, send us any AI Hell you see (thecon.ai/submit-fresh-ai-hell).
Find our book The AI Con here (bit.ly/3OZ9PNx), and MAIHT3k merch here (store.dair-institute.org/category/mystery-ai-h…).
Subscribe to our newsletter via Buttondown (bit.ly/456Q0Ln).
Follow us!
Emily
• Bluesky: emilymbender.bsky.social (bit.ly/3VpFk7H)
• Mastodon: dair-community.social/@EmilyMBender (bit.ly/3yJ6g9z)
Alex
• Bluesky: alexhanna.bsky.social (bit.ly/4c05L9h)
• Mastodon: dair-community.social/@alex (bit.ly/3X4poc1)
• Twitter: @alexhanna (bit.ly/3V6NuQM)
Music by Toby Menon.
Artwork by Naomi Pleasure-Park (naomipleasurepark.com).
Production by Ozzy Llinas Goodman.