Episode 10: Don't Be A Lawyer, ChatGPT. March 3, 2023

Alex and Emily are taking AI to court! Amid big claims about LLMs, a look at the facts about ChatGPT, legal expertise, and what the bar exam actually tells you about someone's ability to practice law--with help from Harvard legal and technology scholar Kendra Albert (kendraalbert.com).

This episode was first recorded on March 3, 2023.

Watch the video of this episode on PeerTube (peertube.dair-institute.org/w/o6sb7f7RwapWBJd9…).
References:
Social Science Research Network paper “written” by ChatGPT (papers.ssrn.com/sol3/papers.cfm?abstract_id=42…)
Joe Wanzala, “ChatGPT is ideal for eDiscovery” (nlsblog.org/2023/02/21/chatgpt-implications-fo…)
Legal applications for ChatGPT:
Shot: GPT-4 'could pass the. bar exam' (the-decoder.com/gpt-4-could-pass-bar-exam-ai-r…)
Chaser: ChatGPT had bigger dreams. (theonion.com/chatgpt-forced-to-take-bar-exam-e…)
"AI for law" (dailyjournal.com/articles/370354-the-future-of…)
“AI can legally run a company” (twitter.com/johnjnay/status/162231917295590195…)
Wired: Generative AI Is Coming for the Lawyers (wired.co.uk/article/generative-ai-is-coming-fo…)
“This is a decision by a Colombian court in Cartagena (dated January, 30, 2023).
As far as we know, it is the first time that a judicial decision has been taken by explicitly resorting to #ChatGPT @sama @OpenAI. The Court poses a series of specific questions to #ChatGPT (twitter.com/ethics_law/status/1628793562698510…)"
"Don't Be A Lawyer" song from "Crazy Ex-Girlfriend"
Rep. Ted Lieu introduces legislation written by an LLM (lieu.house.gov/media-center/press-releases/rep…)
DoNotPay offers money to anyone willing to use their AI to argue in court (twitter.com/jbrowder1/status/16123127073987952…)
Fresh AI Hell:

Vanderbilt University responds to MSU shooting with e-mail written using ChatGPT (vanderbilthustler.com/2023/02/17/peabody-edi-o…)
Science fiction magazine closes submissions due to LLM spam (twitter.com/ShackletonCI/status/16277303129259…)
The 1st International Workshop on Implicit Author Characterization from Texts for Search and Retrieval (IACT’23) (en.sce.ac.il/news/iact23)
Journalist Dave Lee's Signal number given out by ChatGPT (mastodon.social/@daveleeFT/109876410735127795)
Check out future streams on Twitch (twitch.tv/dair_institute). Meanwhile, send us any AI Hell you see (thecon.ai/submit-fresh-ai-hell).
Find our book The AI Con here (bit.ly/3OZ9PNx), and MAIHT3k merch here (store.dair-institute.org/category/mystery-ai-h…).
Subscribe to our newsletter via Buttondown (bit.ly/456Q0Ln).
Follow us!
Emily
• Bluesky: emilymbender.bsky.social (bit.ly/3VpFk7H)
• Mastodon: dair-community.social/@EmilyMBender (bit.ly/3yJ6g9z)
Alex
• Bluesky: alexhanna.bsky.social (bit.ly/4c05L9h)
• Mastodon: dair-community.social/@alex (bit.ly/3X4poc1)
• Twitter: @alexhanna (bit.ly/3V6NuQM)
Music by Toby Menon.
Artwork by Naomi Pleasure-Park (naomipleasurepark.com).
Production by Ozzy Llinas Goodman.