A Big Picture Look at AI Detection Tools, with Christopher Ostro

Christopher Ostro shares a big picture look at AI detection tools on episode 555 of the Teaching in Higher Ed podcast.

[divwrap class=”one-half first”]

Quotes from the episode

I think there are tons of students I interact with who are really just curious and trying to use these tools to dig deeper.

-Christopher Ostro

I want them getting practice on these things that are going to be part of their future careers and lives. I love that my classroom is a stage for that.

-Christopher Ostro

I think AI detection has a place, but its place is limited. I don’t think it should ever be the sole reason a student is getting honor coded.

-Christopher Ostro

I love to tell my students if all you’re doing with these tools is taking the output and submitting as your own work, you don’t have a job.

-Christopher Ostro

[/divwrap][divwrap class=”one-half”]

Resources

• Video: AI Detection: A Literature Review with Christopher Ostro (vimeo.com/1035821046)

• Slides: AI Detection: A Literature Review (docs.google.com/presentation/d/1WUjdpXHnlhymTW…)

• University of Colorado Boulder Learning Design Group (colorado.edu/learningdesign/about-us)

• Video: Student Use of AI: A Panel Dialogue (vimeo.com/1015079781)

• GPTZero (gptzero.me), TurnItIn AI Detector (turnitin.com/solutions/topics/ai-writing/ai-de…), Writer.AI (writer.com)

• Can linguists distinguish between ChatGPT/AI and human writing?: A study of research ethics and academic publishing, by J. Elliott Casal & Matt Kessler (sciencedirect.com/science/article/abs/pii/S277…)

• A real-world test of artificial intelligence infiltration of a university examinations system: A “Turing Test” case study, by Peter Scarfe, Kelly Watcham, and Alasdair Clarke (doi.org/10.1371/journal.pone.0305354)

• Simple techniques to bypass GenAI text detectors: implications for inclusive education, by Mike Perkins et al (educationaltechnologyjournal.springeropen.com/…)

• Can AI-Generated Text be Reliably Detected? by Vinu Sankar Sadasivan et al (arxiv.org/abs/2303.11156)

• Testing of detection tools for AI-generated text, by Debora Weber-Wulff et al (edintegrity.biomedcentral.com/articles/10.1007…)

• GPT detectors are biased against non-native English writers, by Weixin Liang et al (arxiv.org/abs/2304.02819)

• Detecting ChatGPT-generated essays in a large-scale writing assessment: Is there a bias against non-native English speakers? by Yang Jiang et al (sciencedirect.com/science/article/abs/pii/S036…)

• Kaggle competition 2023 – 2024 (kaggle.com/competitions/llm-detect-ai-generate…)

• h/t to Janae Cohn who shared the article on LinkedIn and posted some additional reflective questions we might ask, as we refuse GenAI in writing studies (linkedin.com/posts/jenae-cohn_refusing-genai-i…)

• Refusing GenAI in Writing Studies: A Quickstart Guide, by Jennifer Sano-Franchini, West Virginia University; Megan McIntyre, University of Arkansas;Maggie Fernandes, University of Arkansas (refusinggenai.wordpress.com)

• Maha Bali’s writing on AI (and other topics) (blog.mahabali.me)

• A Man on the Inside (imdb.com/title/tt26670955)

• Daytripper (DC Comics) (bookshop.org/a/79174/9781401229696)

[/divwrap]