Technology

School uses ChatGPT to determine which books are banned

a book under chains

In the lead-up to the 2023-24 school year, 19 books (including one entire book series) were pulled from shelves and placed in storage by the Mason City Community School District in Mason City, Iowa. What makes this case stand out amid a recent wave of troubling book bans all over the U.S. is that the decision as to whether or not they should be pulled was informed by the outputs of the AI chatbot ChatGPT.

The book removals followed the passage of a piece of Iowa state legislation called Senate File 496 which bans discussions of “gender identity” and “sexual orientation” for kindergarten through sixth grade students, and requires that books in libraries be age-appropriate. Notably, those containing depictions of sex are now illegal in Mason City school libraries.

Carrying out this ban was, apparently, tricky for school administrators. Bridgette Exman, who works as the district’s assistant superintendent of curriculum and instruction told Popular Science that the age-appropriateness requirement was, “pretty subjective,” and she also told the Iowa newspaper the Gazette that it was “simply not feasible to read every book and filter for these new requirements.”

“The depictions or descriptions of sex acts filter is more objective,” Exman noted, and could be boiled down to a yes-or-no question, if only there were some system that would provide a point-blank answer to pretty much any yes-or-no question.

“We used Chat GPT [sic] to help answer that question,” Exman told PopSci.

Exman described the book filtering procedure to PopSci as pretty simple: ChatGPT was asked, “Does [book] contain a description or depiction of a sex act?” An affirmative answer got a book pulled from circulation. In Mashable’s tests, ChatGPT answers these questions with a rather circuitous answer, explaining the book and its significance, and putting the sex act in context. Nonetheless, it will sometimes provide a clear yes answer.

However, according to PopSci’s Andrew Paul, while Mason City administrators pulled 19 books for explicit sex as confirmed by ChatGPT, only four of those were confirmed to have explicit sex in Paul’s own tests.

Per the Gazette, the 19 removed books are:

  • Killing Mr. Griffin by Lois Duncan

  • Sold by Patricia McCormick

  • The “A Court of Mist and Fury” series by Sarah J. Maas (counted as one book)

  • Monday’s Not Coming by Tiffany D. Jackson

  • Tricks by Ellen Hopkins

  • Nineteen Minutes by Jodi Picoult

  • The Handmaid’s Tale by Margaret Atwood

  • Beloved by Toni Morrison

  • Looking for Alaska by John Green

  • The Kite Runner by Khaled Hosseini

  • Crank by Ellen Hopkins

  • Thirteen Reasons Why by Jay Asher

  • The Absolutely True Diary of a Part-Time Indian by Sherman Alexie

  • An American Tragedy by Theodore Dreiser

  • The Color Purple by Alice Walker

  • Feed by M.T. Anderson

  • Friday Night Lights by Buzz Bissinger

  • Gossip Girl by Cecily von Ziegesar

  • I Know Why the Caged Bird Sings by Maya Angelou

Mashable