Update, 2023-05-23: Added a paragraph about Dr. Howard Whiteman’s non-existent quote.

I subscribe to the Chicago Sun-Times, a non-profit newspaper. This week they sent me a sixty-four page special insert, branded with the Chicago Sun-Times logo, full of LLM nonsense. Yesterday I wrote the following letter to the Chicago Sun-Times. That evening, they published this followup.

Dear Mr. Buscaglia and the Chicago Sun-Times,

The May 18th “Heat Index” summer insert feels remarkably like “AI slop”: text generated by a large language model. The unusually enthusiastic use of adjectives coats the entire insert with an oily sheen, but I’m also concerned that there may be wholesale fabrications in the text.

For instance, “Summer soundtracks” cites Dr. Daniel Levitin, in an interview with Scientific American, as saying “Music activates the brain’s reward centers in ways similar to other pleasurable experiences. When paired with meaningful activities, these songs become powerful memory anchors that can transport us back to those moments for decades”. These phrases, and substrings thereof, return zero matches on Kagi or Google. Scientific American’s archives include a January 22, 2001 article with several quotes from Levitin, but nothing like the purported quotes.

The “Nightfall adventures” article cites Dr. Howard Whiteman, professor at Murray State University. “Understanding nocturnal adaptations helps us appreciate the complexity of ecosystems. Even common backyard species display fascinating behaviors that most people never witness.” I checked with Dr. Whiteman, who confirmed that he had never said these words:

I have never spoken to the Chicago Sun-Times or any other Chicago paper, and I can’t recall ever saying any of those words to anyone, ever.

I write for some regional papers, some of which is online, and I could see an AI putting all of my writing together somehow into those words, but I’ve never actually written about nocturnal behavior per se.

The “Summer food trends” article cites an interview in Bon Appetit, claiming Padma Lakshmi said, “What distinguishes this summer’s global food exploration is how these international flavors are being adapted to local, seasonal ingredients.” Lakshmi is published in an interview with BA, but I can’t find any use of the uncanny marketer-speak “this summer’s global food exploration”.

The same article also cites the National Ice Cream Retailers Association as forecasting “unexpected savory notes” and “hyperlocal ingredient sourcing” as the “fastest-growing segments in premium frozen desserts”. I find it hard to believe these are segments at all—nor do these phrases appear anywhere on the NICRA web site.

The “Summer reading list for 2025” recommends books like “The Rainmakers”, by Percival Everett—a real author, but as far as I can tell, not a real text. Immediately thereafter it offers “Salt and Honey”, by “Delia Owens”—again, a real writer, not a real book. I started reaching out to some of the experts cited in the insert to ask whether their quotes were real, then realized the Verge beat me to it.

These examples are just from a cursory skim; the insert fails my LLM “sniff test” on essentially every page. How did this happen? How do you print and distribute a full-color, sixty-four page special edition without anyone reading it first? Many of the articles have no byline, but those that do are purportedly by Marco Buscaglia. Was he responsible? Or is he too, like so many of the people cited in this nonsense publication, a victim of confabulatory applied statistics? This would be a great project for the Sun-Times newsroom, assuming OpenAI hasn’t eaten them yet.

Doubtfully,

—Kyle Kingsbury

Post a Comment

Comments are manually approved. Links have nofollow. Seriously, spammers, give it a rest.

Please avoid writing anything here unless you're a computer. This is also a trap:

Supports Github-flavored Markdown, including [links](http://foo.com/), *emphasis*, _underline_, `code`, and > blockquotes. Use ```clj on its own line to start an (e.g.) Clojure code block, and ``` to end the block.