My daughter Erica Heinz, a most excellent design expert, has been exploring "AI" LLM technology, most recently focusing on "AI" and ethics. Her latest post pointed me at the blog of Gary Marcus, "Marcus on AI".
I subscribed to his RSS feed [substack seems to be very oriented to signing up to mailing lists - I far prefer RSS feeds???]. NewsBlur, my RSS reader, gives you the last few months of posts from a site when you add it to your list.
This 1 of Marcus', from 2025-02-03, caught my attention:
Deep Research, Deep Bullshit, and the potential (model) collapse of scienceClearly great minds running in the same direction:
- "Deep Bullshit" sounds like my "Bullshit All The Way Down".
- "The potential (model) collapse of science" clearly would be part of the general Bullshit Apocalypse.
“Model collapse”, aka “model autophagy disorder”, is what happens when AI models chase their own tails.leading to this conclusion:
And it’s not just the models that will be infected, but the scientific literature itself.A new term for bullshit, "shite", nice! So many variations, so many possibilities, so many new words to describe ... bullshit. We are going to need lots of those - kind of like Kate Bush's "50 Words for Snow".Because Deep Research lowers the effort, making it trivial to write legit-sounding articles, paper mill factories (there is already such a thing, designed to game citation counts, “an illegitimate, yet lucrative business“ that is growing) will massively ramp up production, choking the peer review process and saturating the market with hard-to-find, hard-to-rectify errors.
When — not if — Deep Research begins to flood the medical zone with shite, we are all in trouble.
Again, at this point, I do not think my term, Bullshit Apocalypse, is much of an exaggeration or hyperbole.
The Marcus post starts with this quote:
As Harry Frankfurt observed, “The liar cares about the truth and attempts to hide it; the bullshitter doesn't care if what he or she says is true or false, but cares only whether the listener is persuaded.“Frankfurt wrote the book "On Bullshit", published in 2005, based on a 1996 essay. Wow, I buy the book, (eBook version), it's only 26 pages, 8k words, for $9.99?!?!? Is this like, a self-parody, or ??? Clearly, there should be more bullshit about bullshit. ;->
I think we need more books On Bullshit! What fun coming up with the titles!
No comments:
Post a Comment