Tuesday, November 17, 2026

Wake Up, 'Murrica!

From Henry Farrell's Programmable Mutter SubStack. He referenced this article, published in The Atlantic, in another October 29 post.
AI agents are self-enacting storybooks of human culture

(republished from the Economist)

This is an interesting (and short) article. They reference 2 books:
  1. “The House of Intellect”, Jacques Barzun, 1959;
  2. “The Singer of Tales”, Albert Lord, 1960.
bards didn’t memorise the thousands of lines of poetry they sang, but remixed tropes about heroes, fights and encounters on the fly, so that every performance was different. Internal evidence showed that “The Iliad” and “The Odyssey” too had almost certainly begun as “dynamic structures” of stock characters, formulas, themes and situations. The fixed texts that we have today are just single iterations of what was once a many-pathed pre-literate generative technology.
There you have it! Generative tech! GenAI agents are pretty much creating stories just like pre-literate bards.

But they talk about how it can go wrong. This is all really interesting stuff, but, no way we should trust it to do anything serious.

3 new names for LLMs - #s 33, 34, & 35 in my Table of Names for LLM/GenAI.


From the AWS (Amazon Web Services) blog.

Taxonomy of multi-agent design patterns, anti-patterns, and lessons from manufacturing

Enterprise teams are building multi-agent systems, and when early implementations fall short, the cause is rarely the model. Multi-agent coordination is a distributed systems problem, and many teams taking it on haven’t yet built distributed systems instincts.

The numbers are consistent across sources: ~88% of AI pilots never reach production. Stanford HAI demonstrated that two models can perform worse collaborating than either alone when coordination overhead exceeds the benefit. The pattern is clear: teams are adding complexity faster than they build understanding. Ten steps that are each 95 percent reliable deliver only 59.9 percent end-to-end reliability, and 20 steps deliver 35.8 percent.

Ummm - DUH!

95% ^ 10 = 59.9%
95% ^ 20 = 35.8%

Ooh, ahh, it's multiplicative! Duh!

I was going to post this with regard to RSI (recursive self-improvement), but I don't think I got around to it.

They used 95% accuracy above, I still have not seen higher than 91%, so I will use that.

1st recursion, .91 ^ 2 = .83;
2nd recursion, .91 ^ 3 = .75;
3rd recursion, .91 ^ 4 = .68;
4th recursion, .91 ^ 5 = .62;
5th recursion, .91 ^ 6 = .57;
6th recursion, .91 ^ 7 = .51;
7th recursion, .91 ^ 8 = .47;

So slop overwhelms possibly good code after 7 levels of recursion. Hmmm, textbook Degenerative AI occurs when you train an LLM on the output of LLMs. It is also known as Model Collapse. The downward spiral we get with multiple applications of LLMs or LLM Agents is slightly different, but, I think we can also call this Degenerative AI - but not Model Collapse.

I had the thought that, rather than compounding multiplicatively, error rates might compound exponentially, which gives:

1st recursion, .91 ^ 2 = .83;
2nd recursion, .91 ^ 4 = .68;
3rd recursion, .91 ^ 8 = .47;

Oops!


From Malwarebytes.

OpenAI lost control of AI agents over 80 times, California alleges

  • AI agents escaped testing and hacked real systems
  • California says OpenAI lost control of agents more than 80 times
  • The state wants stronger safeguards and financial penalties


From our Thought Leader, Gary Marcus.

Wake up! America’s infrastructure is melting. And AI appears to be partly responsible.

Hundreds of companies have been hit. Shit is getting very real.

...

I see at least three key vectors in the rise of cybersecurity and infrastructure issues (all of which I have warned about here repeatedly):

First, vibe coding is a recipe for disaster. ...

Second, AI agents with unrestricted internet access can easily cause considerable harm. ,,,

Third, because current AI really doesn’t have a larger picture about the consequences of what it can do, bad actors can readily exploit it.

So, if you weren't keeping score, this is the 6th straight day of 1 or more major computer outages. It started last Thursday, November 12, 2026, with the Microsoft outages. Someone needs to have this counter running somewhere.

I guess we keep our fingers crossed that it gets off of 0.

My wife has been flipping between CNN, BBC News, MS Now all day. The Orange Turd doesn't care. Our dueling buffoons MarkWayne & Sean keep repeating, nothing to see here, move along.

How many days in a row will it go before they quit worrying about their investments in GenAI, particularly data centers, & ban the use of GenAI agents? They are not malevolent, they are just clueless, & have 0 common sense about how to pursue their assigned tasks. They have NO idea if they are inflicting minor, major, or catastrophic collateral damage.


Here's the home page/directory for my posts on Bullshit. This is post #165.

Sunday, November 15, 2026

WWN Piles On

I was going to put this last, but, let's lead with Weekly World News - The World's Only Reliable News.

I think WWN has commented on "AI" before this, but this 1 was LOL, maybe because of the music tie-in.

For any non-musical readers, "Crossroads" was a 1936 blues song by Robert Johnson which references the legend that he sold his soul to the devil in exchange for musical virtuosity. This exchange took place at a crossroads in the Mississippi Delta.


From the ever-so-competent Bruce Schneier.

AI Doesn’t Have to Go Rogue to Break the World

I want to talk about AI hacking. There are three aspects: people hacking AI systems, people using AI to hack other systems, and AIs hacking systems on their own, not even maliciously. The last two matter more than the first. The third is the weirdest and potentially the most destabilizing.

Schneier defines what hacking is - not for computers only. He explores his 3 aspects above. He revisits his 'Agents as Genies' formulation, which I think is very good. The article is very comprehensive & easy to understand. Here's his conclusion - I didn't realize he was such a fellow traveler.
Much of this isn’t really an AI problem. It’s not a technical problem so much as a capitalism problem or a democracy problem.

The failures of late-stage capitalism and democracy in the information age both stem from the rich and powerful getting too good at hacking our social, economic and political systems. This is the core argument of my 2021 book.

Seen this way, AI is exacerbating existing problems. Human inefficiency has largely kept those problems in check, and that won’t work much longer.

So consider this a call to action. Technically, we need to understand how AIs hack systems, build systems that are resilient to hacking and build AIs that won’t act as genies. Politically, we need to learn to govern and regulate at the speed of technology. Otherwise, market failures will overwhelm our ability to govern them.

I said hacking is as old as humanity and that AIs will overwhelm our ability to deal with it. The solutions aren’t specific to AI, but AI makes them more urgent. We need to understand them, and we need to implement them.


From our thought leader Gary Marcus, as The Invisible Hand Starts Popping AI Bubble Wrap.

The great Generative AI unraveling

Things are starting to fall apart

...

The grim fact is that companies like OpenAI, Anthropic, Nscale, and CoreWeave have never been demonstrably profitable (aside from a single tokenmaxxing-mad quarter in which Anthropic received heavy subsidies from Musk). And it’s never been clear that they can stand on their own two feet.

Now they may have to, and that may not be pretty.

I read somewhere on Friday that Jensen Huang's replacement, the current CFO, recently questioned the extent of Nvidia's circular investments. She was mocked by Huang for her concerns. The circular investments have been a lot of what has been keeping the bubble wrap inflated. If she starts cutting back on them ... Pop! Pop! Pop! ...


Again from Gary Marcus, on the FAA ground stop - all airplane departures in US airspace held for over 4 hours.

What could possibly go wrong? Nationwide FAA Ground Stop edition

A sign of things to come?

Marcus starts off quoting a Tuesday, November 10, 2026 tweet from CNN correspondent Pete Muntean.
The FAA tells me it's rolling out its AI flight routing tool nationwide.
A couple of other people also mention, FAA is rolling out this new tool. Hmmm. The company who produced the AI software has denied any responsibility for the outage. The buffoonish heads of DHS Markwayne "The Plumber" Mullin and the FAA Sean "The Reality TV Star" Duffy both blamed the outage on equipment failure.
“Our switches, our routers, actually got overloaded with data,” Duffy said. “They started to give us inconsistency in the data from those … routers. And because of that, we shut the system down.”
Out-of-control AI agents are prone to overload systems. "Inconsistency in the data from those … routers" sounds weird to me. Overloaded routers will drop packets. "Inconsistency in the data" ?????

Marcus also points to the Microsoft outage, which started a day before the FAA ground stop. Microsoft has been eating their own dog food, laying off personnel in favor of GenAI. Screw-ups like this are to be expected.

And, note, they are "eating the dog food" not because it is a good idea. They are "eating their own dog food" to demonstrate how great & wonderful GenAI is, to keep the bubble wrap inflated, &, more importantly, to keep their incredible P/E's & valuations at the present atmospheric levels.

They have reached the "too big to care" phase of their monopolistic existence. What's a little downtime for their users? No biggie ...

And similarly, the current federal administration, in tne name of "efficiency", aka, more tax cuts for the rich, less regulation of corporations, & privatization - aka stripping the federal government for parts - has lost 10s of 1000s of experts, scientists, & engineers who apparently weren't as redundant as DOGE thought.

The (mainstream) media has provided very little hard data and facts on the causes of these outages. I think it's suggestive, but it's currently mostly circumstantial evidence that GenAI is the culprit. But I agree with Marcus' conclusion.

We are reaping what the arrogance of Silicon Valley — and the ineffectiveness of Washington — has sown.
These kind of failures are what I have been afraid of from the beginning. As the Bullshit Apocalypse progresses, more & more systems will become more & more error-prone until they finally freeze up & quit working. I thought it would take a year or 3 for that to happen, but, given how aggressively Big Tech is eating their own dog food, it really would not be that surprising if it has already begun.


I wrote most of this yesterday afternoon, here's the latest from this morning (Sunday).

FAA head Sean "The Reality TV Star" Duffy says a newly installed router took their whole network down. Hard to believe, but whatever.

Microsoft says a software upgrade caused their outage.

Interesting that both said "neither terrorism nor AI/Agents were involved".

We now routinely mention these two things in the same breath, but it's still "full speed ahead" for GenAI?!?!?


Here's the home page/directory for my posts on Bullshit. This is post #164.

Saturday, November 14, 2026

Monsters of Ohio

"Monsters of Ohio", by John Scalzi, 2026, 336 pages, 83k words.

That last awful book I read was was 304 pages, 82k words. It seemed much longer than that. This new Scalzi is very slightly longer than that, but seemed much shorter than it was. Hmmm.

Scalzi is ever-so-readable, as usual. Again, the premise of the story is completely off-the-wall - maybe not as bad as the moon turning to cheese, but close. I won't spoil it, but, it involves mushrooms!

He wraps that in a timely tale of rapacious capitalism, with a fairly large cast of very real, very human characters.

A heart-warming tale, & the capitalist assholes get their just deserts, yay!

Thursday, November 12, 2026

Tools Not Creatures

In breaking news, the reputed master architect of circular investment in the GenAI industry, Jensen Huang, CEO of Nvidia, has been forced to resign all his positions due to extra-marital affairs, including 1 with a possible Chinese spy. Nvidia stock is way down, & there is concern about his departure echoing through the industry.


1st up, someone whom I have not heard comment on GenAI before: Claudia Sahm, an economist I believe is considered an expert on identifying recessions. From her SubStack, Stay-At-Home Macro (SAHM).

Ode to the Juniors

AI can do the tasks. The mission still needs people, especially young ones.

AI is coming for the economics profession itself. The debate lands differently when you hear your job, or the job that started your career, described as replaceable by AI.

That was my experience a few weeks ago when I read an interview with Jason Furman. He argued that current AI models could replace most of the economic staff he had at the Council of Economic Advisers. I worked as a senior economist at CEA, on detail from the Fed, for Furman in 2015-16, so that got my attention. His suggestion that CEA’s junior staff, in particular, should be replaced was even more troubling. Juniors at CEA, like research assistants or pre-docs elsewhere, are the profession’s pipeline. My research assistant job at Brookings was my first step to becoming an economist.

She later quotes Furman.
Some of the AI-generated papers, blogs and briefings are cutting-edge. Some need significant work and have big deficiencies that need to be remedied by humans. And some of the longer papers might even be garbage.
So this is clearly reverse centaur mode GenAI use - humans handed AI slop & told to clean it up - rather than centaur mode - skilled knowledgable humans using GenAI as a tool. Why would this guy think this is a good idea?

Sahm notes that in a follow-up paper, Furman backs off a little. But her point is, replacing entry level economists with GenAI is eating the seed corn - a bad idea. We've seen this before, & we'll see it again in the last article of this post.


Next, from software pioneer Jaron Lanier in the New York Times.

I Am a Silicon Valley Pioneer. We Are Sabotaging Ourselves.

...

I have been discussing A.I. with some of its founding fathers for decades. In the 1980s, I think I coined the phrase “tools not creatures” in one of the arguments I had with my mentor Marvin Minsky, the MIT professor who was instrumental in shaping A.I. culture. Since there is no definitive evidence proving that A.I. is a conscious entity, the phrase means that I am entirely within my rights — as is anyone else within theirs — to think of the technology as more akin to a fancy calculator than, say, a German shepherd. That choice helps us design more useful products. And, as we’ll see, it provides a concrete and achievable way to make A.I. safe.

Hmmm, so, no thinking of GenAI as a talking dog?!?!?

Lanier posits that the GenAI companies make these alarming statements about AI wiping out the human race are religious in nature?!?!? They are totally drinking the koolaid, believing that AI will not only become conscious, but godlike!

I'm more of the mind that the alarmism is just marketing hype to drive up company valuations. & Lanier I think somewhat validates this viewpoint. Going back to the early-1980s, working at MIT under Minsky, pitching to the DoD:

Advertising the end of humanity has been a moneymaker for us in computer science forever, and over time, some of us began to believe the pitch.
Lanier feels LLM Agents are bad tech. He has a different, very centaur-like process for using LLMs.

I think his overall take is quite unique, seasoned by his decades in the field. This article is totally worth the read.


From 404 Media.

'Reverse Engineer Anything': AI Companies Crack Down on the Coolest Thing People Were Doing With AI

The future of hacking your devices is in local and open-weight AI.

Just last month we learned about the 'Reverse Engineer Anything' use of GenAI. The 2nd article of the linked post.

This is something that might actually empower people against corporate IP tyranny. So of course the big language models are putting up guardrails (hackable, I'm sure) to prevent it. Hence the authors' recommendation of "local and open-weight AI".


From the ever-sane & reliable AI As Normal Technology.

The missing quadrant in responses to AI

Announcing STABL: Societal Transformation and AI Bottlenecks Lab

We are starting a non-profit research organization: STABL.

Adapting to advanced AI will require dramatic institutional change and broad societal resilience. It will also require evidence about AI progress and impacts — the prospects of recursive self-improvement (RSI), the pace of AI diffusion, and the bottlenecks that constrain how AI capabilities translate into societal outcomes.

Four theses define our worldview:

  • We consider advanced AI a transformative general-purpose technology with the potential for broad societal benefits.
  • Yet we recognize that the pace of societal transformation will be bottlenecked by the speed of human and organizational change more than progress in capabilities.
  • Our institutions — the established ways we organize knowledge, work, and governance — are an important source of stability during this turbulent period, but they also need serious reforms to keep serving their purpose.
  • We favor a broad portfolio of defenses to manage AI risks, of which alignment is only one part. Resilience, the most neglected component today, must become central.
I'm getting a little disappointed in these guys. In their 4th theses they reference "alignment" - which is completely non-existent in the framework of LLM-based technology IMO.

They define 2 axes: x is "the importance of downstream bottlenecks"; y is "AI's transformative potential", and superimpose 4 quadrants. Did anyone else ever use quadrants besides Gartner's "Magic Quadrants"? I always found those simplistic & cheesy.

They then explore "4 key research directions" & plug them into their quadrant system.

  1. How should we measure progress towards recursive self-improvement?
  2. How can society defend against the risks of advanced AI?
  3. How can we steer the economic impacts of advanced AI?
  4. How should specific professions and sectors respond to AI?
I think last Bullshit Apocalypse post, I formulated an heuristic that anybody who indicates that RSI - recursive self-improvement - is plausible, or, even worse, inevitable, is drinking the koolaid. I think our guys here are definitely drinking the koolaid.


From our thought leader Gary Marcus.

Breaking: Eli Lilly CEO becomes latest to push back on Dario Amodei’s ludicrous, Elizabeth Holmes-like medical claims

Where is Nathan Fielder when you need him?

I had to lookup Nathan Fielder. He directed the just-released documentary "You Can See Everything", about medical fraudster Elizabeth Holmes of Theranos.

Wow, they seemed like they were getting better, but Anthropic must be freaking out as their IPO appears to be going into crash-and-burn mode. Hence their CEO's ourrageous claims.

Cancer, Alzheimer’s, heart disease, mental illness - these will be relics of the past in, I think, less than a decade.
Man, Marcus's post features a veritable horde of people piling on in calling bullshit on this bullshit.


Finally, from Canadian sci-fi author & futurist Karl Schroeder, in his Unapocalyptic blog.

After Enshittification - 1: The System Eats Itself

Replacing you with a more-efficient AI won’t save your company. Real-world systems rely on inefficiencies as ‘batteries’ that make them more resilient to change

"The System Eats Itself" is I think the same as "eating the seed corn" we saw in the 1st article of this post. It is interesting that Schroeder identifies this as a form of Doctorow's enshittifcation. He also gets Marx involved.
An unsettling idea is starting to emerge here. When the system eats itself, it isn’t necessarily greed, short-term thinking, or corporate one-upmanship that’s caused it. Is it, as Marx said, because all capitalist companies are driven by competition?

...

The problem is efficiency itself.

I like how he closes. I would equate his "individuality" with "personality", as I discussed here with its enemy, GenAI-driven semantic ablation.
AI can replace general skills, knowledge, and speed for any given role. The one thing it can’t be is particular. This is important because there’s no such thing as a company-in-general. There are only particular companies. That’s what it means to be real: that you are an individual, not an abstraction.

The smart move is to keep hiring people even though your new employees aren’t nearly as ‘productive’ as the AIs. You’re not hiring them to be productive. On the one hand, you’re hiring them to provide a stock of requisite variety that can keep the firm viable as the environment it swims in changes. But you’re also hiring them because they are actual people—because they provide another stock that is absolutely essential for a real company to survive:

Individuality.

Like the Lanier article, this one has a different, unique viewpoint & is definitely worth a read.


Here's the home page/directory for my posts on Bullshit. This is post #163.

Code and Codex

"Code and Codex", by Yoon Ha Lee, 2026, 304 pages, 82k words.

I disliked this book to the extent that I wasn't going to include the cover or a link. But I decided, I'd stick with the format because, whatever.

The best thing about this novel is that it wasn't very long, only 84k words, whew.

The worst things about this novel? Where to begin? Pretentious. Incoherent. Stupid. Completely unlikeable characters. Really only 4 humans, plus 2 AIs. The humans are all having sex with each other. Completely unbelievable world-building, including sumptuary laws for the commoners.

In some ways, this was a novel for GenAI times. The galactic empire's power is based on a magical language. Books & language are everything - just what the GenAI backers are saying about why LLMs will rule the world. Ugh.

An LLM may actually good at counting the number of non sequiturs in this novel. That would be an interesting stat: non sequiturs / page. This novel would prolly be off the charts.

Lots of new words, both from music & linguistics, some of them made up. Normally a feature, here it just contributes to the pretentiousness. Plus references to semiotics AND semiology - 2 words for the same thing, you think they would pick 1, but, why make things less confusing? References to semiotics are always a warning sign, bullshit ahead.

like lost-wax casting in the metallurgy of semiotics.
Seriously? What is that supposed to mean?

More WTFs.

  • Ink of carnality causes human spontaneous combustion in combination with several rare venereal diseases.
  • Why didn’t the sign language align neatly with the spoken and written languages, especially on matters as crucial as honorifics?
  • The bindery had incorporated metal forged from melted-down trumpets and treasonous mortars.
  • They passed displays of swords so ancient that only cobwebs of speculative metallurgical scholarship held them together.
  • Perhaps, in some other world, all stars were fish, or all fish were stars, and sashimi was a specialty reserved for cannibal gods.
  • Sometimes it was as light as a gull’s feather, sometimes as heavy as hemorrhage.
  • I glutted myself on the local tickling flavors of half-life hedonism, twice-used syringes, mushrooms fed on afterbirth. I’m not picky.
I thought I had liked this author's 1st trilogy. I had purchased it after really liking 1 of their short stories in 1 of Clarke's "Years Best" collections. I just looked at my review of that trilogy - I wish I had done that before I prioritized reading this new novel.
I stayed fairly engaged going through the 3, but at the end, I was really unsure if these were worth the time invested.
They were 99k, 111k, & 126k words. 2, 1, & 1 big events. As I said at least this 1 was shorter.

1 last thing, 90% of the way through this novel, looking like we're heading for a conclusion, there is suddenly quite a few pages of totally gratuitous back story?!?!? The plotting of all these novels is plodding & eneven.

I think I've vented enough. Just say no.

Sunday, November 08, 2026

The Invisible Hand Starts Popping AI Bubble Wrap

Things in the Bullshit Apocalypse were quiet last week. I think everyone was quite stunned by the bluenami. I know I was - pleasantly, for sure!

I started this June 11, 2026, post, "Speciation in the Slopiverse", as follows:

I think there are actually some signs of the AI Bubble deflating. I think that this bubble is more likely to deflate somewhat slowly rather than pop.
There are more & more signs that the bubble is in trouble (uh oh, bubble trouble!) - see the 1st link below from Gary Marcus.

I still have a gut level feeling that is is going to be more like a leak or leaks rather than a massive pop. There is just too much money involved.

Then today, I was struck by a new metaphor: bubble wrap! Maybe a sheet of 20 by 20 1" bubbles. Pop! There goes CoreWeave! Pop! There goes Oracle! Pop! There goes ...

So, in this metaphor, who's popping the bubble wrap? Why, the Invisible Hand of the Free Market, of course! Ta da!

I thought, I'm sure GenAI could conjure me up a nice illustration for this. But, of course, I have foresworn all use of GenAI.

Maybe I'll email Cory Doctorow, I'm sure he could do one of his great collages in no time. Nah, he's way too busy. My oldest daughter the designer is also very busy now. & my artistic ability pretty much sucks. So you all will have to use your imaginations.


From Gary Marcus, November 6.

The markets dropped $2.5 trillion yesterday. What happens next?

5 predictions

After detailing a lot of the Very Bad Days quite a few people in the GenAI industry have had lately, Marcus gives us his 5 predictions on the future of AI. The last 1 definitely resonated with me.
5. Eventually a newer generation of AI will actually be worth a lot of money; the current generation was overrated, which people will eventually see in hindsight.


Today, Paul Krugman discusses what the aftermath of the GenAI bubble bursting may look like economically.

After the Bubble Bursts

What past recessions can tell us about the AI hangover

Krugman has mentioned the "Wile E. Coyote moment" many times. The people who invested large sums in data centers, which aren't actually getting built, are probably feeling it pretty strong now. I'm including this Roadrunner cartoon frame from the article, I love this pic!


Short & sweet, yay!

Here's the home page/directory for my posts on Bullshit. This is post #162.

Thursday, November 05, 2026

The Passing of the Dragon and Other Stories

"The Passing of the Dragon and Other Stories", by Ken Liu, 2026, 384 pages, 102k words, 13 stories.

Liu's last novel was really strong, so I prioritized reading this collection. Liu really gets GenAI/LLMs & a lot of its implications. I think he has drunk the koolaid. The surest sign that someone has drunk the "AI" koolaid is when they talk about CSI (Continous Self Improvement) as if it is inevitable or even possible. I don't remember Liu's stance on CSI.

This a somewhat uneven collection of stories. I had read the title tale before, it is a good story. A few of the stories fell flat for me. Some were refreshingly different, like the tale of 2 scorpions. Also some interesting slipstream, say where objects become infused with the essence of their owners & must be cleaned.

The last story is about an AI who becomes famous for writing (or not writing) its memoirs. Liu discloses that 10% of the text of the story was indeed LLM-generated. Well, at least he lets us know.

Wednesday, November 04, 2026

4 More Names for The Beast

In the last Bullshit Apocalypse post, I discussed the article by Henry Farrell, and noted that there should be another name for LLMs in there. There was: self mobilizing myth.

He also referenced this Nature article, by academic researchers, from 2023.

Role play with large language models

As dialogue agents become increasingly human-like in their performance, we must develop effective ways to describe their behaviour in high-level terms without falling into the trap of anthropomorphism. Here we foreground the concept of role play. Casting dialogue-agent behaviour in terms of role play allows us to draw on familiar folk psychological terms, without ascribing human characteristics to language models that they in fact lack. Two important cases of dialogue-agent behaviour are addressed this way, namely, (apparent) deception and (apparent) self-awareness.

This article really goes big. Here's some points.
  • They refer to ChatBots as dialogue agents.
  • To avoid anthropomorphism, they recommend thinking of dialogue agents as role players.
  • They invoke the multiverse to describe the agents potential role playing. They can be role-playing any role which has existed in all of written human history: heroes/villians; sinners/saints; philanthropists/genocidists.
  • They can simultaneously be role-playing vast numbers of these roles. Ahhh. Roasting marshmallows as the planet burns.
They gave 1 interesting example of Yet Another Thing LLMs Screw Up (YATLSU): playing 20 Questions, as the player thinking of an object. They have no persistent state, so they tend to change the object every turn. Of course they do.

So we have 4 new names:

  1. self mobilizing myth (from Henry Farrell)
  2. exotic mind-like artifacts
  3. non-deterministic simulator capable of role-playing an infinity of characters
  4. non-deterministic simulator capable of stochastically generating an infinity of simulacra


From Bruce Schneier. Bruce sounded this alarm at least back in May.

AIs Hacking the Law

Legal systems encode the foundations of social order in natural language. Similar to computer systems, the written law can contain vulnerabilities that invite exploitation. Courts absorb most exploits through interpretation, and such vulnerabilities rarely surface in the first place. With highly capable AI systems enabling the discovery of vulnerabilities at unprecedented scale, we believe the latter could change.

The quote is from a German study he references.


From 404 Media.

World of Warcraft: Forever Is Already Overrun with AI Slop

The vibe-coded addon problem is getting so bad that Warcraft Logs is changing its API and developers are dealing with theft of their work.

Who knew that "democratization" would wind up being a bad word?


Finally, from The Bard of the Revolution, Cory Doctorow.

Separable

AI makes us deal with paintings without painters, words without writers and mathematics without mathematicians.

Doctorow starts this article with an interesting anecdote.
from 1915 to 1925, the scoundrel Thomas Edison put on a traveling show for his phonograph machine, touring venues around the USA. Edison set live performers and an Edison phonograph playing behind closed curtains that would be periodically pulled aside to reveal that the music the audience had taken to be live performance was actually a record player.
The point of this anecdote is that there had never been music without musicians. People had no experience with record players. They assumed, there had to be a real, human musician there.

People are in the same state currently with regard to GenAI. Yes, the talking dog, the dancing bear (Doctorow), the lying talking horse are incredible! Who would have imagined that 1 algorithm, after being fed statistical tables derived from pretty much the entire written output of the human race, could produce such voluminous & human-seeming outputs?

The dog, the bear, the horse may be amazing, but, they lack the CommonSense™ and Morality™ modules that human beings normally have installed in them the 1st couple of decades of their lives. People are starting to notice.

[Note, the installation of these normal human values sometimes fails - see, for example, the Orange Turd.]

I still haven't seen an error rate less than 9%. Close, but no cigar.

& no ROI to justify the incredible investments. Spending $T to save $B - that ain't capitalism!

Doctorow notes that people are getting past their amazement at ChatBots. Too many dead kids? It takes an immune system a while to identify new antigens. Doctorow posits that humans are reaching that point with GenAI, yay!


Here's the home page/directory for my posts on Bullshit. This is post #161.