I think WWN has commented on "AI" before this, but this 1 was LOL, maybe because of the music tie-in.
For any non-musical readers, "Crossroads" was a 1936 blues song by Robert Johnson which references the legend that he sold his soul to the devil in exchange for musical virtuosity. This exchange took place at a crossroads in the Mississippi Delta.
From the ever-so-competent Bruce Schneier.
AI Doesn’t Have to Go Rogue to Break the WorldSchneier defines what hacking is - not for computers only. He explores his 3 aspects above. He revisits his 'Agents as Genies' formulation, which I think is very good. The article is very comprehensive & easy to understand. Here's his conclusion - I didn't realize he was such a fellow traveler.I want to talk about AI hacking. There are three aspects: people hacking AI systems, people using AI to hack other systems, and AIs hacking systems on their own, not even maliciously. The last two matter more than the first. The third is the weirdest and potentially the most destabilizing.
Much of this isn’t really an AI problem. It’s not a technical problem so much as a capitalism problem or a democracy problem.The failures of late-stage capitalism and democracy in the information age both stem from the rich and powerful getting too good at hacking our social, economic and political systems. This is the core argument of my 2021 book.
Seen this way, AI is exacerbating existing problems. Human inefficiency has largely kept those problems in check, and that won’t work much longer.
So consider this a call to action. Technically, we need to understand how AIs hack systems, build systems that are resilient to hacking and build AIs that won’t act as genies. Politically, we need to learn to govern and regulate at the speed of technology. Otherwise, market failures will overwhelm our ability to govern them.
I said hacking is as old as humanity and that AIs will overwhelm our ability to deal with it. The solutions aren’t specific to AI, but AI makes them more urgent. We need to understand them, and we need to implement them.
From our thought leader Gary Marcus, as The Invisible Hand Starts Popping AI Bubble Wrap.
The great Generative AI unravelingI read somewhere on Friday that Jensen Huang's replacement, the current CFO, recently questioned the extent of Nvidia's circular investments. She was mocked by Huang for her concerns. The circular investments have been a lot of what has been keeping the bubble wrap inflated. If she starts cutting back on them ... Pop! Pop! Pop! ...Things are starting to fall apart
...
The grim fact is that companies like OpenAI, Anthropic, Nscale, and CoreWeave have never been demonstrably profitable (aside from a single tokenmaxxing-mad quarter in which Anthropic received heavy subsidies from Musk). And it’s never been clear that they can stand on their own two feet.
Now they may have to, and that may not be pretty.
Again from Gary Marcus, on the FAA ground stop - all airplane departures in US airspace held for over 4 hours.
What could possibly go wrong? Nationwide FAA Ground Stop editionMarcus starts off quoting a Tuesday, November 10, 2026 tweet from CNN correspondent Pete Muntean.A sign of things to come?
The FAA tells me it's rolling out its AI flight routing tool nationwide.A couple of other people also mention, FAA is rolling out this new tool. Hmmm. The company who produced the AI software has denied any responsibility for the outage. The buffoonish heads of DHS Markwayne "The Plumber" Mullin and the FAA Sean "The Reality TV Star" Duffy both blamed the outage on equipment failure.
“Our switches, our routers, actually got overloaded with data,” Duffy said. “They started to give us inconsistency in the data from those … routers. And because of that, we shut the system down.”Out-of-control AI agents are prone to overload systems. "Inconsistency in the data from those … routers" sounds weird to me. Overloaded routers will drop packets. "Inconsistency in the data" ?????
Marcus also points to the Microsoft outage, which started a day before the FAA ground stop. Microsoft has been eating their own dog food, laying off personnel in favor of GenAI. Screw-ups like this are to be expected.
And, note, they are "eating the dog food" not because it is a good idea. They are "eating their own dog food" to demonstrate how great & wonderful GenAI is, to keep the bubble wrap inflated, &, more importantly, to keep their incredible P/E's & valuations at the present atmospheric levels.
They have reached the "too big to care" phase of their monopolistic existence. What's a little downtime for their users? No biggie ...
And similarly, the current federal administration, in tne name of "efficiency", aka, more tax cuts for the rich, less regulation of corporations, & privatization - aka stripping the federal government for parts - has lost 10s of 1000s of experts, scientists, & engineers who apparently weren't as redundant as DOGE thought.
The (mainstream) media has provided very little hard data and facts on the causes of these outages. I think it's suggestive, but it's currently mostly circumstantial evidence that GenAI is the culprit. But I agree with Marcus' conclusion.
We are reaping what the arrogance of Silicon Valley — and the ineffectiveness of Washington — has sown.These kind of failures are what I have been afraid of from the beginning. As the Bullshit Apocalypse progresses, more & more systems will become more & more error-prone until they finally freeze up & quit working. I thought it would take a year or 3 for that to happen, but, given how aggressively Big Tech is eating their own dog food, it really would not be that surprising if it has already begun.
I wrote most of this yesterday afternoon, here's the latest from this morning (Sunday).
FAA head Sean "The Reality TV Star" Duffy says a newly installed router took their whole network down. Hard to believe, but whatever.
Microsoft says a software upgrade caused their outage.
Interesting that both said "neither terrorism nor AI/Agents were involved".
We now routinely mention these two things in the same breath, but it's still "full speed ahead" for GenAI?!?!?
Here's the home page/directory for my posts on Bullshit. This is post #164.

No comments:
Post a Comment