AI safety still has a long way to go before its trustworthy. Lots of PhD thesis topics. Until then, be careful."Be careful." Seems like pretty weak tea to me. How about requiring a license?AI’s safety features can be circumvented with poetry, research finds
Here's a Medium post, about Agentic "AI" in hospitals. What could go wrong?
The Builder’s Notes: Agentic AI in Hospitals — 5 Workflows Leaders Are Automating and the 5 New Risks They’re IgnoringThese cases are examined in depth. "What breaks" is listed for each.Then you deploy it.
And suddenly:
These aren’t hypothetical. These are incidents from the past 90 days.
- Your AI scheduling agent optimized for “maximum utilization” and booked every slot — including maintenance windows and physician PTO
- Your prior auth agent approved 400 requests in one day, including three that should have been escalated to medical review
- Your clinical documentation agent drafted a discharge summary that contradicted the attending physician’s treatment plan
- Your revenue cycle agent resubmitted 2,000 denied claims without fixing the underlying coding errors
- Your triage agent routed a chest pain case to “routine follow-up” because the patient’s exact symptoms didn’t match its training data
Agentic "AI" is not ready for prime time, particularly in hospitals. There will be deaths, like from the triage agent ignoring chest pain. This is definitely full-scale Bullshit Apocalypse.
Here's the home page/directory for my posts on Bullshit. This is post #68.










