Lots of people in IT have been fired and must find a new job.

The whole federation loves nolto.social, an open source, federated alternative to linkedin! 5 seconds later We regret to inform you the noto.social is vibe-coded

€5 say they’ll claim he was talking to jefffrey in an effort to stop the horrors.

no not the abuse of minors, he was asking epstein for donations to stop AGI, and it’s morally ethical to let rich abusers get off scott free if that’s the cost of them donating money to charitable causes such as the alignment problem /s

I don’t mean the term “psychosis” as a depreciative, I mean in the clinical sense of forming a model of the world that deviates from consensus reality, and like, getting really into it.

For example, the person who posted the Matrix non-code really believed they had implemented the protocol, even though for everyone else it was patently obvious the code wasn’t there. That vibe-coded browser didn’t even compile, but they also were living in a reality where they made a browser. The German botanics professor thought it was a perfectly normal thing to admit in public that his entire academic output for the past 2 years was autogenerated, including his handling of student data. And it’s by now a documented phenomenon how programmers think they’re being more productive with LLM assistants, but when you try to measure the productivity, it evaporates.

These psychoses are, admittely, much milder and less damaging than the Omega Jesus desert UFO suicide case. But they’re delusions nonetheless, and moreover they’re caused by the same mechanism, viz. the chatbot happily doubling down on everything you say—which means at any moment the “mild” psychoses, too, may end up into a feedback loop that escalates them to dangerous places.

That is, I’m claiming LLMs have a serious issue with hallucinations, and I’m not talking about the LLM hallucinating.

Notice that this claim is quite independent of the fact that LLMs have no real understanding or human-like cognition, or that they necessarily produce errors and can’t be trusted, or that these errors happen to be, by design, the hardest possible type of error to detect—signal-shaped noise. These problems are bad, sure. But the thing where people hooked on LLMs inflate delusions about what the LLM is even actually doing for them—that seems to me an entirely separate mechanism; something that happens when a person has a syntactically very human-like conversation partner that is a perfect slave, always available, always willing to do whatever you want, always zero pushback, who engages into a crack-cocaine version of brownosing. That’s why I compare it to cult dynamics—the kind of group psychosis in a cult isn’t a product of the leader’s delusions alone, there’s a way that the followers vicariously power trip along with their guru and constantly inflate his ego to chase the next hit together.

It is conceivable to me that someone could make a neutral-toned chatbot programmed to never 100% agree with the user and it wouldn’t generate these psychotic effects. Only no company will do that because these things are really expensive to run and they’re already bleeding money, they need every trick in the book to get users to stay hooked. But I think nobody in the world had predicted just how badly one can trip when you have “dr. flattery the alwayswrong bot” constantly telling you what a genius you are.

Copy-pasting my tentative doomerist theory of generalised “AI” psychosis here:

I’m getting convinced that in addition to the irreversible pollution of humanity’s knowledge commons, and in addition to the massive environmental damage, and the plagiarism/labour issues/concentration of wealth, and other well-discussed problems, there’s one insidious damage from LLMs that is still underestimated.

I will make without argument the following claims:

Claim 1: Every regular LLM user is undergoing “AI psychosis”. Every single one of them, no exceptions.

The Cloudflare person who blog-posted self-congratulations about their “Matrix implementation” that was mere placeholder comments is one step into a continuum with the people whom the chatbot convinced they’re Machine Jesus. The difference is of degree not kind.

Claim 2: That happens because LLMs have tapped by accident into some poorly understood weakness of human psychology, related to the social and iterative construction of reality.

Claim 3: This LLM exploit is an algorithmic implementation of the feedback loop between a cult leader and their followers, with the chatbot performing the “follower” role.

Claim 4: Postindustrial capitalist societies are hyper-individualistic, which makes human beings miserable. LLM chatbots exploit this deliberately by artificially replacing having friends. it is not enough to generate code; they make the bots feel like they talk to you—they pretend a chatbot is someone. This is a predatory business practice that reinforces rather than solves the loneliness epidemic.

n.b. while the reality-formation exploit is accidental, the imaginary-friend exploit is by design.

Corollary #1: Every “legitimate” use of an LLM would be better done by having another human being you talk to. (For example, a human coding tutor or trainee dev rather than Claude Code). By “better” it is meant: create more quality, more reliably, with more prosocial costs, while making everybody happier. But LLMs do it: faster at larger quantities with more convenience while atrophying empathy.

Corollary #2: Capitalism had already created artificial scarcity of friends, so that working communally was artificially hard. LLMs made it much worse, in the same way that an abundance of cheap fast food makes it harder for impoverished folk to reach nutritional self-sufficiency.

Corollary #3: The combination of claim 4 (we live in individualist loneliness hell) and claim 3 (LLMs are something like a pocket cult follower) will have absolutely devastating sociological effects.

OT: today the respiratory illness I’ve had for five days tested positive for Covid the first time just now.

My symptoms are fairly mild, probably because I reinforced my vaccine three months ago. But I’m trying to learn more about these recent “swallowing razors” variants and dang! the online situation is bad. Finding reliable medical information in the post-slop, post-Trump Internet is a nightmare.

this sounds exactly like the sentence right before “they have played us for absolute fools!” in that meme.

I gave the new ChatGPT Health access to 29 million steps and 6 million heartbeat measurements [“a decade of my Apple Watch data”]. It drew questionable conclusions that changed each time I asked.

WaPo. Paywalled but I like how everything I need to know is already in the blurb above.

The interesting thing in this case for me is how did anyone think it was a good idea to draw attention to their placeholder code with a blog post. Like how did they went all the way to vibe a full post without even cursorily glancing at the slop commits.

I’m convinced by now that at least mild forms of “AI psychosis” affect all chatbots users; after a period of time interacting with what Angela Collier called “Dr. Flattery the Always Wrong Robot”, people will hallucinate fully working projects without even trying to test whether it compiles.

I mean you don’t have to grasp, know of, or care about the consequences when none of the consequences will touch you, and after the bubble pops and the company bankrupts catastrophically, you will remain comfortably a billionaire with several more billions in your aire than the ones you had when you started the bubble in the first place. Consequences are for the working class, capitalists fall upwards.

Cloudflare just announced in a blog post that they built:

a serverless, post-quantum Matrix homeserver.

it’s a vibe-coded pile of slop where most of the functions are placeholders like // TODO: check authorization.

Full thread: https://tech.lgbt/@JadedBlueEyes/115967791152135761

Someone at the It Could Happen Here podcast was making a prediction that someone at some point will make a big push for an “AI crypto”, which (under some pretext or another) you can only mine with AI datacenters. Because there’s like a real big amount of resources being burned on AI datacenters, and as the chatbots continue to fail to return anything at all on the massive investment, they’ll have to come up with a way to justify the datacentres’ existence at all. Maybe Yegge’s just ahead of the curve 🤷‍♀️

I went from “oh hey Steve Yegge I vaguely remember that name, what’s he up to these days?” to “Oh.” in the space of half a sentence

If someone deals with this using denial (one of Freud’s maladaptive defenses), you get the nerd who says “no, I really am the next Einstein,” ie a crackpot, aka the sort of person who gets featured on Sneerclub. If they deal with it using reaction formation (another of Freud’s maladaptive defenses), you get the self-hating nerd, aka the sort of person who joins Sneerclub⁴.

Fuck how is Scott’s prose always so boring.

But hey, the news to me is: Is Freud a thing in the Alexandrian county of the ratworld now? I thought Freud was supposed to be illogical pseudoscience mystification or something

Choice sneering by one Baldur Bjarnasson https://www.baldurbjarnason.com/notes/2026/note-on-debating-llm-fans/ :

Somebody who is capable of looking past “ICE is using LLMs as accountability sinks for waving extremists through their recruitment processes”, generated abuse, or how chatbot-mediated alienation seems to be pushing vulnerable people into psychosis-like symptoms, won’t be persuaded by a meaningful study. Their goal is to maintain their personal benefit, as they see it, and all they are doing is attempting to negotiate with you what the level of abuse is that you find acceptable. Preventing abuse is not on their agenda.

You lost them right at the outset.

or

Shit is getting bad out in the actual software economy. Cash registers that have to be rebooted twice a day. Inventory systems that randomly drop orders. Claims forms filled with clearly “AI”-sourced half-finished localisation strings. That’s just what I’ve heard from people around me this week. I see more and more every day.

And I know you all are seeing it as well.

We all know why. The gigantic, impossible to review, pull requests. Commits that are all over the place. Tests that don’t test anything. Dependencies that import literal malware. Undergraduate-level security issues. Incredibly verbose documentation completely disconnected from reality. Senior engineers who have regressed to an undergraduate-level understanding of basic issues and don’t spot beginner errors in their code, despite having “thoroughly reviewed” it.

(I only object to the use of “undergraduate-level” as a depreciative here, as every student assistant I’ve had was able to use actual reasoning skills and learn things and didn’t produce anything remotely as bad as the output of slopware)

Like that classic Žižek bit about fair trade organic coffee in Starbucks being a way of offering temptation, sin, penance and absolution all in one convenient package, you pay to absolve the guilt.

Invest in benefit corporations to wash the guilt/bad PR from social and environmental damage, and as a bonus if any of them randomly strike a vein in the hype mines, you can let go of the pbc frame and milk some profits. (they think. it remains to see how much profit can be made out of this bloated, costly software.)

and on the side of the _entepreneur, start your grift as a pbc and you get some investment even if you never reach a point where profits may be made.

As “AI” grift corporations race to extract all the shareholder value they can before the con is off, I expect we’re going to see a race to the bottom of polluting and destroying the environment more and more brazenly to squeeze those few more profits—an approach tolerated, when not outright endorsed, by the current political landscape. Ahead of the race and already a veteran at the bottom, Elon Musk: https://xcancel.com/aakashgupta/status/2012588893884019092

my landlord’s app in the past: pick through a hierarchy of categories of issues your apartment might have, funnelling you into a menu to choose an appointment with a technician

my landlord’s app now: debate ChatGPT until you convince it to show you the same menu

as far as I can ascertain the app is the only way left to request services from the megacorp, not even a website interface exists anymore. technological progress everyone

oh gosh our boy is just so proud that he got the echo-chambering machine specifically engineered to chamber echoes to echo his words.

what kinds of jailbreak is he going to invent next, maybe a way to make LLMs suck up to everything you say? perhaps even a sophisticated hacker glitch to make LLMs say things that are statistically likely to follow the preceding input