BigBoyKarlLiebknecht [he/him, comrade/them]

  • 8 Posts
  • 462 Comments
Joined 2 years ago
cake
Cake day: September 3rd, 2023

help-circle


















  • Sadly Yegge now works for Sourcegraph, and as such, is one of the most hyperbolic LLM shills out there. Here’s the article:

    How do you know if you’re doing AI right at your company? We’ve noticed that the companies that are winning with AI – the ones happy with their progress – tend to be the ones that encourage token burn. Token spend per developer per unit time is the new health metric that best represents how well your company is doing with AI: an idea proposed by Dr. Matt Beane and playing out in the field as we speak. I see companies saying, “If our devs are spending $100-$300 a day, that’s much less than paying for another human engineer. So if AI makes our devs twice as productive, or in some cases only 50% more, we’re winning.”

    There’s an implicit assumption here that tokens == productivity. We don’t have any data to back this up yet, so if you’re about to have a seizure from wanting to argue with me, this would be a good spot to pounce and call bullshit on every word of this post.

    kermit-pain



  • Lmao, the free money is drying up for AI companies and they’re enshittifying hard. From the massive rate limiting on Claude’s APIs, to this - the free ride is over, and the largest capital expenditure in the history of tech is producing fuck all to show for it.

    As ever, Ed Zitron has been great on this:

    In the event that they are representative of the greater picture of Anthropic’s customer base, this company is wilfully burning 200% to 3000% of each Pro or Max customer that interacts with Claude Code, and in each price point’s case I have found repeated evidence that customers are allowed to burn their entire monthly payment in compute within, at best, eight days, with some cases involving customers on a $200-a-month subscription burning as much as $10,000 worth of compute.

    I am, however, unsure what restrictions Anthropic could make that would ease the burden on its infrastructure without also hemorrhaging users. I am deadly serious when I say that almost any interaction with Claude Code loses Anthropic money, and anyone using it for even a few hours a day is guaranteed to burn through the majority of their subscription revenue in a couple of days.

    This is not a sustainable business model, but also suggests that the violent and sudden changes to products like Lovable, Replit and Cursor are indicative of the real economics of these models, and the likely future form of products offered by OpenAI and Anthropic themselves — opaque rate limits, random service outages, constant demands to upgrade and unhappy customers churning every hour.

    Edit: just played with it, the AGI is here folks