Yeah, what's the surprise here? Turns out it's expensive.
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
Microsoft was deceptive here and never made it clear exactly what sort of deal you were getting with the flat rate. There was no indication of the actual magnitude.
Yeah especially because they now have some convoluted method involving different counts of processing, cache etc. But the developer has no easy way of seeing those statistics and thus has no feel for them. And developers already have little control over how much tokens a task takes. Which was fine with the flat rate, just use the service. But now that those things actually matter, the stats should be way easier to see?
So in typical Microsoft fashion not only did they raise prices they somehow made it even more shit. Like the AI already sucked, but does the service itself need to suck as well?
Not being able to control costs and very vague productivity improvement claims makes the ROI impossible to calculate. So even if the AI wasn't shit, it would still be hard to figure out if it's even helping at all.
It was very much a red flag when they shut down signups.
You'd have to be truly ignorant to not know that it was going to happen (not saying that you are). It'll be interesting to see if there any legal recourse, but I'm guessing not.
All of these companies are hemmoraging money to train and provide LLMs. The only option is to charge more. This current increase, IMO, is an alpha test for future increases. Unless there is a major jump in the technology, moreso the logic to train LLMs more efficiently, the cost has to keep going up to stay solvent for most of these major players.
The surprise is that they're not continuing to throw VC money at it to bolster user numbers and mislead investors.
It wasn't profitable. This bait and switch was a long time coming.
Yup, the “first one is free” deal is always a trap.
Literal drug dealer strategy
In just glad it happened relatively soon. Should have happened sooner :-)
Man, enshittification is happening so fast for ai. Imagine the next big thing. It'll be enshittified prior to release.
As a mod for the Enshitification you hate to see Enshitification in any form.
As a mod of Fuck_AI, I'll make an exception in this one case.
COMMENCE THE ENSHITIFICATION!!!!
Which completely goes against my Enshitification mod mindset, but here we are.
So....nobody told me life was going to be this way.....
clap-clap-clap-clap
They forgot the first step where you make a great product that everyone's clamoring to use.
Meta kind of did that with their VR stuff. They skipped the appealing to users part and build a bland, brand-safe, microtransaction-laden experience to sell to businesses assuming they could just use their size to force users to buy it.
„Enshittified“ implies it was ever not shit.
Sigh. None of this is surprising in the least. The cost of AI infrastructure and compute (coupled with the complexity of the chain) makes it prohibitively expensive.
It only has appeared cheap because of investor money flowing like Niagara on the off-chance that it could be made cheap enough to be profitable after getting everyone addicted to using it. I really don't think it's there, and it's definitely not cheap enough to continue flying for free much longer.
There will be some major bag holders soon. Who's is gonna be? The funnelers or the funnelees? How does MS bounce back having integrated copilot into everything?
Given the recent NASDAQ changes, looks like US pension funds will end up with the bag. What a scam.
Microslop can suck it.
So a massive wealth transfer - right after Covid, ANOTHER unprecedented wealth transfer.
Side question: when are you people in the imperial core going to do something about this with all that God given Liberty™ and Freedom® you continually bomb and destabilize the rest of us for?
~~GitHub~~ Microsoft just switched Copilot to metered billing, and developers are watching months of credits vanish in a single day
They switched from heavily subsidizing it, to subsidizing it less. That's going to happen with the other providers, too.
yes but continue to use the github brand because we need to remind folks that github blows
Everyone could've seen it coming from mile away
I have pro+ and I filed an FTC complaint when the billing change was announced and encouraged others to do the same, with the hope that it may lead to a class action settlement in the future.
Good luck, buddy!
I'm not sure why anyone is surprised. The new pricing is closer to what it actually costs to provide the service.
They can't keep subsidizing AI forever. The same thing is going to happen to other providers too.
Ever run an AI model locally? If you want the most capability you need a fast GPU with 32-48gb RAM. And that's all for you, ONE user.
Copilot has millions of users, with tens or hundreds of thousands of them hitting the AI all at once. Each one needs $thousands worth of GPU and RAM dedicated to them for the length of their query processing.
Where do you think the money to buy all that hardware comes from? You see OpenAI buying a double digit percentage of the world's RAM production, you think they got it on clearance sale?
No, there are investors. Investors who are pouring hundreds of billions into this AI stuff. And they don't do this because it's fun, they do it because they expect a BIG return.
So what's going on is just like your neighborhood drug pusher, only the drug pusher is more honest. He says 'first hit's free, man'. AI company says 'AI models are an easy and cost effective way to modernize your workflow!'; they don't tell you that once you've integrated them and fired all the humans who know how to do the work, the price is gonna go way up.
Because the fact is, there IS a real cost of AI compute. GPU time, or at the large scale, datacenter space, power, cooling, etc.
In another few months to few years, the C-suites will stop huffing the koolaid and will start doing cost-benefit analysis on where AI is and isn't cost-effective vs. humans. With any luck (for the AI people) by that time the AIs will be good enough that it's a clear benefit. If not this bubble's gonna pop.
Has anyone ever actually had a drug dealer giving out free hits?
I feel like that's the biggest lie DARE ever told.
I've been using it for well over a year now.
Hit my limit in 1 day and canceled.
Just trying to squeeze it out before the pop.
I guess they are starting to feel the strain of hemorrhaging billions of dollars for data centers.
They're figuring if AI is not deeply embeded and people totally addicted to using it by now it's not ever going to happen, so it's time to let the trap shut and see what they caught.
Watching github news from my codeberg safe place 😎🍿🍺
Not me. As soon as my boss said, "Use the tool thoughtfully," I pretty much don't use it at all anymore.
The most thoughtful way to use it.

My reaction, exactly.
Would love to be a fly on the boardroom wall of any one of those companies which did massive layoffs “because AI”. Probably lowkey panicking on how to get their devs back.
I think this is "stupid money', again.
I hope this makes companies stop being "AI native"
*plays the world's tiniest violin*
Good.
The faster slop code stops, the more reliable our software will get.

Just wait until OpenAI and Anthropic get their IPO and the front slowly falls off. A recession will happen shortly thereafter.
Now suddenly everyone will care how horrible it is when you have to pay for said garage.