
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
My company recently converted our PMs into Vine Engineers right after laying off actual engineers. They don't even know what git is or how to use it. 3 of them alone are using $7k a month in Claude tokens and they have not raised so much as a single PR.
Who needs PRs? What's a branch? It defaults to master and that seems to work just fine!
So it has a negative ROI and anyone who brought it into their firm is a clueless twat who uncritically bought a sales pitch.
If corporate governance were not a joke, C-level heads would roll.
Some CEO guy said employees must evolve. Throttle your workloads even more employees. Transcend! Praise be to the AI overlord(s)!
A sign of the times? Possible lead in the bubble popping?
AI bubble popping is that gif of the crash test truck.
No clue what you mean.
Wait for it.

I’m confused. I thought employers loved AI and it was the future.
They love money. AI was good money for a while. Or at least it looked like good money until you looked at it for longer than 3 seconds, which greatly surpasses the average attention span of an executive. And also the average executive's iq.
Mixed bag.
There are legitimately high value problems that AI works well against. But ungoverned proliferation has a net negative ROI across complex and difficult to measure areas.
When applied expertly, it works great. When blindly handed to your entire workforce as a panacea, not so much
They loved it too much and now it costs more than paying a living wage to a human being. The end goal of AI was always to cut cost and layoff people. The best sabotage right now is to setup a script that constantly prompts an LLM for something useless. I would recommend it if it didn't waste so much energy and clean water. But it would send a message. AI is not cheaper, it never was. Even with today's outrageous token prices, LLM companies are still bleeding money per user. It will only get more expensive as data center contracts fall through and the investment craze fizzles out.
the AI companies are hoping the ones buying the LLM subscriptions to be the suckers and losers.
Uplifting News
All over America, employees are saying "But YOU said..."
This is actually how the bubble begins to pop, we're seeing it happen now.
...said every day now for a year
Ironic
Something I’ve been noticing recently is that while the cost per token on specific models hasn’t gone up, the provided interfaces for using those models are starting to chew up significantly larger numbers of tokens for the same tasks that used fewer tokens with older versions of the interface software just a few months ago. Likely the interfaces are applying more expensive guardrail prompts and charging the end user for those tokens — but the end result is that it costs 4x as much to get the same work done.
A very large chunk of the improvements in the last year have come not from categorically better models, but from the circumstances of the models massively improving. For example, reasoning is just automatic prompt engineering, and eats a fuckton of tokens. Harnesses give LLMs tools, making it easier to turn nondeterminism into determinism (does this code compile is a decision the compiler can answer definitely). Then there's subagents, which is just automatic context engineering.
Basically, the price per token might not have changed, but in practice, the amount of tokens used to get "SOTA" performance has massively increased.
How is it too expensive? Surely it's generating way more profit than it would cost in value. How else could it be propping up the entire economy?
Itd have to be some kind of bubble and that would mean we were in a lottttt of danger and should reasses our use of it.
Nah we should just reduce our use because its too expensive and then stop thinking about it beyond that.
I don't really understand how people are using so many tokens. At work I haven't even hit $200 I spend per month. Wtf are people doing with these things that burns so many tokens?
If you run "agentic coding harness" or any kind of goal oriented loop then tokens goe brrrr.
And LLM sellers are pushing for that (duh), as they managed to convince people to use infinite monkeys typewriting until they make Hamled.
(Type made on purpose)
Agent loops for SWE burn a LOT of tokens.
I'm unfortunately temporarily disabled and can't use my hands for another 2 months. So I've leaned heavily into AI based workflows to keep my job in the meantime.
Aside from the nightmare of keeping quality high, not atrophying skills, and avoiding a lack of domain knowledge. It works reasonably okay.
Token usage is insane though. A productive day might cost a few hundred dollars in tokens all things considered. Quality is expensive as well, a good 1/4 of that are automated systems that exist to identify defects, quality, coherence....etc issues early.
I do it on purpose
Some companies had leaderboards and encouraged AI usage until they got their bills.
A big context costs a lot more
https://github.com/JuliusBrussee/caveman
Why use many token when few do trick
That's funny now that whole workflows are automated with it. Oops hit the quota, I'm off
You mean those workflows that could've been traditional scripting and CI/CD, if not for management forcing AI into them? Those workflows?