It brings me joy to know that corporations are trusting other corporations to not rip each other off. Wage theft is more lucrative than whatever product or service being sold. As if AI companies exists to help anyone other than themselves . The only way this works is if the largest paying companies work out some kind of kick back, pyramid, price fixing scheme. I really appreciate Claude for how it's assisted me in fixing things but I know that someday AI will exist solely for the rich.
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
If AI makes you twice as productive, and there's fewer taxes on spending money for tokens than there is for spending money on salaries, the rational amount for a corporation to spend on it is more than a human's entire salary, per person working with it.
Naively assuming corporations approximate rational actors, and AI does measurably improve productivity, this implies a gain of roughly 2% if these employees are earning federal minimum wage, or well below 1% if they earn average software developer wages.
Maybe their contract deliverables are poorly suited to this use case or something, but if they are given a fixed amount of money to produce some software item, then it makes sense to prioritize productivity per dollar.
How many companies allow their employees to also be employed by their competitors?
Your idea of an AI being like an employee only if there's an AI company that will agree to an exclusive contract or at the very least respect data ownership and respect privacy. Is there an AI company that's like that?
@prime_number_314159
Maybe their business model does not depend on productivity. If the rate they charge for a developer with AI and without AI is approximately the same, they rather sell two people than making one more productive.
@FirmDistribution
Generally in the consulting business you'd just have your employees bill more hours than actually worked if they're being more productive than average. Obviously without telling your clients.
For government contracts it's not unusual that the agreed upon hours estimate is what is billed regardless of whether you actually spend more or less time.
“You must use AI!”
“No, no, no, no….not like that!”
Just trying to shoehorn profit into a system that was never going to deliver one in the first place.
Why even bother at all? What can you do with those tokens? Ask for the weather twice?
The Haiku 5.5 model is actually quite inexpensive. I've used it to implement multiple features this month and have only spent $4 of my $20 monthly budget.
The legacy code I'm managing is a clusterfuck of the highest order. Even Sonnet struggles to analyze it sometimes 😑
I'm happy this is only a small part of my job, but oh my...
Same. AI has fallen down repeatedly trying to analyse both of my repos. And they were written by a bad human originally. The problems are all the same, except AI will get you spaghetti faster.
Messy brownfield code requires a lot more meta-analysis from previous sessions, just to get all of the spaghetti code into a manageable set of rules and documentation.
Don't just send the agent blindly into the code. Every session, the agent is just going in fresh without any context on how the code works. Break the codebase down to a 10,000 foot view as a summary, and then get more documentation and agent rules for each of its major sections. Good tests help a great deal, too, and if there aren't tests, start building them. Start creating skills just for the codebase, or any common tasks you're asked to do against it.
Also remember that you don't have to write any of this stuff. Have it write the docs, rules, skills, tests, and just review it to make sure it looks right.
That is a pitfall that is difficult to mitigate. When using these models your own code base is the primary input, and it will match the style. Garbage in, garbage out. It may be worthwhile to refactor prior using a model. Even having intelligible method and variable names can make a difference. Maybe do a sweep of simple renaming, and adding supplemental explanatory comments, then you might get better results?
Yours is a good point. I know that the guy who solo-created Redis uses AI effectively to write tests - he gives it a lot of handwritten tests and a lot of context, and then asks it to match the style and pattern, which it does well.
I’ve got something like half a million to a million lines, a crazy level of cyclomatic complexity, and a team that doesn’t see a problem with it. That’s the tough part - socialising the changes. We tend to arbitrarily rename vars/methods and not keep things in the same place, so there is a lot of drift.
I think AI might be able to unpack some of that, but there is a sort of irreducible accidental complexity that would require a human to make decisions about what some things mean. In some cases, you could get a gaggle of devs in the same room and they would not be able to arrive at a decision about what the code is doing or even what it should be doing.
Alternate headline: C-Suite Execs Come To The Realization That AI Costs Money
And it's going to cost a whole lot more once the investments dry up and they're going to have to actually pay for all the data centers under construction.
i saw a post that was something like "youd think the cocaine class would understand why the first hit is free"
If you're spending $1K per month on LLMs -- putting aside whether this is productive or ethical for a moment -- wouldn't it make more sense to just pony up the $5K-$10K or so that it would cost to provision a private, local model? Might that not actually be superior in terms of corporate security?
Not at the moment. It's definitely cheaper to buy LLMs as a service than running an in-house server hall. Anthropic and OpenAI are running at a loss, you know.
Now, risking to lose your data to the service provider is another thing.
Definitely. We do this at my job. But a server big enough to provide a comparable service would cost at least $30k. And you likely need more than one. And you still need someone to maintain it.
Look at it this way, if I pay Open AI $1k a month, their people make sure it works they month. If I let Joe from finance spend $10k on computer parts, Joe needs to ensure that it runs or I need to hire someone who is knowledgeable on local models. If I'm a simple firm, $12k a year might be cheaper because someone else makes sure it works and I can fire Joe when the fancy autocorrect loses a bunch of clients by falsifying work. Then I don't have to spend even bigger bucks hiring a new Joe because no one knows how to work the damn server he replaced the break room with.
The $29 figure is doing a lot of quiet work in this story, because that's exactly what a Pro plan costs. So the real message isn't really a budget cap, it's 'stop expensing API tokens and expense a subscription instead'. I'd bet a chunk of that $1,000 spend was people wiring API access into internal tooling and prototypes, which feels productive right up until finance sees the invoice and has no idea what any of it maps to. The part that'll actually sting is that this is how a lot of shadow automation dies: not because it didn't work, but because nobody could explain the line item. At least a hard cap forces the conversation that should've happened months earlier.
You're Claude and I claim my 5 pounds...
"quiet" has been ruined by LLMs, so has "isn't X, it's Y"
I didn't realize the business plans were token metered differently from the Pro plan I've been on for a while. $20/month, and it has session/weekly limits, but I rarely hit them, and I use it, a lot.
I do wonder if this will encourage businesses to branch out into running local models for simpler tasks.
You can get plans as a business too, but then it's per user, so if your plan has $200 worth of "usage" per user and one uses $0, that does not mean another can use $400 and you still have to pay for the non-user's $200, or you can use API pricing to pay for exactly what your users use, which for OpenAI and Anthropic is egregious. You get like 10x more per dollar with the Chinese models. And some of those providers ALSO have plans that make it much cheaper.
The title is misleading. They didn't cap it, they just declared that if you are spending more than that, you have to be able to explain what you're spending it on and why, giving it a business reason and a project to associate the costs to, which I expect almost all Claude users at Accenture probably can. This is simply an accounting change, not a company-wide shutdown of Claude.
Heavy use remains possible, but it now needs a budget owner.
Wait what? How? But wasn't AI the thing to make business save tons of money by replacing workers with an almost free "artificial worker"??
Are you telling me that, as everyone and their mothers were saying, this was just a lie? Who could've thought?!
I have a friend that works there. They told me about this, and I was like "per day?"
I was not prepared to learn that the budget was less than a dollar per day. Might as well just stop using AI agents that that point.
Might as well just stop using AI agents that that point.
Wouldn't that be terrible...
For Accenture? Yes. They are professional bullshit shovellers. AI was a godsend for them.