This is a most excellent place for technology news and articles.
if only AI companies optimized their AI to run on less compute (in the data centers)
If only the mainstream media would have said this since 2023. We maybe even have dodged the bullet called the Trump second term, but now we're heading towards a global financial collapse.
Yeah no shit Sherlock. AI chat bots are just a way to market and sell a dystopian surveillance apparatus to the masses wrapped in the guise of it will right your bullshit corporate emails and messages for you all the while the government and the corporations are fucking you in the ass.
It was a barely functional technology that provides convenience and laziness well hiding it’s true purpose, Machine learning algorithms for facial recognition license prints tracking making it efficient and relatively economical to spy on and control an entire population.
what makes you think advances in LLMs have anything to do with ML for Computer vision? If you wanted the latter, you would've gotten that way cheaper than by training on reddit text.
12 upvotes for this thin conspiracy theory, congrats Lemmy.
If you think those datacenters being built are for LLMs only, I have a bridge to sell you.
ML and LLMs both need massive compute to work with the data sets involved.
AI is the idea of putting a million monkeys in a room with a typewriter and waiting for Shakespeare.
The smart people already knew the monkeys would just starve to death. The business majors are just now figuring that out.
It was the best of times, it was the blurst of times.
The ten thousandth monkey typed out the word "the" , fund them everything they'll type out Shakespeare!
Dude, the math says it would be cheaper to fund research into necromancy to revive the actual Shakespeare than this.
Look, if you know a way to convert a PDF to text with less than 500GB of VRAM and 2000W of power used for twenty seconds, I'm all ears.
I’m…but…no…wait….
We’re not going to make it.
It isn't about content generation at all. It's about pattern recognition and prediction, which, in the hands of those with the most power to change the world, offers insights into our collective behavior that rulers from every age would have committed genocide to get. AI will tell them how to better build the prison the poor are being impoverished into.
It has the same flaw as every other overreaching evil. We outnumber them. A significant number on our side is willing to kill the other side.
Ima die in the crossfire for sure. But the evildoers always assume they are going to win and they literally never do. They always lose. Expensively.
It’s a dying echo. Nothing more.
Yes but we are effectively disconnected from our mutual self interest. We should already have risen up together and our complacency is a testament to their existing ability to pacify us.
Stop spreading criti-hype! Zuck didn’t invent a mind-control ray with targeted advertising, and Sam Altman doesn’t run a terminator factory with GenAI.
Wtf are you talking about? Do you even know the nature of data usage today? You can't identify reality from science fiction?
AI enables them to better do what they have already been doing with analytics and user data. They are already doing it and have been for decades.
I've seen it first hand on smaller software products during analytics reviews and telemetry design discussions during preproduction through product launch and post launch. I know the questions that gets asked, the purpose of a telemetry hook for a user action, heard what they wished they could track and why. I know how they can cohort a user base, how they extrapolate and predict user behavior and user characteristics from that data to target content. There's laws already written to prevent some data collection because of what is known can be done. That's a small software product with a few millions users, not Amazon or Google who have billions of users, many of whom give them access to their entire phone telemetry at all times, cross device access and service wide account tracking, across decades of their lives. Location, region, timezone, battery usage, app usage, age, phone numbers, address, gender, mac ids, wifi connections and data usage etc etc etc.
With just my gender and age, you can make predictions, of some accuracy, using existing research data, about my life, who I am, what I think and how I behave. Every single piece of data more allows further clarity and breadth. That knowledge is what gives them more and more accurate predictions about me, you and all of us. Now they want cameras everywhere, microphones everywhere, OS real ID and VPNs to be banned so there is no anonymity. They want as much data as possible because they now have a data pattern recognition system(LLMs) that can effectively make use of that amount of data.
FFS, this isn't science fiction anymore, it's here, now. And those companies have never had your, or my, interests or well-being in mind. They will use it for power, as they always have.
We are repeating an old pattern in computing: throw more hardware at the problem until efficiency becomes impossible to ignore. Bigger models have delivered remarkable gains, but they’re increasingly expensive. The next breakthroughs may come less from adding parameters and more from smarter architectures, better algorithms and more efficient inference.
Except there likely won't be a lot of further breakthroughs if we burn down our planet faster than we already do.
This is all an expenditure of vast amounts of energy for literally no gain for anybody except a handful of billionaires and their corporations.
DeepSeek has really led the way here, especially as they are a bit more hardware constrained. Plus they openly publish their findings and release open source models, so high hopes there.
It's probably China's play to pop the AI bubble, but I'm all for it (:
Man I swear, AI is like astrology, people have strong opinions about it but haven’t done any research into what it actually is. So much more nuanced than ‘AI bad!’
Large Language Model (LLM) is like astrology, Mashine Learning (ML) is like astronomy. I hate that they both refer to as AI.
That's exactly what Baldur Bjarnason explains in his well-researched book "The Intelligence Illusion". I can highly recommend it!
But it’s so good at programming if you already know how to program! Surely that’s worth burning the planet and crashing the world economy??
Actually still no
https://github.com/JustVugg/colibri
Everyone was desperate to be first because capitalism. But we are getting good models without the insane build out requirement. Which will be hilarious to leave the cunts holding the bag. Not that the planet is better for it in the end.
The engine is a single C file (c/glm.c, ~2,400 lines)
That file is almost 6k lines. The style also makes my eyes bleed. Why do people pretend stuffing 6k lines of code with almost no whitespace and meaningless variable names into a single file is a good thing? I've seen this a lot recently
Yeah this article is already outdated and poorly researched
~1 token per second (storage bound gen4 nvme)... Some of us have places to be.
Don't get me wrong. Its impressive that it can run at all, but honestly the usecase is exceedingly narrow. You'd have better results with a structured quantized gpu-only gemma or qwen workflow. Quality over quantity, rely on validation and a structured process: lots of cross-model review and iteration loops with spec and test driven dev. You could probably get a working alpha by the time colibri set up the environment.
