457
Generative AI Is an Engineering Disaster. A shockingly inefficient trillion-dollar project.
(www.theatlantic.com)
This is a most excellent place for technology news and articles.
We are repeating an old pattern in computing: throw more hardware at the problem until efficiency becomes impossible to ignore. Bigger models have delivered remarkable gains, but they’re increasingly expensive. The next breakthroughs may come less from adding parameters and more from smarter architectures, better algorithms and more efficient inference.
Except there likely won't be a lot of further breakthroughs if we burn down our planet faster than we already do.
This is all an expenditure of vast amounts of energy for literally no gain for anybody except a handful of billionaires and their corporations.
DeepSeek has really led the way here, especially as they are a bit more hardware constrained. Plus they openly publish their findings and release open source models, so high hopes there.
It's probably China's play to pop the AI bubble, but I'm all for it (: