this post was submitted on 29 Jul 2026
444 points (99.1% liked)
Technology
86745 readers
2391 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I think there's a categorical issue in how this whole story is framed, at least for the examples that have been cited by the booksellers themselves. These books are "rare" because they are low-print and have basically no demand, think obsolete technical books from the 60s or university theses printed at 100 copies. This kind of books are routinely destroyed by booksellers, and even publishers, because keeping inventory is expensive and nobody is buying or reading them. That's how AI companies are able to buy them for pennies on the dollar, and whatever they don't buy is probably eligible for recycling or burning by the seller/publisher anyway.
It's basically a way to slurp up a few billion tokens for cheap. They're destroying the copies by chopping off the spine and feeding the loose pages into page-fed scanners, which is way less expensive than those non-destructive scanning robots, but this doesn't work on really old books from previous centuries as the paper is different and fragile and will jam your scanner constantly.
What they're looking for is industrially-produced books with low circulation, not because they are culturally valuable but because they contain prose that hasn't yet been digitized and that's what they need for pre-training.