You can either use Cloudflare(proprietary) or anubis (Foss)
this post was submitted on 08 Jun 2025
128 points (97.8% liked)
Fuck AI
3026 readers
850 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 1 year ago
MODERATORS
Cloudflare has pretty good protection against this, but I totally understand not wanting to use Cloudflare
Haha, just wait when you get ddosed by anonymous user agents. I have been there.
I'm talking 40k requests per 5 seconds.
You can enable Private Instance in your admin settings, this will mean only logged in users can see content. This will prevent AI scrapers from slowing down your instance as all they'll see is an empty homepage, so no DB calls. As long as you're on 0.19.11, federation will still work.
Same for Mbin.
Enabled, thanks for the tip!
Use Anubis. That's pretty much the only thing you can do against bots that they have no way of circumventing.
Yeah, going to install it this week, but the nginx extension seemed to solve the issue.
Which extention are you using if I may ask?
At some point they're going to try to evade detection to continue scraping the web. The cat and mouse game continues except now the "pirates" are big tech.
They already do. ("They" meaning AI generally, I don't know about Claude or ChatGPT's bots specifically). There are a number of tools server admins can use to help deal with this.
See also:
these solutions have the side effect of making the bots stay on your site longer and generate more traffic. it's not for everyone.