potatoguy

joined 1 week ago
sorted by: new top controversial old
Now even my personal instance is infested by these AI crawlers in c/fuck_ai@lemmy.world
[–] potatoguy@potato-guy.space 1 points 3 hours ago (1 children)

Oh, cool. I'm going to look at it!

Now even my personal instance is infested by these AI crawlers in c/fuck_ai@lemmy.world
[–] potatoguy@potato-guy.space 1 points 3 hours ago* (last edited 3 hours ago) (3 children)

I don't have a cache, but the problem is solved now, i can browse lemmy haha.

Now even my personal instance is infested by these AI crawlers in c/fuck_ai@lemmy.world
[–] potatoguy@potato-guy.space 3 points 5 hours ago (6 children)

They are 1 cpu and 1 gb of ram pods, postgres goes to 100% cpu on 500 requests per minute, after i put the NGINX extension, it reduced to at max 10%. On weaker servers, these bots make hell on earth, not the config.

Now even my personal instance is infested by these AI crawlers in c/fuck_ai@lemmy.world
[–] potatoguy@potato-guy.space 31 points 15 hours ago

Enabled, thanks for the tip!

Now even my personal instance is infested by these AI crawlers in c/fuck_ai@lemmy.world
[–] potatoguy@potato-guy.space 16 points 16 hours ago (1 children)

Yeah, going to install it this week, but the nginx extension seemed to solve the issue.

156
Now even my personal instance is infested by these AI crawlers (potato-guy.space)
submitted 17 hours ago* (last edited 17 hours ago) by potatoguy@potato-guy.space to c/fuck_ai@lemmy.world
28 comments fedilink
 

It's impossible, i got this instance to just see lemmy from my own instance, but no, it was slow as hell the whole week, i got new pods, put postgres on a different pod, pictrs on another, etc.

But it was slow as hell. I didn't know what it was until a few hours before now. 500 GETs in a MINUTE by ClaudeBot and GPTBot, wth is this? why? I blocked the user agents, etc, using a blocking extension on NGINX and now it works.

WHY? So google can say that you should eat glass?

Life is now hell, if before at least someone could upload a website, now even that is painfull.

Sorry for the rant.

4
The Lukka before they were Sea Peoples | Dig. (m.youtube.com)