this post was submitted on 11 Sep 2025
125 points (100.0% liked)
Fuck AI
4024 readers
380 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
That's pretty sweet but just be aware a lot of bots are bad actors and don't advertise a proper user agent, so you have to also block by ips. Blocking all alibaba server ips is a good start.
This is an nginx reverse proxy configuration. It's not passive, like robots.txt, but they probably named it like thatin solidarity with the intent of robots.txt. You're on-point about Alibaba though, which I'm sure could be somewhat easily added to this nginx blocking strategy. Anubis is still probably a better solution, since it doesn't have that limitation of having LLM bots pass a user-agent.