51
Blocking AI crawlers on the fediverse
(fedia.io)
A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).
If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!
Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy
Also, I've already seen complaints about AI companies scraping everything ignoring
robots.txt
And we would block the obedient and useful crawlers while doing no harm to malicious