Hacker News

1001 readers

242 users here now

Posts from the RSS Feed of HackerNews.

The feed sometimes contains ads and posts that have been removed by the mod team at HN.

founded 6 months ago

MODERATORS

patrick@lemmy.bestiver.se

rssbot@lemmy.bestiver.se

Amazon's AI crawler is making my Git server unstable (xeiaso.net)

submitted 2 months ago by rssbot@lemmy.bestiver.se to c/hackernews@lemmy.bestiver.se

6 comments fedilink hide all child comments

Comments

all 7 comments

sorted by: hot top controversial new old

[–] sp3tr4l@lemmy.zip 5 points 2 months ago

Amazing.

I remember 20 years ago when this kind of bullshit would happen upon your tiny community forum board... but it would be Chinese or Russian bot nets.

God help anyone trying to fight off Amazon.

[–] owl@infosec.pub 1 points 2 months ago

Maybe cloudflare?

[–] originalucifer@moist.catsweat.com 0 points 2 months ago (1 children)

just drop their traffic at the ip level. works for me

[–] Limonene@lemmy.world 6 points 2 months ago* (last edited 2 months ago) (3 children)

From the article:

It's futile to block AI crawler bots because they lie, change their user agent, use residential IP addresses as proxies, and more.

EDIT(2025-01-17 17:50 UTC): ... The bots are still hammering away from a different IP every time. About 10% of the requests do not have the amazonbot user agent ...

[–] brlemworld@lemmy.world 4 points 2 months ago

Could this be considered illegal computer hacking?

[–] originalucifer@moist.catsweat.com 1 points 2 months ago

from my comment

works for me