9
what about data scrapers? (programming.dev)
submitted 1 year ago by lucoso@programming.dev to c/meta@programming.dev
7 comments fedilink hide all child comments

reddit and twitter (suposedly) jacked up their API prices because of data scrapers, what could lemmy to do try to stop them?

i dont think we can do anything

you are viewing a single comment's thread
view the rest of the comments
[-] Die4Ever@programming.dev 2 points 1 year ago

I wonder how stuff like this would affect the scalability of the fediverse, I think having 1 instance like you describe would be good, but having many of them could become an issue maybe

[-] philm@programming.dev 3 points 1 year ago

Yeah but this is a general problem that ActivityPub has, it builds on the goodwill of the people/instances.

But I don't think it will be a really big issue, if there are really just a few of these instances (that is the premise though) But it's a good point, when something like this is open source, and anyone could spin it up to kinda DDOS the fediverse...

But when looking at it in more positive light/good will, it could probably also be used as an intermediate cache/index instance for other instances, which may save requests to the original instances.

this post was submitted on 08 Jul 2023
9 points (84.6% liked)

Programming.dev Meta

2365 readers
1 users here now

Welcome to the Programming.Dev meta community!

This is a community for discussing things about programming.dev itself. Things like announcements, site help posts, site questions, etc. are all welcome here.

Links

Credits

founded 1 year ago
MODERATORS
snowe@programming.dev
Ategon@programming.dev