this post was submitted on 29 Jun 2023
1 points (100.0% liked)

Reddit

14336 readers
1 users here now

founded 6 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Hotzilla@sopuli.xyz 1 points 2 years ago* (last edited 2 years ago)

Web crawling has always worked through raw HTTP/HTML parsing, why create site specific API calls that require authentication and are throttled.

This excuse is pure bullshit.