341
you are viewing a single comment's thread
view the rest of the comments
[-] terminhell@lemmy.dbzer0.com 81 points 8 months ago

Can we get a list of companies NOT doing this? I'd assume it's going to be much shorter.

[-] IllNess@infosec.pub 41 points 8 months ago

All these AI and machine learning companies are taking content directly from websites and ignoring robot.txt files.

If your content is able to be crawled, even without being listed on search engines, I don't think it really matters.

[-] T156@lemmy.world 8 points 8 months ago

It might help proof an AI company against legal issues that might be brought about by their using the content. If they're ever sued by Automattic, then they can just point to the deal and say that they bought the data from them. There's much less ambiguity.

[-] IllNess@infosec.pub 3 points 8 months ago

You are correct, about the legal stuff. These companies are being sued all the time.

Doing this deal also makes processing the data a lot easier. Being handed a big ass database would be a lot easier than crawling for content.

What I posted was about how they operate. These companies showed time and time again that they don't really care what data they are taking or from whom. They will even take their own AI or machine learning content and put it in their own system.

this post was submitted on 28 Feb 2024
341 points (98.0% liked)

Technology

59374 readers
3943 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS