598
submitted 6 months ago by lemmyreader@lemmy.ml to c/technology@lemmy.ml
top 50 comments
sorted by: hot top controversial new old
[-] stembolts@programming.dev 139 points 6 months ago* (last edited 6 months ago)

This is similar to when I heard reddit was doing the API lockdown, I wrote an automation bot over the weekend that self-destructed my subreddit and the entire post history. The bot also automatically downloaded and archived all of the content on my local machine.

It was annoying because at first I couldn't get access to older posts since at the time reddit had changed their API to only show the first X posts (100 or 1,000 or whatever). So I told my bot to delete the posts as it archived them so as I deleted content, reddit had no choice but to populate the page with the older posts.

And that's how I archived my subreddit. Reddit banned me two days later for automation, lol. I did not break any of the reddit or reddit api ToS during this process but I guess I upset someone.

[-] ubergeek77@lemmy.ubergeek77.chat 27 points 6 months ago

I don't think I've been banned, but I did a similar thing. I requested all my data from Reddit, then used that list of comment/post IDs to mass-edit them. I think I'm in the clear because I used the official third party API, with an official "app." If you used the private API or instrumented this via the browser, that may be why you were banned.

Anyway, if you or someone else wants their full history, Reddit will give it to you via a data export request.

[-] GBU_28@lemm.ee 19 points 6 months ago

Unfortunately they still have everything. It's good for the "human" visibility (lack of) but they have the data still

[-] stembolts@programming.dev 13 points 6 months ago* (last edited 6 months ago)

Oh I know, I just wanted a copy too.

Deleting posts from the user PoV was the only way I could come up with to force the API to show them to me.

load more comments (1 replies)
[-] henfredemars@infosec.pub 82 points 6 months ago

I feel like this content craze is going to evaporate soon because all the new content from here forward is sure to be polluted by LLM output already. AI is fast becoming a snake eating its own tail.

That reminds me. I should go update my licenses to spit in the face of AI training companies.

[-] CaptObvious@literature.cafe 75 points 6 months ago

Stack Overflow just earned a place under Reddit in the hosts block list.

[-] pe1uca@lemmy.pe1uca.dev 60 points 6 months ago

It's just a matter of time until all your messages on Discord, Twitter etc. are scraped, fed into a model and sold back to you

As if it didn't happen already

[-] darkphotonstudio@beehaw.org 44 points 6 months ago

I think people would have less issues with AI training if it was non-profit and for the common good. And there are open source AI projects, many in fact. But yeah, these deals by companies like this are sleazy.

[-] NeatNit@discuss.tchncs.de 21 points 6 months ago

OpenAI was literally that until it wasn't

[-] darkphotonstudio@beehaw.org 8 points 6 months ago

I don't think OpenAI actually released any FOSS code, did they?

[-] hagar@lemmy.ml 43 points 6 months ago

StackOverflow: *grabs money on monetizing massive amounts of user-contributed content without consulting or compensating the users in any way*

Users: *try to delete it all to prevent it*

StackOverflow: *your contributions belong to the community, you can't do that*

Pretty fucked-up laws. A lot of lawsuits going on right now against AI companies for similar issues. In this case, StackOverflow is entitled to be compensated for its partnership, and because the answers are all CC BY-SA 3.0, no one can complain. Now, that SA? Whatever.

[-] 9point6@lemmy.world 15 points 6 months ago

That SA part needs to be tested in court against the AI models themselves

A lot of this shittiness would probably go away if there was a risk that ingesting certain content would mean you need to release the actual model to the public.

load more comments (7 replies)
[-] jubilationtcornpone@sh.itjust.works 42 points 6 months ago

Data Rule Numero Uno:

Garbage in, garbage out.

Have fun training your LLM on a big steaming pile of hot garbage. That's 80% of Stack Overflows content.

[-] harrys_balzac@lemmy.dbzer0.com 17 points 6 months ago

Mostly "this has been answered in another thread" and "why don't you Google it" comments in my experience.

[-] DarkDarkHouse@lemmy.sdf.org 9 points 6 months ago

Can’t wait until the top answer to every Google search is “just google it”

[-] LostXOR@fedia.io 7 points 6 months ago* (last edited 6 months ago)

The other 20% is mostly high quality however, and I'm sure they'd filter out the heavily downvoted crud.

[-] mnemonicmonkeys@sh.itjust.works 6 points 6 months ago

You say that as if the garbage gets downvoted

[-] mnemonicmonkeys@sh.itjust.works 6 points 6 months ago

One time I was went on there to figure out an issue in Arduino. The answer one guy gave was "I don't know how to do this in Arduino, here's how you do this in Java". Not only the the mods prevent any other answers from being posted, I tried the guy's suggestion in Java and it didn't even work

[-] davel@lemmy.ml 38 points 6 months ago

Good luck with the deleting. It often just means UPDATE comments SET is_deleted = 1 WHERE ID = 666;.

[-] chiisana@lemmy.chiisana.net 14 points 6 months ago

There was similar things done on Reddit during the big exit. I doubt it achieved what people expected it to achieve. Even if they’re not visible externally, I’m sure they can easily access (thereby make deals to license) the data out of their backend / backup; just a matter of how hard they want to try (hint: it’s really not very hard).

[-] duncesplayed@lemmy.one 15 points 6 months ago

Yeah during the reddit exodus, people were recommending to overwrite your comment with garbage before deleting it. This (probably) forces them to restore your comment from backup. But realistically they were always going to harvest the comments stored in backup anyway, so I don't think it caused them any more work.

If anything, this probably just makes reddit's/SO's partnership more valuable because your comments are now exclusive to reddit's/SO's backend, and other companies can't scrape it.

[-] Lemongrab@lemmy.one 10 points 6 months ago

It was to make the data inaccessible to general people, therefore removing the reason people visit reddit. Even if reddit could still get the data, regular people would be inconvenienced (in theory) and look somewhere else.

load more comments (2 replies)
[-] beyond@linkage.ds8.zone 26 points 6 months ago* (last edited 6 months ago)

There is, I believe, a fundamental misunderstanding as to what exactly a site like Stack Overflow is. It's not a forum; there's no such thing as "your posts." It's more like Wikipedia, as in a collaborative question-and-answer site, or a knowledgebase. Each question and answer can be edited like a mini wiki page. They aren't "yours" any more than the Wikipedia page you created ten years ago is; you contributed it to the commons, so (at least in theory) you don't have the right to take it back.

Whether whatever "Open"AI is doing is right is another question, of course. But, I don't think destroying or poisoning the commons to strike back at it is any helpful either; it feels like "destroying it to save it."

[-] tetris11@lemmy.ml 17 points 6 months ago

Fine, but when coding projects undergo licensing changes that the contributors are against, the code author has to remove those contributions and replace them.

[-] delirious_owl@discuss.online 26 points 6 months ago

Like AI doesn't know how to use the way back machine?

[-] i_am_not_a_robot@discuss.tchncs.de 25 points 6 months ago

Why now? Other people have been profiting off of your Stack Overflow answers for years. This is nothing new.

[-] haui_lemmy@lemmy.giftedmc.com 18 points 6 months ago

Simple answer: people vs corporations. A dev or homelabber getting help from you is very different from a company making billions just by mass shoveling your knowledge to the highest bidder.

The reason we need this as a fediverse service is that everyone can take in this knowledge and one corp doesnt have the ability to sell it. Thats what the worth comes from. Someone holding they key to it.

[-] i_am_not_a_robot@discuss.tchncs.de 6 points 6 months ago

That's not what I mean. When you contribute content to Stack Exchange, it is licensed CC BY-SA. There are websites that scrape this content and rehost it, or at least there used to be. I've had a problem before where all the search results were unanswered Stack Overflow posts or copies of those posts on different sites. Maybe similar to Reddit they restricted access to the data so they could sell it to AI companies.

load more comments (2 replies)
[-] wuphysics87@lemmy.ml 18 points 6 months ago

Those answers were given in good faith under the presumption that they would be read and used by another person. Not used to train something to remove the interactions which motivated the answer in the first place.

load more comments (3 replies)
[-] mbirth@lemmy.mbirth.uk 13 points 6 months ago

Currently, all answers are properly attributed. But once OpenAI will have trained and sell a “hackerman” persona, do you really think it will answer people’s questions with ”This answer was contributed by i_am_not_a_robot” or will it just sell this as its own answer?

[-] Taleya@aussie.zone 8 points 6 months ago

As a tech, i'm fucking howling because 99% of answers to any given question is already bullshit that ranges from useless to dangerous.

"The machine" can't tell the difference and it's going to be considered authoratitive in its blithe stupidity. hoover up SA all you want, you're just gonna agregate it with bullishit and poison your own well anyway

[-] scottmeme@sh.itjust.works 23 points 6 months ago

Based users

[-] baseless_discourse@mander.xyz 17 points 6 months ago* (last edited 6 months ago)

This is a violation of GDPR, no?

EDIT: user created content is not directly protected under GDPR, only personally identifiable data is pertected under GDPR.

[-] lemmyreader@lemmy.ml 16 points 6 months ago

Dunno. GDPR is a Europe only thing, and isn't it only related to how your private data (like name, IP address, phone number) is cared about ?

[-] AccountMaker@slrpnk.net 7 points 6 months ago

Right, I think it only covers personal information: companies can only collect what they need to run their service, users can request to see their data etc. I don't think it applies to comments and posts.

load more comments (1 replies)
load more comments (14 replies)
[-] fluxc0@lemmy.world 17 points 6 months ago

This feels a little iffy to me. it rings of what happened with reddit.

[-] delirious_owl@discuss.online 16 points 6 months ago

This isn't really comparable to reddit, since users can just send a request to SO for all the content. Reddit locking down the API meant we lost access to our content.

load more comments (1 replies)
[-] mhzawadi@lemmy.horwood.cloud 13 points 6 months ago

Why delete the answer, why not edit it so that a human can see the answer but for AI its a load of nonsense?

[-] chicken@lemmy.dbzer0.com 16 points 6 months ago

There's no way that would work either, they can just store the full edit history and auto-curate as needed.

[-] gjoel@programming.dev 8 points 6 months ago

People did that. Stack overflow reverted the change.

load more comments (2 replies)
[-] HexesofVexes@lemmy.world 8 points 6 months ago

I mean, here is a thought, if an AI tool uses creative commons data, then it's derivatives fall under creative commons. I.e. stop charging for AI tools and people will stop complaining.

[-] Modern_medicine_isnt@lemmy.world 7 points 6 months ago

So what is the stack overflow replacement?

[-] Sibbo@sopuli.xyz 6 points 6 months ago

Does GDPR apply to stackoverflow? Since my data there probably does not identify me as a person?

load more comments (1 replies)
load more comments
view more: next ›
this post was submitted on 08 May 2024
598 points (99.0% liked)

Technology

34805 readers
215 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS