this post was submitted on 08 May 2024
599 points (99.0% liked)

Technology

34828 readers
336 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 139 points 6 months ago* (last edited 6 months ago) (2 children)

This is similar to when I heard reddit was doing the API lockdown, I wrote an automation bot over the weekend that self-destructed my subreddit and the entire post history. The bot also automatically downloaded and archived all of the content on my local machine.

It was annoying because at first I couldn't get access to older posts since at the time reddit had changed their API to only show the first X posts (100 or 1,000 or whatever). So I told my bot to delete the posts as it archived them so as I deleted content, reddit had no choice but to populate the page with the older posts.

And that's how I archived my subreddit. Reddit banned me two days later for automation, lol. I did not break any of the reddit or reddit api ToS during this process but I guess I upset someone.

[–] [email protected] 27 points 6 months ago

I don't think I've been banned, but I did a similar thing. I requested all my data from Reddit, then used that list of comment/post IDs to mass-edit them. I think I'm in the clear because I used the official third party API, with an official "app." If you used the private API or instrumented this via the browser, that may be why you were banned.

Anyway, if you or someone else wants their full history, Reddit will give it to you via a data export request.

[–] [email protected] 19 points 6 months ago (2 children)

Unfortunately they still have everything. It's good for the "human" visibility (lack of) but they have the data still

[–] [email protected] 13 points 6 months ago* (last edited 6 months ago)

Oh I know, I just wanted a copy too.

Deleting posts from the user PoV was the only way I could come up with to force the API to show them to me.

load more comments (1 replies)
[–] [email protected] 82 points 6 months ago

I feel like this content craze is going to evaporate soon because all the new content from here forward is sure to be polluted by LLM output already. AI is fast becoming a snake eating its own tail.

That reminds me. I should go update my licenses to spit in the face of AI training companies.

[–] [email protected] 75 points 6 months ago

Stack Overflow just earned a place under Reddit in the hosts block list.

[–] [email protected] 60 points 6 months ago

It's just a matter of time until all your messages on Discord, Twitter etc. are scraped, fed into a model and sold back to you

As if it didn't happen already

[–] [email protected] 44 points 6 months ago (1 children)

I think people would have less issues with AI training if it was non-profit and for the common good. And there are open source AI projects, many in fact. But yeah, these deals by companies like this are sleazy.

[–] [email protected] 21 points 6 months ago (1 children)

OpenAI was literally that until it wasn't

[–] [email protected] 8 points 6 months ago (1 children)

I don't think OpenAI actually released any FOSS code, did they?

[–] [email protected] 43 points 6 months ago (2 children)

StackOverflow: *grabs money on monetizing massive amounts of user-contributed content without consulting or compensating the users in any way*

Users: *try to delete it all to prevent it*

StackOverflow: *your contributions belong to the community, you can't do that*

Pretty fucked-up laws. A lot of lawsuits going on right now against AI companies for similar issues. In this case, StackOverflow is entitled to be compensated for its partnership, and because the answers are all CC BY-SA 3.0, no one can complain. Now, that SA? Whatever.

[–] [email protected] 15 points 6 months ago (7 children)

That SA part needs to be tested in court against the AI models themselves

A lot of this shittiness would probably go away if there was a risk that ingesting certain content would mean you need to release the actual model to the public.

load more comments (7 replies)
[–] [email protected] 42 points 6 months ago (3 children)

Data Rule Numero Uno:

Garbage in, garbage out.

Have fun training your LLM on a big steaming pile of hot garbage. That's 80% of Stack Overflows content.

[–] [email protected] 17 points 6 months ago (1 children)

Mostly "this has been answered in another thread" and "why don't you Google it" comments in my experience.

[–] [email protected] 9 points 6 months ago

Can’t wait until the top answer to every Google search is “just google it”

[–] [email protected] 7 points 6 months ago* (last edited 6 months ago) (1 children)

The other 20% is mostly high quality however, and I'm sure they'd filter out the heavily downvoted crud.

[–] [email protected] 6 points 6 months ago

You say that as if the garbage gets downvoted

load more comments (1 replies)
[–] [email protected] 38 points 6 months ago (3 children)

Good luck with the deleting. It often just means UPDATE comments SET is_deleted = 1 WHERE ID = 666;.

[–] [email protected] 14 points 6 months ago (1 children)

There was similar things done on Reddit during the big exit. I doubt it achieved what people expected it to achieve. Even if they’re not visible externally, I’m sure they can easily access (thereby make deals to license) the data out of their backend / backup; just a matter of how hard they want to try (hint: it’s really not very hard).

[–] [email protected] 15 points 6 months ago (1 children)

Yeah during the reddit exodus, people were recommending to overwrite your comment with garbage before deleting it. This (probably) forces them to restore your comment from backup. But realistically they were always going to harvest the comments stored in backup anyway, so I don't think it caused them any more work.

If anything, this probably just makes reddit's/SO's partnership more valuable because your comments are now exclusive to reddit's/SO's backend, and other companies can't scrape it.

[–] [email protected] 10 points 6 months ago

It was to make the data inaccessible to general people, therefore removing the reason people visit reddit. Even if reddit could still get the data, regular people would be inconvenienced (in theory) and look somewhere else.

load more comments (2 replies)
[–] [email protected] 26 points 6 months ago

Like AI doesn't know how to use the way back machine?

[–] [email protected] 26 points 6 months ago* (last edited 6 months ago) (5 children)

Would be a shame if someone used ChatGPT to generate bad answers and a short script to resubmit them back to Stackoverflow. So awful.

load more comments (5 replies)
[–] [email protected] 26 points 6 months ago* (last edited 6 months ago) (1 children)

There is, I believe, a fundamental misunderstanding as to what exactly a site like Stack Overflow is. It's not a forum; there's no such thing as "your posts." It's more like Wikipedia, as in a collaborative question-and-answer site, or a knowledgebase. Each question and answer can be edited like a mini wiki page. They aren't "yours" any more than the Wikipedia page you created ten years ago is; you contributed it to the commons, so (at least in theory) you don't have the right to take it back.

Whether whatever "Open"AI is doing is right is another question, of course. But, I don't think destroying or poisoning the commons to strike back at it is any helpful either; it feels like "destroying it to save it."

[–] [email protected] 17 points 6 months ago

Fine, but when coding projects undergo licensing changes that the contributors are against, the code author has to remove those contributions and replace them.

[–] [email protected] 25 points 6 months ago (3 children)

Why now? Other people have been profiting off of your Stack Overflow answers for years. This is nothing new.

[–] [email protected] 18 points 6 months ago (3 children)

Those answers were given in good faith under the presumption that they would be read and used by another person. Not used to train something to remove the interactions which motivated the answer in the first place.

load more comments (3 replies)
[–] [email protected] 18 points 6 months ago (1 children)

Simple answer: people vs corporations. A dev or homelabber getting help from you is very different from a company making billions just by mass shoveling your knowledge to the highest bidder.

The reason we need this as a fediverse service is that everyone can take in this knowledge and one corp doesnt have the ability to sell it. Thats what the worth comes from. Someone holding they key to it.

[–] [email protected] 6 points 6 months ago (2 children)

That's not what I mean. When you contribute content to Stack Exchange, it is licensed CC BY-SA. There are websites that scrape this content and rehost it, or at least there used to be. I've had a problem before where all the search results were unanswered Stack Overflow posts or copies of those posts on different sites. Maybe similar to Reddit they restricted access to the data so they could sell it to AI companies.

load more comments (2 replies)
[–] [email protected] 13 points 6 months ago (1 children)

Currently, all answers are properly attributed. But once OpenAI will have trained and sell a “hackerman” persona, do you really think it will answer people’s questions with ”This answer was contributed by i_am_not_a_robot” or will it just sell this as its own answer?

[–] [email protected] 8 points 6 months ago

As a tech, i'm fucking howling because 99% of answers to any given question is already bullshit that ranges from useless to dangerous.

"The machine" can't tell the difference and it's going to be considered authoratitive in its blithe stupidity. hoover up SA all you want, you're just gonna agregate it with bullishit and poison your own well anyway

[–] [email protected] 23 points 6 months ago

Based users

[–] [email protected] 17 points 6 months ago

This feels a little iffy to me. it rings of what happened with reddit.

[–] [email protected] 17 points 6 months ago* (last edited 6 months ago) (15 children)

This is a violation of GDPR, no?

EDIT: user created content is not directly protected under GDPR, only personally identifiable data is pertected under GDPR.

[–] [email protected] 16 points 6 months ago (2 children)

Dunno. GDPR is a Europe only thing, and isn't it only related to how your private data (like name, IP address, phone number) is cared about ?

[–] [email protected] 7 points 6 months ago

Right, I think it only covers personal information: companies can only collect what they need to run their service, users can request to see their data etc. I don't think it applies to comments and posts.

load more comments (1 replies)
load more comments (14 replies)
[–] [email protected] 16 points 6 months ago (1 children)

This isn't really comparable to reddit, since users can just send a request to SO for all the content. Reddit locking down the API meant we lost access to our content.

load more comments (1 replies)
[–] [email protected] 13 points 6 months ago (5 children)

Why delete the answer, why not edit it so that a human can see the answer but for AI its a load of nonsense?

[–] [email protected] 16 points 6 months ago

There's no way that would work either, they can just store the full edit history and auto-curate as needed.

[–] [email protected] 8 points 6 months ago

People did that. Stack overflow reverted the change.

load more comments (2 replies)
[–] [email protected] 8 points 6 months ago

I mean, here is a thought, if an AI tool uses creative commons data, then it's derivatives fall under creative commons. I.e. stop charging for AI tools and people will stop complaining.

[–] [email protected] 7 points 6 months ago (2 children)

So what is the stack overflow replacement?

[–] [email protected] 6 points 6 months ago (1 children)

let's all go back to experts exchange

[–] [email protected] 8 points 6 months ago

Expert sex change?

[–] [email protected] 6 points 6 months ago (1 children)

Does GDPR apply to stackoverflow? Since my data there probably does not identify me as a person?

load more comments (1 replies)
load more comments
view more: next ›