Technology

58151 readers

3878 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

Generative AI will eventually poison itself (www.xda-developers.com)

submitted 6 months ago by [email protected] to c/[email protected]

23 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 6 points 6 months ago* (last edited 6 months ago)

No, it won't.

A number of things:

When the cited paper came out it was the first looking at this. And even with just 10% of the original data the effects were mitigated.
Since, another paper found a mix of synthetic and organic data is the best performing mixture.
The quality of the models producing the synthetic data matters a lot.
Other research has found huge benefits in training models with synthetic data from SotA models.
Models are only getting better, meaning the quality of synthetic data will be improving.

It only leads to collapse if all organic data representing long tails of data variety disappear. Which hopefully throws water on x-risk doomers as AI killing humanity would currently be a murder suicide.