this post was submitted on 21 Mar 2024
97 points (89.4% liked)

Technology

59312 readers
4683 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
97
Generative AI will eventually poison itself (www.xda-developers.com)
submitted 7 months ago by [email protected] to c/[email protected]
23 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 6 points 7 months ago* (last edited 7 months ago)

No, it won't.

A number of things:

  • When the cited paper came out it was the first looking at this. And even with just 10% of the original data the effects were mitigated.
  • Since, another paper found a mix of synthetic and organic data is the best performing mixture.
  • The quality of the models producing the synthetic data matters a lot.
  • Other research has found huge benefits in training models with synthetic data from SotA models.
  • Models are only getting better, meaning the quality of synthetic data will be improving.

It only leads to collapse if all organic data representing long tails of data variety disappear. Which hopefully throws water on x-risk doomers as AI killing humanity would currently be a murder suicide.