this post was submitted on 29 Nov 2023
435 points (97.4% liked)

Technology

59207 readers
3702 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

ChatGPT is full of sensitive private information and spits out verbatim text from CNN, Goodreads, WordPress blogs, fandom wikis, Terms of Service agreements, Stack Overflow source code, Wikipedia pages, news blogs, random internet comments, and much more.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 5 points 11 months ago* (last edited 11 months ago) (1 children)

Yes.

Just because they're in a neural network and not ASCII or unicode doesn't mean they're not stored. It's even more apt a concept since apparently those works can be retrieved fairly easily, even if the references to them are hard to isolate. It seems ChatGPT is storing eidetic copies of data, which would imply what other people have said in this thread, that it is overfitting itself to the data and not learning truly generalisable language.

[–] [email protected] 2 points 11 months ago (1 children)

The claim is that it contains entire copies of the book. It does not. AI memory is like our memory, we do not remember books word to word.

[–] [email protected] 6 points 11 months ago* (last edited 11 months ago) (1 children)

They are spitting out, as in the quote above, "verbatim text", as in, word for word. That is copyrightable.

And that's not what you said. You said it has no memory. That's clearly wrong.

[–] [email protected] 1 points 11 months ago

It’s only under copyright if it’s a significant portion of the work. Single sentences are not enough, unless it’s a short poem.