this post was submitted on 05 Feb 2024
667 points (87.9% liked)

Memes

45666 readers
944 users here now

Rules:

  1. Be civil and nice.
  2. Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.

founded 5 years ago
MODERATORS
 

I think AI is neat.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 3 points 9 months ago (1 children)

LLMs don't "learn" they literally don't have the capacity to "learn". We train them on an insane amount of text and then the LLMs job is to produce output that looks like that text. That's why when you attempt to correct it nothing happens. It can't learn, it doesn't have the capacity to.

Humans aren't "word guessing machines". Humans produce language with intent and meaning. This is why you and I can communicate. We use language to represent things. When I say "Tree" you know what that is because it's the word we use to describe an object we all know about. LLMs don't know what a tree is. They can use "tree" in a sentence correctly but they don't know what it means. They can even translate it to another language but they still don't know what "tree" means. What they know is generating text that looks like what they were trained on.

Here's a well made video by Kyle Hill that will teach you lot better than I could

[โ€“] [email protected] 1 points 9 months ago

Here is an alternative Piped link(s):

Here's a well made video by Kyle Hill

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source; check me out at GitHub.