this post was submitted on 21 Feb 2024
289 points (95.0% liked)

Technology

59174 readers
2122 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

ChatGPT has meltdown and starts sending alarming messages to users::AI system has started speaking nonsense, talking Spanglish without prompting, and worrying users by suggesting it is in the room with them

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 11 points 8 months ago* (last edited 8 months ago) (1 children)

What is intelligence?

Even if we don't know what it is with certainty, it's valid to say that something isn't intelligence. For example, a rock isn't intelligent. I think everyone would agree with that.

Despite that, LLMs are starting to blur the lines and making us wonder if what matters of intelligence is really the process or the result.

A LLM will give you much better results in many areas that are currently used to evaluate human intelligence.

For me, humans are a black box. I give them inputs and they give me outputs. They receive inputs from reality and they generate outputs. I'm not aware of the "intelligent" process of other humans. How can I tell they are intelligent if the only perception I have are their inputs and outputs? Maybe all we care about are the outputs and not the process.

If there was a LLM capable of simulating a close friend of yours perfectly, would you say the LLM is not intelligent? Would it matter?

[–] [email protected] 3 points 8 months ago (1 children)

the ability to acquire and apply knowledge and skills

[–] [email protected] 8 points 8 months ago* (last edited 8 months ago) (1 children)

Things we know so far:

  • Humans can train LLMs with new data, which means they can acquire knowledge.

  • LLMs have been proven to apply knowledge, they are acing examns that most humans wouldn't dream of even understanding.

  • We know multi-modal is possible, which means these models can acquire skills.

  • We already saw that these skills can be applied. If it wasn't possible to apply their outputs, we wouldn't use them.

  • We have seen models learn and generate strategies that humans didn't even conceive. We've seen them solve problems that were unsolvable to human intelligence.

... What's missing here in that definition of intelligence? The only thing missing is our willingness to create a system that can train and update itself, which is possible.

[–] [email protected] -2 points 8 months ago* (last edited 8 months ago) (1 children)

Can a LLM learn to build a house and then actually do it?

LLMs are proven to be wrong about a lot of things. So I would argue these aren’t “skills” and they aren’t capable of acting on those “skills” effectively.

At least with human intelligence you can be wrong and understand quickly that you are wrong. LLMs have no clue if they are right or not.

There is a big difference between actual skill and just a predictive model based on statistics.

[–] [email protected] 8 points 8 months ago* (last edited 8 months ago) (1 children)

Is an octopus intelligent? Can an octopus build an airplane?

Why do you expect these models to have human skills if they are not humans?

How can they build a house if they don't even have vision or a physical body? Can a paralized human that can only hear and speak build a house? Is that human intelligent?

This is clearly not human intelligence, it clearly lacks human skills. Does it mean it isn't intelligent and it has no skills?

[–] [email protected] -3 points 8 months ago* (last edited 8 months ago) (2 children)

Exactly. They are just “models”. There is nothing intelligent about them.

Yes octopus are very intelligent. They can think themselves out of a box without relying on curated data to train them.

Logic, reasoning, and deduction. LLMs have zero ability to reject data based on their understanding of reality. Big diff.

[–] [email protected] 5 points 8 months ago* (last edited 8 months ago)

You keep asking questions like "can a model build a house" but keep ignoring questions like "can an octopus build a house". Then asking "can a model learn in seconds how to escape from a complex enclosure" and then ignoring "can a newborn human baby do that?"

Can an octopus write a poem? Can a baby write an essay? Can an adult human speak every human language, including fictional languages?

Just because it isn't as intelligent as a human doesn't mean this isn't some type if intelligence.

Go and check what we call AI in videogames. Do you think that's a simulated human? Go see what we've been calling AI in chess. Is that a simulated human being playing chess? No.

We've been calling Artificial intelligence things that are waaaaaay dumber than GPTs for decades. Even in the academia. Suddenly a group of people decided "artificial intelligence must be equal to human intelligence". Nope.

Intelligence doesn't need to be the same type of human intelligence.

[–] [email protected] 2 points 8 months ago

LLMs have zero ability to reject data based on their understanding of reality.

Me:

I just found a proof that 2+2=5!

ChatGPT:

The statement "2 + 2 = 5" is a classic example of a mathematical fallacy or incorrect reasoning, often used for humorous or illustrative purposes. In standard arithmetic, of course, 2 + 2 = 4. Proofs claiming to show otherwise rely on some form of invalid manipulation of algebraic properties or deliberate arithmetic mistakes.

A common "proof" of 2 + 2 = 5 might go something like this:

  1. Start with an incorrect assumption or manipulate the algebraic steps in a way that hides a division by zero or another illegal operation.
  2. Through these manipulations, arrive at the conclusion that 2 + 2 = 5.

However, each step of a valid mathematical proof must adhere strictly to the rules and properties of mathematics. Any proof leading to 2 + 2 = 5 will contain an error or a misapplication of those rules.

If you have a specific "proof" in mind, I can help identify the error in it.