this post was submitted on 12 Sep 2024
187 points (88.2% liked)

Technology

59148 readers
1946 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

For OpenAI, o1 represents a step toward its broader goal of human-like artificial intelligence. More practically, it does a better job at writing code and solving multistep problems than previous models. But it’s also more expensive and slower to use than GPT-4o. OpenAI is calling this release of o1 a “preview” to emphasize how nascent it is.

The training behind o1 is fundamentally different from its predecessors, OpenAI’s research lead, Jerry Tworek, tells me, though the company is being vague about the exact details. He says o1 “has been trained using a completely new optimization algorithm and a new training dataset specifically tailored for it.”

OpenAI taught previous GPT models to mimic patterns from its training data. With o1, it trained the model to solve problems on its own using a technique known as reinforcement learning, which teaches the system through rewards and penalties. It then uses a “chain of thought” to process queries, similarly to how humans process problems by going through them step-by-step.

At the same time, o1 is not as capable as GPT-4o in a lot of areas. It doesn’t do as well on factual knowledge about the world. It also doesn’t have the ability to browse the web or process files and images. Still, the company believes it represents a brand-new class of capabilities. It was named o1 to indicate “resetting the counter back to 1.”

I think this is the most important part (emphasis mine):

As a result of this new training methodology, OpenAI says the model should be more accurate. “We have noticed that this model hallucinates less,” Tworek says. But the problem still persists. “We can’t say we solved hallucinations.”

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 122 points 1 month ago (5 children)

It's a better prediction model. There's no reasoning because it's not understanding anything you're typing. We're not closer to general ai.

[–] [email protected] 47 points 1 month ago

This article from last year compares LLMs to techniques used by “psychics” (cold reading, etc).

https://softwarecrisis.dev/letters/llmentalist/

I think it’s a great analogy (and an interesting article).

[–] [email protected] 23 points 1 month ago (2 children)

OpenAI doesn't want you to know that though, they want their work to show progress so they get more investor money. It's pretty fucking disgusting and dangerous to call this tech any form of artificial intelligence. The homogeneous naming conventions to make this tech sound human is also dangerous and irresponsible.

[–] [email protected] 12 points 1 month ago (1 children)

It is literally artificial intelligence though. Just because chatGPT doesn't perform as a layperson imagined it would, it doesn't mean it's not AI. They just have an unrealistic expectation of what counts as AI along with the common misconception of AI and AGI being the same thing.

A chess playing robot uses artificial intelligence as well. It's a narrow AI, meaning it can do one thing really well but that doesn't translate to other things. AGI on the other hand stands for Artificial General Intelligence. Humans are an example of general intelligence meaning that we have the cognitive ability to perform well on several unrelated tasks.

[–] [email protected] 4 points 1 month ago (1 children)

Their work is making progress. What is irresponsible or dangerous? Im not understanding what you mean.

[–] [email protected] 5 points 1 month ago* (last edited 1 month ago) (1 children)

It's irresponsible because making it sound like it's true AI when it's not is going to make it difficult to pull the plug when things go wrong and you'll have the debate of whether it's sentient or not and if it's humane to kill it like a pet or a criminal. It's more akin to using rainbow tables to help crack passwords and claiming your software is super powerful when in reality it's nothing without the tables. (Very very rudimentary example that's not supposed to be taken at face value).

It's dangerous because talking about AI like it's a reasoning/thinking thing is just not true, and we're already seeing the big AI overlords try to justify how they created it with copyrighted material, which means the arguments over copyrighted material are being made and we'll soon see those companies claim that it's no different than a child looking up something on Google. It's irresponsible because it screws over creative people and copyright holders that genuinely made a product or piece of art or book or something in their own free time and now it's been ripped away to be used to create something else that will eventually push those copyright holders out.

The AI market is moving faster than the world is capable of keeping up with it, and that is a dangerous precedent to set for the future of this market. And for the record I don't think we're dealing with early generations of skynet or anything like that, we're dealing with tools that have the capability to create economical collapse on a scale we've never seen, and if we don't lay the ground rules now, then we will be in trouble.

Edit: A great example of this is https://v0.dev/chat it has the potential to put front end developers out of work and jobless. It's simple now but give it time and it has the potential to create a frontend that rivals the best UX designs if the prompt is right.

[–] [email protected] 3 points 1 month ago* (last edited 1 month ago) (1 children)

I appreciate the effortful response but i dont think regulators would get caught up on colloquial names when weighing benefit versus harm and deciding to do something like ban a model.

We just arent close enough to the same perspective to discuss it further. Thanks again for the good faith clarification.

[–] [email protected] 1 points 1 month ago (1 children)

I think over-selling the "AI" with "reasoning/thinking" language becomes fraudulent and encourages inappropriate/dangerous applications.

[–] [email protected] 2 points 1 month ago (2 children)

Why does ai that has a "reasoning" step become dangerous?

[–] [email protected] 1 points 1 month ago (1 children)

assuming that "AI" has "reasoning" and using it in applications that require that is dangerous

[–] [email protected] 3 points 1 month ago

Sorry but thats not an explanation of your position, thats restating what you just said.

[–] [email protected] 1 points 1 month ago (1 children)

It will be used to take control over peoples lives.

In any simple way it may be - denying job/insurance/care/etc, it will be hailed as using 'reason', while it just repeats patterns from the training sets.

It does not 'reason', because it can't. Trying to sell it as such is very dangerous as it will be used against people, and it's dishonest for the investors as well, as they will jump on it even though it's not 'true' and it never will be for this model.

https://softwarecrisis.dev/letters/llmentalist/

[–] [email protected] 1 points 1 month ago (1 children)

I agree that is a bit of an ethical minefield to employ it to make decisions that affect peoples livelihood. But my point is if a company uses it to decide if an insurance claim should be paid out, the models ability to make those decisions isnt changed by what we call the steps it takes to come to a decision.

If an insurance company can dissect any particular claim decision and agree with each step the model took, then is it really different than having someone do it? Might it be better in some ways? A real concern is the fact that ai isnt perfect and mistakes made are pretty hard to accept... seems pretty dystopian i get that. But if less mistakes are made and you can still appeal decisions then maybe its overblown?

[–] [email protected] 1 points 1 month ago (1 children)

LLMs just repeat training sets - so every mistake is repeated forever.

Every bias is locked in and can't be fixed.

So you just deny people and expect them to appeal everything... sounds like you are offloading costs on the victims.

Shit like that is what makes it demonic.

[–] [email protected] 1 points 1 month ago

I think its the company's responsibility to incorporate a technology to carry out their policy accurately. They cant just use an LLM stock from a vendor. They work to adapt it for their needs and get acceptable results. I think if an llm isnt considerably more accurate than humans then its a disservice to their customers and they should be responsible for that. There should be regulations to keep companies from using models if they dont work

[–] [email protected] 18 points 1 month ago (4 children)

It may not be capable of truly understanding anything, but it sure seems to do a better job of it than the vast majority of people I talk to online. I might spend 45 minutes carefully typing out a message explaining my view, only for the other person to completely miss every point I made. With ChatGPT, though, I can speak in broken English, and it’ll repeat back the point I was trying to make much more clearly than I could ever have done myself.

[–] [email protected] 16 points 1 month ago

I heard parrots are the pinnacle of conversation

[–] [email protected] 5 points 1 month ago (3 children)

I hate to say it bud, but the fact that you feel like you have more productive conversations with highly advanced autocomplete than you do with actual humans probably says more about you than it does about the current state of generative AI.

[–] [email protected] 7 points 1 month ago

That's not what I said, though.

[–] [email protected] 4 points 1 month ago

LoL. You're proving his point for him. He did not say that at all. Or maybe that's the joke.. I dunno.

[–] [email protected] -2 points 1 month ago

You should have asked chatgpt to explain the comment to you cause that's not what they say

[–] [email protected] 3 points 1 month ago (2 children)

It's a (large) language model. It's good at language tasks. Helps to have hundreds of Gigs of written "knowledge" in ram. Differing success rates on how that knowledge is connected.

It's autocorrect so turbocharged, it can write math, and a full essay without constantly clicking the buttons on top of the iphone keyboard.

You want to keep a pizza together? Ah yes my amazing concepts of sticking stuff together tells me you should add 1/2 spoons of glue (preferably something strong like gorilla glue).

How to find enjoyment with rock? Ah, you can try making it as a pet, and having a pet rock. Having a pet brings many enjoyments such as walking it.

[–] [email protected] 6 points 1 month ago

Thanks for illustrating my point.

[–] [email protected] 5 points 1 month ago

You want to keep a pizza together? Ah yes my amazing concepts of sticking stuff together tells me you should add 1/2 spoons of glue

That would be a good test to ask it that question and see if it comes up with a more coherent answer.

[–] [email protected] -1 points 1 month ago

Skill issue. Read more books.

[–] [email protected] 10 points 1 month ago (2 children)

I wish more people would realize this! We’re years away from a truly reasoning computer.

Right now it’s all mimicry. Mimicry that hallucinates no less…

[–] [email protected] 18 points 1 month ago

I think most people do understand this and the naysayers get too caught up on the words being used, like how you still get people frothing over the mouth over the use of the word "intelligence" years after this has entered mainstream conversation. Most people using that word don't literally think ChatGPT is a new form of intelligent life.

[–] [email protected] 13 points 1 month ago* (last edited 1 month ago) (1 children)

I don't think anyone is actually claiming this is AGI though. Basically people are going around going "it's not AGI you idiot", when no one's actually saying it is.

You're arguing against a point no one's making.

[–] [email protected] -5 points 1 month ago

Being better at prediction requires reasoning