Technology

59390 readers

2560 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

1101

CEO of Google Says It Has No Solution for Its AI Providing Wildly Incorrect Information (futurism.com)

submitted 5 months ago by [email protected] to c/[email protected]

447 comments fedilink hide all child comments

You know how Google's new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won't slide off (pssst...please don't do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 18 points 5 months ago (10 children)

no, the truth is it's impossible even then. If the result involves randomness at its most fundamental level, then it's not reliable whatever you do.

[–] [email protected] -3 points 5 months ago* (last edited 5 months ago) (9 children)

Sure, the AI is never going to understand what it's doing or why, but training it on better datasets certain WILL improve the results.

Garbage in, garbage out.

[–] [email protected] 4 points 5 months ago (5 children)

The problem is that given the way they combine things is determine by probability, even training it with the greatest bestest of data, the LLM is still going to halucinate because it's combining multiple sources word by word (roughly) guided only by probabilities derived from language, not logic.

[–] [email protected] 1 points 5 months ago (1 children)

Yes, I understand that. But I'm fairly certain the quality of the data will still have a massive influence over how much and how egregiously that happens.

Basically, what I'm saying is, training your AI on a corpus on shitposts instead of factual information seems like a good way to increase the frequency and magnitude of such hallucinations.

[–] [email protected] 2 points 5 months ago (1 children)

Yeah, true.

If you train you LLM on exclusivelly Nazi literature (to pick a wild example) don't expect it to by chance end up making points similar to Marx's Das Kapital.

(Personally I think what might be really funny - in the sense of laughter inducing - would be to purposefull train an LLM exclusivelly on a specific kind of weird material).

[–] [email protected] 3 points 5 months ago (2 children)

Yeah, I mean that’s basically what GPT4Chan did, which someone else already mentioned ITT.

Basically, this guy took a dataset of several gigabytes worth of archived posts from /pol/ and trained a model on that, then hooked it up to a chatbot and let it loose on the board. You can see the results in this video.

[–] [email protected] 2 points 5 months ago

That was hilarious!

Thanks for the link.

[–] [email protected] 1 points 5 months ago

Here is an alternative Piped link(s):

in this video

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source; check me out at GitHub.

load more comments (3 replies)

load more comments (6 replies)