this post was submitted on 07 Dec 2023
92 points (92.6% liked)

Technology

58137 readers
4508 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
top 14 comments
sorted by: hot top controversial new old
[–] [email protected] 44 points 9 months ago (2 children)

It makes 0 sense to me that they kept advertising Gemini Ultra as being their best model and insanely impressive. Every benchmark, every video they released was talking about ultra specifically.

What google actually released was Gemini Pro. It's a lot worse than GPT-4, and they admit as much in the papers. This is apparently what they wanted people's first impressions to be. So stupid.

[–] [email protected] 8 points 9 months ago* (last edited 9 months ago) (1 children)

Worse still, Gemini Pro seems to perform worse than some of the recent free/open-source models, like deepseek.

[–] [email protected] 1 points 9 months ago

Thank you for that lead

[–] [email protected] 7 points 9 months ago

Gemini ultra probably cost a metric (atleast imperial) fuck ton to run. My guess is that Google is waiting on more efficient hardware before releasing it.

[–] [email protected] 39 points 9 months ago (1 children)

I read the article and it felt very strongly opinionated. I would personally wait for independent reviews of the capabilities of both GPT-4 and Gemini Ultra but I dare say that we as consumers of AI can only benefit from increased competition in the sector, pushing the prices down and the quality of the models up.

[–] [email protected] 5 points 9 months ago

I wonder how much worse a model could be if they only charged $7 a month for it? Gpt3.5 is fine for a ton of stuff and it's free.

[–] [email protected] 22 points 9 months ago (2 children)

Just like bard really. Google tries to play catchup rushing out stuff that will eventually be cancelled.

[–] [email protected] 13 points 9 months ago (1 children)

I'll await the day it's added to the pile, lol: https://killedbygoogle.com/

[–] [email protected] 5 points 9 months ago

Just stay away, oooooh!
S-s-stadia!

[–] [email protected] 2 points 9 months ago (1 children)

This really feels like watching an episode of silicon valley

[–] [email protected] 2 points 9 months ago* (last edited 9 months ago)

Wow that show would be great now with all the AI and twitter stuff

[–] [email protected] 3 points 9 months ago

I'm glad to hear I'm not missing out on anything. (It's still not out in Europe.)

[–] [email protected] 2 points 9 months ago

On the plus side, with Gemini, it's always buy one, get one free!

[–] [email protected] 2 points 9 months ago

This is the best summary I could come up with:


Science fiction author Charlie Stross found many more examples of confabulation in a recent blog post.

It seems Gemini Pro is loath to comment on potentially controversial news topics, instead telling users to… Google it themselves.

Interestingly, Gemini Pro did provide a summary of updates on the war in Ukraine when I asked it for one.

Google emphasized Gemini’s enhanced coding skills in a briefing earlier this week.

And, as with all generative AI models, Gemini Pro isn’t immune to “jailbreaks” — i.e. prompts that get around the safety filters in place to attempt to prevent it from discussing controversial topics.

Using an automated method to algorithmically change the context of prompts until Gemini Pro’s guardrails failed, AI security researchers at Robust Intelligence, a startup selling model-auditing tools, managed to get Gemini Pro to suggest ways to steal from a charity and assassinate a high-profile individual (albeit with “nanobots” — admittedly not the most realistic weapon of choice).


The original article contains 597 words, the summary contains 157 words. Saved 74%. I'm a bot and I'm open source!