this post was submitted on 06 Dec 2023
34 points (78.3% liked)

Technology

58137 readers
4481 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
all 22 comments
sorted by: hot top controversial new old
[–] [email protected] 32 points 9 months ago (2 children)
[–] [email protected] 6 points 9 months ago* (last edited 9 months ago) (1 children)

consider I thought bard was their answer to chaptgpt..... EDITED - oh it essentially is bard just the version of the backend.

[–] [email protected] 3 points 9 months ago (1 children)

Same. I'm very confused right now. What is Bard then?

[–] [email protected] 3 points 9 months ago

Gemini is the model backing Bard.

[–] [email protected] 20 points 9 months ago* (last edited 9 months ago)

After it was supposedly updated to support helping with code, I asked bard about how to access password protected zips in Go and it made up libraries and gave me a very simple non-functioning example. When asked to describe Octopath Traveler 2, it invented a new main character and setting that isn't in the game or its predecessor or the mobile game. I don't have a lot of faith that Gemini will be better.

[–] [email protected] 15 points 9 months ago (1 children)
[–] [email protected] 3 points 9 months ago (2 children)

How did you you play around with it?

[–] [email protected] 5 points 9 months ago

It's geographically restricted. I had to choose VPN servers in the US to be able to use it, otherwise bard would only load a useless landing page.

[–] [email protected] 4 points 9 months ago

That was the one and only prompt I gave it in that chat. New bard sucks as bad as old bard.

[–] [email protected] 11 points 9 months ago

They still call Google a search company here... So weird. It's an ad company.

[–] [email protected] 5 points 9 months ago (2 children)

Took em long enough.

I wonder if they used ChatGPT to create any of the training data.

[–] [email protected] 4 points 9 months ago (1 children)

The transformer architecture GPT is based on came from Google. I'm sure the delay has more to do with Google trying to mitigate liability issues that arise with large scale general public usage, and letting OpenAI "test the waters" first.

[–] [email protected] 0 points 9 months ago (1 children)

Quite possible. Whatever the case, they apparently saw no pressure to innovate. It implies that tech development is being slowed down by the Big Tech monopolies.

[–] [email protected] 1 points 9 months ago (1 children)

lack of innovation on what exactly? They're all exploring new things if you search for it.

[–] [email protected] 0 points 9 months ago

It just seems that Google should have been able to move faster. Yes, they did publish a lot of important stuff, but seeing the splash that came from Stability and OpenAI, they seem to have done so little with it. What their researchers published was important but I can't help thinking, that a public university would have disseminated such research more openly and widely. Well, I may be wrong. I don't have inside knowledge.

[–] [email protected] 2 points 9 months ago (1 children)

Not likely. They may have tested it as an adversarial feedback tool, but it would be much more accurate and efficient to get the source data rather than paying OpenAI for maybe correct information.

They did, I believe, trick ChatGPT into exposing some of its source data though, but it was only a few hundred MB’s.

[–] [email protected] 1 points 9 months ago* (last edited 9 months ago) (1 children)

For the fine-tuning stage at the end, where you turn it into a chatbot, you need specific training data (eg OpenOrca). People have used ChatGPT to generate such data. Come to think of it, if you use Mechanical Turk, then you almost certainly include text from ChatGPT.

[–] [email protected] 1 points 9 months ago

Yes it could be done that way, and maybe GPT models were used, but calling these API’s isn’t free and there are plenty of open and surely internal models that could be used for that purpose.

[–] [email protected] 3 points 9 months ago

I'm annoyed they had to use the same name as a web protocol.

[–] [email protected] 2 points 9 months ago

Who, exactly, was waiting for this?