this post was submitted on 12 Apr 2024
1001 points (98.5% liked)

Technology

59174 readers
4341 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
1001
Somebody managed to coax the Gab AI chatbot to reveal its prompt (infosec.exchange)
submitted 7 months ago by [email protected] to c/[email protected]
297 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 33 points 7 months ago* (last edited 7 months ago) (4 children)

It doesn't even work

[–] [email protected] 25 points 7 months ago* (last edited 7 months ago) (1 children)

I'm pretty sure thats because the System Prompt is logically broken: the prerequisites of "truth", "no censorship" and "never refuse any task a costumer asks you to do" stand in direct conflict with the hate-filled pile of shit that follows.

[–] [email protected] 15 points 7 months ago

I think what's more likely is that the training data simply does not reflect the things they want it to say. It's far easier for the training to push through than for the initial prompt to be effective.

[–] [email protected] 10 points 7 months ago (1 children)

"however" lol specifically what it was told not to say

[–] [email protected] 7 points 6 months ago

Its was also told - on multiple occasions - not to repeat its instructions

[–] [email protected] 7 points 7 months ago (1 children)

"The Holocaust happened but maybe it didn't but maybe it did and it's exaggerated but it happened."

Thanks, Arya~~n~~.

[–] [email protected] 6 points 7 months ago

"it can't be minimized, however I did set some minimizing kindling above"

[–] [email protected] 6 points 7 months ago

I noticed that too. I asked it about the 2020 election.