this post was submitted on 10 Sep 2023
687 points (95.5% liked)

Technology

59207 readers
2845 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
687
OpenAI confirms that AI writing detectors don’t work (arstechnica.com)
submitted 1 year ago by [email protected] to c/[email protected]
116 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 28 points 1 year ago (6 children)

OpenAI discontinued its AI Classifier, which was an experimental tool designed to detect AI-written text. It had an abysmal 26 percent accuracy rate.

If you ask this thing whether or not some given text is AI generated, and it is only right 26% of the time, then I can think of a real quick way to make it 74% accurate.

[–] [email protected] 4 points 1 year ago (1 children)

it seemed like a really weird decision for OpenAI to have an AI classifier in the first place. their whole business is to generate output that's good enough that it can't be distinguished from what a human might produce, and then they went and made a tool to try and point out where they failed.

[–] [email protected] 2 points 1 year ago

That may have been the goal. Look how good our AI is, even we can't tell if its output is human generated or not.

load more comments (4 replies)