Technology

59440 readers

4492 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

319

New report: 60% of OpenAI model's responses contain plagiarism (www.axios.com)

submitted 8 months ago by [email protected] to c/[email protected]

45 comments fedilink hide all child comments

A new report from plagiarism detector Copyleaks found that 60% of OpenAI's GPT-3.5 outputs contained some form of plagiarism.

Why it matters: Content creators from authors and songwriters to The New York Times are arguing in court that generative AI trained on copyrighted material ends up spitting out exact copies.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 86 points 8 months ago (18 children)

The individual GPT-3.5 output with the highest similarity score was in computer science (100%), followed by physics (92%), and psychology (88%).

And that’s why this claim is mostly bullshit. These use cases are all sciences, where the correct solution is usually the same or highly similar no matter who writes it. Small snippets of computer code cannot be copyrighted anyway.

Not surprisingly, softer subjects like “English” and “Theatre” rank extremely low on this scale.

[–] [email protected] 33 points 8 months ago (2 children)

Not to mention that a response "containing" plagiarism is a pretty poorly defined criterion. The system being used here is proprietary so we don't even know how it works.

I went and looked at how low theater and such were and it's dramatic:

The lowest similarity scores appeared in theater (0.9%), humanities (2.8%) and English language (5.4%).

[–] [email protected] 9 points 8 months ago

Pun intended?

[–] [email protected] 9 points 8 months ago

Yeah, anyone who has written a thesis knows those tools are bullshit. My handwritten 140 page master's thesis had a similarity index of 11%.

load more comments (15 replies)