this post was submitted on 04 Apr 2025
211 points (96.5% liked)

Technology

68306 readers
4339 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Nucleo's investigation identified accounts with thousands of followers with illegal behavior that Meta's security systems were unable to identify; after contact, the company acknowledged the problem and removed the accounts

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 6 points 23 hours ago (2 children)

Child Sexual Abuse Material is abhorrent because children were literally abused to create it.

AI generated content, though disgusting, is not even remotely on the same level.

The moral panic around AI that leads to implying that these things are the same thing is absurd.

Go after the people filming themselves literally gang raping toddlers, not the people typing forbidden words into an image generator.

Don't dilute the horror of the production CSAM by equating it to fake pictures.

[–] [email protected] 8 points 23 hours ago* (last edited 23 hours ago) (3 children)

Yes at a cursory glance that's true. AI generated images don't involve the abuse of children, that's great. The problem is what the follow-on effects of this is. What's to stop actual child abusers from just photoshopping a 6th finger onto their images and then claiming that it's AI generated?

AI image generation is getting absurdly good now, nearly indistinguishable from actual pictures. By the end of the year I suspect they will be truly indistinguishable. When that happens, how do you tell which images are AI generated and which are real? How do you know who is peddling real CP and who isn't if AI-generated CP is legal?

[–] [email protected] 1 points 11 hours ago* (last edited 11 hours ago)

What's to stop actual child abusers from just photoshopping a 6th finger onto their images and then claiming that it's AI generated?

Aside from the other arguments people have presented, this wrecks one of the largest reasons that people produce CSAM. Pedophiles are insular data hoarders by necessity, because actually creating and procuring it is such a big risk. Every time they go online to find new content, they’re at risk of stumbling into a honeypot. And producing it requires IRL work, and a LOT of risk of being caught/turned in by the victim. They tend to form tight-knit rings, and one of the only reliable ways to get into a ring as an outsider is to provide your own CSAM to the others. CSAM is traded in these rings like baseball cards, where you need fresh content in order to receive fresh content.

The data hoarding side of things is where all of the “cops bust pedophile with 100TB of CSAM” headlines come from; In reality, it was probably like 1TB of videos, (which is a lot, but not unheard of) but was backed up multiple times in multiple places, because losing it would be catastrophic for the CSAM producer; They can’t simply go grab a new blue ray of it. And the cops counted the full size of each backup disk, not just the space that was used.

Intentionally marking your content as AI-generated would ruin the trading value, because nobody will see it as valuable/worth trading for if it’s fake. At best, you won’t get anything for it. At worst, you’d be labeled a cop trying to pass off AI content to gather evidence.

[–] [email protected] 16 points 22 hours ago

What's the follow on effect from making generated images illegal?

Do you want your freedom to be at stake where the question before the Jury is "How old is this image of a person (that doesn't exist?)". "Is this fake person TOO child-like?"

When that happens, how do you tell which images are AI generated and which are real? How do you know who is peddling real CP and who isn't if AI-generated CP is legal?

You won't be able to tell, we can assume that this is a given.

So the real question is:

Who are you trying to arrest and put in jail and how are you going to write that difference into law so that innocent people are not harmed by the justice system?

To me, the evil people are the ones harming actual children. Trying to blur the line between them and people who generate images is a morally confused position.

There's a clear distinction between the two groups and that distinction is that one group is harming people.

[–] [email protected] 10 points 23 hours ago

If pedophiles won't be able to tell what's real and what's AI generated why risk jail to create the real ones?

[–] [email protected] -1 points 20 hours ago* (last edited 20 hours ago) (1 children)

Although that's true, such material can easily be used to groom children which is where I think the real danger lies.

I really wish they had excluded children in the datasets.

You can't really put a stop to it anymore but I don't think it should be something that's normalized and accepted just because there isn't a direct victim anymore. We are also talking about distribution here and not something being done in private at home.

[–] [email protected] -2 points 20 hours ago (2 children)

such material can easily be used to groom children

This literally makes no sense.

[–] [email protected] 5 points 19 hours ago (1 children)

Kids will do things if they see other children doing it in pictures and videos. It's easier to normalize sexual behavior with cp then without.

[–] [email protected] 1 points 16 hours ago (1 children)

This sounds like you're searching really hard for a reason to justify banning it. Pretty tenuous "what if" there.

Like, a dildo could hypothetically be used to sexualize a child. Should we ban dildos?

It's so vague it could apply to anything.

[–] [email protected] -4 points 16 hours ago* (last edited 16 hours ago) (1 children)

Banning the tech, banning generated cp on the internet or banning it at home?

I'm a big advocate of AI and don't personally want any kind of banning or censorship of the tools.

I don't think it should be published on any kind of image sharing sites. I don't hold people publishing it in high regard and I'm not against some kind of consequence. I generally view prison as unproductive though.

At home, I'm not sure. People imo can do what they want behind closed doors. I don't want any kind of surveillance but I don't know how I would react if it got brought up at a trial, as a kind of proof if the allegations have something to do with that theme (child molestation).

I also don't think we need much of a reason to ban it on the web.

[–] [email protected] 6 points 16 hours ago (1 children)

It would probably make me distrust the prosecution, like if they're bringing this up they must not have much to go on. Like every time a black man is shot by police they bring up that he smoked weed.

I guess my main complaint is that it's insane to view it as equivalent to real CP, and it's harmful to waste any resources prosecuting it.

[–] [email protected] 1 points 11 hours ago

That's fair. We can also expect proper moderation from social media sites. I'm okay with a light touch but It shouldn't be floating around if you get what I mean.