341

A Telegram user who advertises their services on Twitter will create an AI-generated pornographic image of anyone in the world for as little as $10 if users send them pictures of that person. Like many other Telegram communities and users producing nonconsensual AI-generated sexual images, this user creates fake nude images of celebrities, including images of minors in swimsuits, but is particularly notable because it plainly and openly shows one of the most severe harms of generative AI tools: easily creating nonconsensual pornography of ordinary people.

you are viewing a single comment's thread
view the rest of the comments
[-] LadyAutumn@lemmy.blahaj.zone 17 points 9 months ago* (last edited 9 months ago)

They're making pornography of women who are not consenting to it when that is an extremely invasive thing to do that has massive social consequences for women and girls. This could (and almost certainly will) be used on kids too right, this can literally be a tool for the production of child pornography.

Even with regards to adults, do you think this will be used exclusively on public figures? Do you think people aren't taking pictures of their classmates, of their co-workers, of women and girls they personally know and having this done to pictures of them? It's fucking disgusting, and horrifying. Have you ever heard of the correlation between revenge porn and suicide? People literally end their lives when pornographic material of them is made and spread without their knowledge and consent. It's terrifyingly invasive and exploitative. It absolutely can and must be illegal to do this.

[-] cley_faye@lemmy.world 8 points 9 months ago

It absolutely can and must be illegal to do this.

Given that it can be done in a private context and there is absolutely no way to enforce it without looking into random people's computer unless they post it online publicly, you're just asking for a new law to reassure people with no effect. That's useless.

[-] LadyAutumn@lemmy.blahaj.zone -1 points 9 months ago

No, I'm saying make it so that you go to prison for taking pictures of someone and making pornography of them without their consent. Pretty straightforward. If you're found doing it, off to rot in prison with you.

[-] WaxedWookie@lemmy.world -5 points 9 months ago

Strange of you to respond to a comment about the fakes being shared in this way...

Do you have the same prescriptions in relation to someone with a stash of CSAM, and if not, why not?

[-] cley_faye@lemmy.world 10 points 9 months ago

No. Because in one case, someone ran a program on his computer and the output might hurt someone else feelings if they ever find out, and in the other case people/kid were exploited for sexual purpose to begin with and their live torn appart regardless of the diffusion of the stuff?

How is that a hard concept to understand?

[-] WaxedWookie@lemmy.world -1 points 9 months ago

What's hard to understand is why you skipped the question I asked, and answered a different one instead.

The creation of the CSAM is unquestionably far more harmful, but I wasn't talking about the *creation *- I was talking about the possession. The harm of the creation is already done, and whether or not the material exists after that does nothing to undo that harm.

Again, is your prescription the same as it relates to the possession, not generation of CSAM?

[-] LadyAutumn@lemmy.blahaj.zone -2 points 9 months ago* (last edited 9 months ago)

How can you describe your friends, family, co-workers, peers, making and sharing pornography of you, and say that it comes down to hurt feelings??? It's taking someone's personhood, their likeness, their autonomy, their privacy, and reducing them down to a sexual act for which they provide no knowledge or consent. And you think this stays private?? Are you kidding me?? Men have literally been caught making snapchat groups dedicated to sharing their partner's nudes without their consent. You either have no idea what you're talking about or you are intentionally downplaying the seriousness of what this is. Like I said in my original comment, people contemplate and attempt suicide when pornographic content is made and shared of them without their knowledge and consent. This is an incredibly serious discussion.

It is people like you, yes you specifically, that provide the framework by which the sexual abuse of women is justified.

[-] afraid_of_zombies@lemmy.world 1 points 9 months ago

I agree. For any guy here who doesn't care imagine one of your "friends" made an AI porn of you where you have a micropenis and erection problems. I doubt you would be over the moon about it. Or if that doesn't work imagine it was someone you love. Maybe you don't want your grandma's face in a porn.

this post was submitted on 29 Mar 2024
341 points (93.4% liked)

Technology

60090 readers
2738 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS