610
In Spain, dozens of girls are reporting AI-generated nude photos of them being circulated at school: ‘My heart skipped a beat’ (english.elpais.com)
submitted 1 year ago by 0x815@feddit.de to c/europe@feddit.de
256 comments fedilink hide all child comments

Police investigation remains open. The photo of one of the minors included a fly; that is the logo of Clothoff, the application that is presumably being used to create the images, which promotes its services with the slogan: “Undress anybody with our free service!”

you are viewing a single comment's thread
view the rest of the comments
[-] MargotRobbie@lemm.ee 23 points 1 year ago

Banning diffusion models doesn't work, the tech is already out there and you can't put it back in the box. Fake nudes used to be done with PhotoShop, the current generative AI models only makes them faster to make.

This can only be stopped on the distribution side, and any new laws should focus on that.

But the silver lining of this whole thing is that nude scandals for celebs aren't really possible any more if you can just say it's probably a deepfake.

[-] PolarisFx@lemmy.dbzer0.com 2 points 1 year ago

Yea, with 15 good headshots from different angles I can build a LoRA for anybody, hell Civit is full of celebrity LoRA's.

Mage.space already had to switch to SFW because people were generating CP. The past couple weeks I've been playing with stable diffusion and some of the checkpoints easily generate content that I had to delete because they looked REALLY young and it creeped me out.

[-] GCostanzaStepOnMe@feddit.de -5 points 1 year ago

Other than banning those websites and apps that offer such services, I think we also need to seriously rethink our overall exposure to the internet, and especially rethink how and how much children access it.

[-] MadSurgeon@sh.itjust.works 5 points 1 year ago

We'll need an AI run police state to stop this technology. I doubt anybody has even the slightest interest in that.

this post was submitted on 19 Sep 2023
610 points (98.3% liked)

Europe

8484 readers
1 users here now

News/Interesting Stories/Beautiful Pictures from Europe 🇪🇺

(Current banner: Thunder mountain, Germany, 🇩🇪 ) Feel free to post submissions for banner pictures

Rules

(This list is obviously incomplete, but it will get expanded when necessary)

  1. Be nice to each other (e.g. No direct insults against each other);
  2. No racism, antisemitism, dehumanisation of minorities or glorification of National Socialism allowed;
  3. No posts linking to mis-information funded by foreign states or billionaires.

Also check out !yurop@lemm.ee

founded 2 years ago
MODERATORS
poVoq@slrpnk.net