I’m afraid Europol is shooting themselves in the foot here.
What should be done is better ways to mark and identify AI-generated content, not a carpet ban and criminalization.
Let whoever happens to crave CSAM (remember: sexuality, however perverted or terrible it is, is not a choice) use the most harmless outlet - otherwise, they may just turn to the real materials, and as continuous investigations suggest, there’s no shortage of supply or demand on that front. If everything is illegal, and some of that is needed anyway, it’s easier to escalate, and that’s dangerous.
As sickening as it may sound to us, these people often need something, or else things are quickly gonna go downhill. Give them their drawings.
What would stop someone from creating a tool that tagged real images as AI generated?
Have at it with drawings that are easily distinguished, but if anything is photorealistic I feel like it needs to be treated as real.
Some form of digital signatures for allowed services?
Sure, it will limit the choice of where to legally generate content, but it should work.
I highly doubt any commercially available service is going to get in on officially generating photorealistic CSAM.
Open-source models exist and can be forked
…and then we’re back at “someone can take that model and tag real images to appear AI-generated.”
You would need a closed-source model run server-side in order to prevent that.
Yep, essentially. But that’s for the hyperrealistic one.
I haven’t read any of this research because, like, the only feelings I have about pedophiles are outright contempt and a small amount of pity for the whole fucking destructive evilness of it all, but I’ve been told having access to drawings and images and whatnot makes people more likely to act on their impulses.
And like. I don’t think images of CSAM in any form, no matter how far removed they are from real people, actually contribute anything worthwhile st all yo the world, so like. I dunno.
Really couldn’t give two squirts of piss of about anything that makes a pedophiles life harder. Human garbage.
You can download the models and compile them yourself, that will be as effective as the US government was at banning encryption.
I hope they don’t have access to a cloud computing provider somewhere, otherwise this is going to be a tough thing to enforce without a great firewall larger than China has.
It will be hilarious to see them attempt it though.
I totally agree with these guys being arrested. I want to get that out of the way first.
But what crime did they commit? They didn’t abuse children…they are AI generated and do not exist. What they did is obviously disgusting and makes me want to punch them in the face repeatedly until it’s flat, but where’s the line here? If they draw pictures of non-existent children is that also a crime?
Does that open artists to the interpretation of the law when it comes to art? Can they be put in prison because they did a professional painting of a child? Like what if they did a painting of their own child in the bath or something? Sure the contents questionable but it’s not exactly predatory. And if you add safeguards for these people could then not the predators just claim artistic expression?
It just seems entirely unenforceable and an entire goddamn can of worms…
I actually do not agree with them being arrested.
While I recognize the issue of identification posed in the article, I hold a strong opinion it should be tackled in another way.
AI-generated CSAM might be a powerful tool to reduce demand for the content featuring real children. If we leave it legal to watch and produce, and keep the actual materials illegal, we can make more pedophiles turn to what is less harmful and impactful - a computer-generated image that was produced with no children being harmed.
By introducing actions against AI-generated materials, they make such materials as illegal as the real thing, and there’s one less reason for an interested party not to go to a CSAM site and watch actual children getting abused, perpetuating the cycle and leading to more real-world victims.
Nah the argument that this could grow “pedophile culture” and even encourage real activities is really not that far fetched and could be even true. Without very convincing studies do you take a chance where real kids could soon suffer? And I mean the studies would have to be really convincing.
The thing is, banning is also a consequential action.
And based on what we know about similar behaviors, having an outlet is likely to be good.
Here, the EU takes an approach of “banning just in case” while also ignoring the potential implications of such bans.
Even in cases when the content is fully artificial and there is no real victim depicted, such as Operation Cumberland, AI-generated CSAM still contributes to the objectification and sexualisation of children.
I get how fucking creepy and downright sickening this all feels, but I’m genuinely surprised that it’s illegal or criminal if there’s no actual children involved.
It mentions sexual extortion and that’s definitely something that should be illegal, same for spreading AI generated explicit stuff about real people without their concent, involving children or adults, but idk about the case mentioned here.
It’s certainly creepy and disgusting
It also seems like we’re half a step away from thought police regulating any thought or expression a person has that those in power do not like
Exactly. If there’s no victim, there’s no crime.
It would depend on the country. In the UK even drawn depictions are illegal. I assume it has to at least be realistic and stick figures don’t count.
It sounds like a very iffy thing to police. Since drawn stuff doesn’t have actual age, how do you determine it? Looks? Wouldn’t be great.
I mean that’s the same thing with AI generated content. It’s all trained on a wide range of real people, how do you know what’s generated isn’t depicting an underage person, which is why laws like this are really dangerous.
Exactly. Any time there’s subjectivity, it’s ripe for abuse.
The law should punish:
- creating images of actual underage people
- creating images of actual non-consenting people of legal age
- knowingly distributing one of the above
Each of those has a clearly identifiable victim. Creating a new work of a fictitious person doesn’t have any clearly identifiable victim.
Don’t make laws to make prosecution easier, make laws to protect actual people from becoming victims or at least punish those who victimize others.
If an underage AI character, is portrayed in say a movie or games, is that wrong? Seems like a very slippery slope.
There have been controversies about that sort of thing.
I know the Oscar-winning movie The Tin Drum as an example. The book by Günter Grass is a very serious, highly celebrated piece of German post-war literature. It takes place around WW2. The protagonist has the mind of an adult in the body of a child. I guess the idea is that he is the other way around from most people?
The movie was banned in Ontario and Oklahoma, for a time. https://en.wikipedia.org/wiki/The_Tin_Drum_(film)#Censorship
With European societies shifting right, I doubt such a movie could be made today, but we aren’t at a point where it would be outright illegal.
Not going to read the article, but I will say that I understand making hyper-realistic fictional CP illegal, because it would make limiting actual CP impossible.
As long as it’s clearly fictional though, let people get off to whatever imaginary stuff they want to. We might find it disgusting, but there are plenty of sexual genres that most people would find disgusting b yet shouldn’t be illegal.
The only way to generate something like that is to teach it something like that from real images.
I don’t think this is actually true. Pretty sure if you feed it naked adults and clothed children it can figure out the rest.
That’s not how these image generators work.
How would it know what an age appropriate penis looks like with our, you know, seeing one.
That’s exactly how they work. According to many articles I’ve seen in the past, one of the most common models used for this purpose is Stable Diffusion. For all we know, this model was never fed with any CSAM materials, but it seems to be good enough for people to get off - which is exactly what matters.
How can it be trained to produce something without human input.
To verify it’s models are indeed correct, some human has to sit and view it.
Will that be you?
How can it be trained to produce something without human input.
It wasn’t trained to produce every specific image it produces. That would make it pointless. It “learns” concepts and then applies them.
No one trained AI on material of Donald Trump sucking on feet, but it can still generate it.
It was able to produce that because enough images of both feet and Donald Trump exist.
How would it know what young genitals look like?
no, it sort of is. considering style transfer models, you could probably just draw or 3d model unknown details and feed it that.
Again, that’s not how image generators work.
You can’t just make up some wishful thinking and assume that’s how it must work.
It takes thousands upon housands of unique photos to make an image generator.
Are you going to draw enough child genetalia to train these generators? Are you actually comfortable doing that task?
i’m not, no. but i’m also well-enough versed in stable diffusion and loras that i know that even a model with no training on a particular topic can be made to produce it with enough tweaking, and if the results are bad you can plug in an extra model trained on at minimum 10-50 images to significantly improve them.
Okay, but my point still stands.
Someone has to make the genitals models to learn from. Some human has to be involved otherwise it wouldn’t just exist.
And if your not willing to get your hands dirty and do it, why would anyone else?
On one hand I don’t think this kind of thing can be consequence free (from a practical standpoint). On the other hand… how old were the subjects? You can’t look at a person to determine their age and someone that looks like a child but is actually adult wouldn’t be charged as a child pornographer. The whole reason age limits are set is to give reasonable assurance the subject is not being exploited or otherwise harmed by the act.
This is a massive grey area and I just hope sentences are proportional to the crime. I could live with this kind of thing being classified as a misdemeanor provided the creator didn’t use underage subjects to train or influence the output.
It’s not a gray area at all. There’s an EU directive on the matter. If an image appears to depict someone under the age of 18 then it’s child porn. It doesn’t matter if any minor was exploited. That’s simply not what these laws are about.
Bear in mind, there are many countries where consenting adults are prosecuted for having sex the wrong way. It’s not so long ago that this was also the case in Europe, and a lot of people explicitly want that back. On the other hand, beating children has a lot of fans in the same demographic. Some people want to actually protect children, but a whole lot of people simply want to prosecute sexual minorities, and the difference shows.
17 year-olds who exchange nude selfies engage in child porn. I know there have been convictions in the US; not sure about Europe. I know that teachers have been prosecuted when minors sought help when their selfies were being passed around in school, because they sent the images in question to the teacher, and that’s possession. In Germany, the majority of suspects in child porn cases are minors. Valuable life lesson for them.
Anyway, what I’m saying is: We need harsher laws and more surveillance to deal with this epidemic of child porn. Only a creep would defend child porn and I am not a creep.
It’s not a gray area at all. There’s an EU directive on the matter. If an image appears to depict someone under the age of 18 then it’s child porn.
So a person that is 18 years old, depicted in the nude, is still a child pornographer if they don’t look their age? This gives judges and prosecutors too much leeway and I could guarantee there are right-wing judges that would charge a 25yo because it could believed they were 17.
In Germany, the majority of suspects in child porn cases are minors. Valuable life lesson for them.
Is it though? I don’t know about the penalties in Germany but in the US a 17yo that takes a nude selfie is likely to be put on a sex offender list for life and have their freedom significantly limited. I’m not against penalties, but they should be proportional to the harm. A day in court followed by a fair amount of community service should be enough of an embarrassment to deter them, not jail.
In Germany, if 14-18yolds make nude selfies then nothing happens, if they share it with their intimate partner(s) then neither, if someone distributes (that’s the key word) the pictures on the schoolyard then the law is getting involved. Under 14yolds technically works out similar just that the criminal law won’t get involved because under 14yolds can’t commit crimes, that’s all child protective services jurisdiction which will intervene as necessary. The general advise to kids given by schools is “just don’t, it’s not worth the possible headache”. It’s a bullet point in biology (sex ed) and/or social studies (media competency), you’d have to dig into state curricula.
Not sure where that “majority of cases” thing comes from. It might very well be true because when nudes leak on the schoolyard you suddenly have a whole school’s worth of suspects many of which (people who deleted) will not be followed up on and another significant portion (didn’t send on) might have to write an essay in exchange for terminating proceedings. Yet another reason why you should never rely on police statistics. Ten people in an elevator, one farts, ten suspects.
We do have a general criminal register but it’s not public. Employers generally are not allowed to demand certificates of good conduct unless there’s very good reason (say, kindergarten teachers) and your neighbours definitely can’t.
Sounds like some actual common sense was applied to German law. Good to hear.
There’s not an epidemic of child porn.
There’s an epidemic of governments wanting greater surveillance powers over the Internet and it is framed as being used to “fight child porn”.
So you’re going to hear about every single case and conviction until your perception is that there is an epidemic of child porn.
“You can’t possibly oppose these privacy destroying laws, after all you’re not on the side of child porn are you?”
Same with misinformation. Where anything they disagree with, in good faith or not, is misinformation.