US prosecutors see rising threat of AI-generated child sex abuse imagery

WASHINGTON — US federal prosecutors are stepping up their pursuit of suspects who use artificial intelligence tools to manipulate or create child sex abuse images, as law enforcement fears the technology could spur a flood of illicit material.

The US Justice Department has brought two criminal cases this year against defendants accused of using generative AI systems, which create text or images in response to user prompts, to produce explicit images of children.

"There's more to come," said James Silver, the chief of the Justice Department's Computer Crime and Intellectual Property Section, predicting further similar cases.

"What we're concerned about is the normalisation of this," Silver said in an interview. "AI makes it easier to generate these kinds of images, and the more that are out there, the more normalised this becomes. That's something that we really want to stymie and get in front of."

The rise of generative AI has sparked concerns at the Justice Department that the rapidly advancing technology will be used to carry out cyberattacks, boost the sophistication of cryptocurrency scammers and undermine election security.

Child sex abuse cases mark some of the first times that prosecutors are trying to apply existing US laws to alleged crimes involving AI, and even successful convictions could face appeals as courts weigh how the new technology may alter the legal landscape around child exploitation.

The rise of generative AI has sparked concerns at the Justice Department that the rapidly advancing technology will be used to carry out cyberattacks, boost the sophistication of cryptocurrency scammers and undermine election security.

Child sex abuse cases mark some of the first times that prosecutors are trying to apply existing US laws to alleged crimes involving AI, and even successful convictions could face appeals as courts weigh how the new technology may alter the legal landscape around child exploitation.

That's a fraction of the average of 3 million monthly reports of overall online child exploitation the group received last year.

Untested ground

Cases involving AI-generated sex abuse imagery are likely to tread new legal ground, particularly when an identifiable child is not depicted.

Silver said in those instances, prosecutors can charge obscenity offences when child pornography laws do not apply.

Prosecutors indicted Steven Anderegg, a software engineer from Wisconsin, in May on charges including transferring obscene material. Anderegg is accused of using Stable Diffusion, a popular text-to-image AI model, to generate images of young children engaged in sexually explicit conduct and sharing some of those images with a 15-year-old boy, according to court documents.

Anderegg has pleaded not guilty and is seeking to dismiss the charges by arguing that they violate his rights under the US Constitution, court documents show.

He has been released from custody while awaiting trial. His attorney was not available for comment.

Stability AI, the maker of Stable Diffusion, said the case involved a version of the AI model that was released before the company took over the development of Stable Diffusion. The company said it has made investments to prevent "the misuse of AI for the production of harmful content."

Federal prosecutors also charged a US Army soldier with child pornography offences in part for allegedly using AI chatbots to morph innocent photos of children he knew to generate violent sexual abuse imagery, court documents show.

The defendant, Seth Herrera, pleaded not guilty and has been ordered held in jail to await trial. Herrera's lawyer did not respond to a request for comment.

Legal experts said that while sexually explicit depictions of actual children are covered under child pornography laws, the landscape around obscenity and purely AI-generated imagery is less clear.

The US Supreme Court in 2002 struck down as unconstitutional a federal law that criminalised any depiction, including computer-generated imagery, appearing to show minors engaged in sexual activity.

"These prosecutions will be hard if the government is relying on the moral repulsiveness alone to carry the day," said Jane Bambauer, a law professor at the University of Florida who studies AI and its impact on privacy and law enforcement.

Federal prosecutors have secured convictions in recent years against defendants who possessed sexually explicit images of children that also qualified as obscene under the law.

Advocates are also focusing on preventing AI systems from generating abusive material.

Two nonprofit advocacy groups, Thorn and All Tech Is Human, secured commitments in April from some of the largest players in AI including Alphabet's Google , Amazon.com, Facebook and Instagram parent Meta Platforms, OpenAI and Stability AI to avoid training their models on child sex abuse imagery and to monitor their platforms to prevent its creation and spread.

"I don't want to paint this as a future problem, because it's not. It's happening now," said Rebecca Portnoff, Thorn's vice president of data science.

"As far as whether it's a future problem that will get completely out of control, I still have hope that we can act in this window of opportunity to prevent that."

[[nid:705771]]