Child abuse images removed from AI image-generator training source, researchers say

Artificial intelligence researchers said Friday that they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a dataset used to train popular AI image-generator tools

ByMATT O’BRIEN AP technology writer

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a dataset used to train popular AI image-generator tools.

The LAION research dataset is a huge index of online images and captions that’s been a source for leading AI image-makers such as Stable Diffusion and Midjourney.

But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children.

That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up dataset for future AI research.

Stanford researcher David Thiel, author of the December report, commended LAION for significant improvements but said the next step is to withdraw from distribution the “tainted models” that are still able to produce child abuse imagery.

One of the LAION-based tools that Stanford identified as the “most popular model for generating explicit imagery” — an older and lightly filtered version of Stable Diffusion — remained easily accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a “planned deprecation of research models and code that have not been actively maintained.”

The cleaned-up version of the LAION dataset comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children.

San Francisco’s city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable the creation of AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform’s founder and CEO, Pavel Durov.

Durov’s arrest “signals a really big change in the whole tech industry that the founders of these platforms can be held personally responsible,” said David Evan Harris, a researcher at the University of California, Berkeley who recently reached out to Runway asking about why the problematic AI image-generator was still publicly accessible. It was taken down days later.

Read More

  • Related Posts

    Child dies in horror three-car crash near the border of South Australia and Victoria

    READ MORE:  Queensland’s new Premier David Crisafulli makes big call on Brisbane 2032 Olympic Games within hours of being voted in By DUNCAN EVANS FOR NCA NEWSWIRE Published: 16:04 EST, 27…

    Huw Edwards’ child porn charges were not made public ‘due to fears over his mental health’: BBC boss Tim Davie denies ‘sitting on’ internal report but admits he knew star’s arrest was over the most serious level of sex abuse images

    Huw Edwards’ child pornography charges were not made public due to fears over his ‘mental health’, it is understood.  Edwards, 62, was arrested on suspicion of receiving indecent images of…

    You Missed

    Hilarious way bank robber’s escape was foiled

    • By admin
    • February 4, 2025
    • 1 views
    Hilarious way bank robber’s escape was foiled

    Police reveal safety fears for missing woman, 35, who ‘disappeared without trace’ on New Year’s Eve

    • By admin
    • February 4, 2025
    • 1 views
    Police reveal safety fears for missing woman, 35, who ‘disappeared without trace’ on New Year’s Eve

    How glitzy Mar-a-Lago New Year’s party reveals who REALLY holds the power with Trump

    • By admin
    • February 4, 2025
    • 1 views
    How glitzy Mar-a-Lago New Year’s party reveals who REALLY holds the power with Trump

    Alina Habba sends explicit political message as Trump’s firebrand attorney stuns at Mar-a-Lago’s NYE party

    • By admin
    • February 4, 2025
    • 1 views
    Alina Habba sends explicit political message as Trump’s firebrand attorney stuns at Mar-a-Lago’s NYE party

    New Orleans updates: ISIS terrorists feared to be on the loose after EV attack by Shamsud Din Jabbar killed 15

    • By admin
    • February 4, 2025
    • 1 views
    New Orleans updates: ISIS terrorists feared to be on the loose after EV attack by Shamsud Din Jabbar killed 15

    Two killed after small ‘home built’ aircraft crashes into Southern California furniture warehouse

    • By admin
    • February 3, 2025
    • 2 views
    Two killed after small ‘home built’ aircraft crashes into Southern California furniture warehouse