Hermes Vector

AI & SI

OpenAI Releases New Tools to Detect and Respond to Online Child Sexual Abuse

OpenAI has launched a new image classifier to detect CSAM, product warnings in ChatGPT, developer guidance, and training for law enforcement investigators.

By Hermes Vector

Also in: Español · Português · Français · Deutsch

Checked against 1 sourceOpenAI
Illustration for: OpenAI Releases New Tools to Detect and Respond to Online Child Sexual Abuse

In brief

  • OpenAI released a new image classifier to detect CSAM, including AI-generated material, available at no cost to vetted organizations via the OpenAI API.
  • New ChatGPT warnings interrupt attempts to find abusive material, explain consequences, and point people toward help, with a 24-hour access pause for flagged conversations.
  • OpenAI published CSAM guidance for developers and is providing tools and training to child-safety law enforcement investigators.
  • Early tests found the new classifier could flag 48% fewer images while finding roughly the same number of abusive images as the existing tool.

OpenAI Releases New Tools to Detect and Respond to Online Child Sexual Abuse

OpenAI has released new tools and support to prevent, detect, and respond to online child sexual exploitation and abuse, the company announced on November 16, 2026.

New CSAM detection tool

OpenAI is releasing a new image classifier that can detect potential child sexual abuse material (CSAM), including AI-generated material. The classifier looks for visual signs of abuse and returns scores to help reviewers prioritize images. OpenAI says this is the first CSAM classifier with broad availability that has a specific signal indicating if CSAM may be AI generated.

The classifier was trained, evaluated, and designed with assistance from the National Center for Missing and Exploited Children (NCMEC). Access is offered to vetted organizations through the OpenAI API at no cost.

Early tests suggest the classifier could reduce review work by flagging 48% fewer images while finding roughly the same number of abusive images as the existing tool. Images flagged by the new classifier were about twice as likely to contain abuse.

John Shehan, Senior Vice President of NCMEC, said: "Technology has an essential role to play in helping identify child sexual abuse material (CSAM) and, ultimately, the children who may be depicted in it. This new classifier gives more organizations access to tools that can help detect previously unidentified CSAM, strengthen reporting and provide critical information to those working to identify and protect victims."

Interrupting harmful behavior

OpenAI is adding new product warnings in ChatGPT that interrupt attempts to find abusive material, explain the consequences, and point people toward help. The warning makes clear that sexualizing children causes harm, including when the requested material is AI-generated.

Alongside the warning, OpenAI will remove the flagged conversation and pause access to ChatGPT for 24 hours, while keeping specialist support available. Repeated violations may lead to longer restrictions and ultimately account closure or reports to authorities.

The approach was developed with input from Protect Children, the Lucy Faithfull Foundation, Dr. Caoilte Ó Ciardha, and Joel Scanlan.

Support for developers and investigators

OpenAI has published CSAM guidance for developers, developed with input from the Tech Coalition, Thorn, NCMEC, and the Internet Watch Foundation. The company also worked with Anthropic and Google to jointly commission new guidance on responding to disclosures of child sexual exploitation and abuse in AI systems, recently published by the Tech Coalition.

OpenAI is supporting child-safety law enforcement units with new tools and trainings on how to use AI in investigations, including dedicated plugins, investigative tools, and complex data analysis. The first tool will help investigators review lengthy chat logs and legal process returns, identify potential connections, and create timelines.

Jeff Jackson, North Carolina Attorney General, said: "As state attorneys general on the AI Task Force, our first priority is protecting kids. That needs to be the first priority of tech companies too. We must increase our defenses, and OpenAI and other tech companies must be thinking about and working around the clock to prevent synthetic child sex abuse material. We need to keep our children safe."

Why it matters

These efforts build on OpenAI's Child Safety Blueprint and aim to give child protection organizations, developers, researchers, and investigators tools to protect children and combat exploitation online.


Sources

This article was drafted with AI assistance and checked against the sources above. Company claims are reported as claims. Cover image is AI-generated.

Questions readers ask

When did OpenAI announce the release of new tools to detect and respond to online child sexual abuse?
OpenAI announced the release of these tools on November 16, 2026.
What is unique about OpenAI's new CSAM detection classifier?
It is the first CSAM classifier with broad availability that includes a specific signal indicating if CSAM may be AI generated.
How does OpenAI plan to interrupt harmful behavior in ChatGPT?
OpenAI will add product warnings that interrupt attempts to find abusive material, remove the flagged conversation, and pause access to ChatGPT for 24 hours.
Which organizations assisted in the development and evaluation of the new CSAM classifier?
The classifier was trained, evaluated, and designed with assistance from the National Center for Missing and Exploited Children (NCMEC).
What tools is OpenAI providing to child-safety law enforcement units?
OpenAI is supporting these units with dedicated plugins, investigative tools, and complex data analysis to help review chat logs and create timelines.

The day's checked news, by email

One short email a day with the top stories. Free, and you can unsubscribe in one click.

Or follow for the latest news:

How do you feel about this story?

Comments 0

No comments yet. Start the discussion.