OpenAI CSAM classifier
OpenAI announced on Monday, November 16, 2026, a new image classifier that it says can detect child sexual abuse material (CSAM), including AI-generated imagery, and it is offering the tool free to vetted organizations.123 OpenAI says it is the first broadly available CSAM classifier with a specific signal for whether material may be AI-generated, and says it is working with the Tech Coalition and ROOST to share access to the tool.4567 The launch also includes a ChatGPT warning for users who seek CSAM, followed by a 24-hour pause in access, with repeated violations possibly leading to longer restrictions and account closure; OpenAI is additionally publishing guidelines for developers.891011
The tool arrives as AI-generated abuse imagery strains reporting systems: The Verge reports the NCMEC CyberTipline received 400,000 generative AI-related reports in 2025, up from 67,000 in 2024.12
OpenAI says that in early testing with partners the classifier flagged 48 percent fewer images while finding about the same number of abusive ones, and that the images it flagged were twice as likely to be abusive.1314 Company leaders said the classifier still requires human review.15 John Buckley, OpenAI's head of child safety public policy, said the company is limiting distribution to organizations equipped for specialized review and registered to report, rather than individual developers.16
Partners quoted by OpenAI praised the tool: John Shehan of NCMEC said it gives more organizations access to tools for detecting previously unidentified CSAM, and Samuel Wang of SafetyKit called it the best his team had seen in testing, with false positives below 1% on legal adult content.171819 North Carolina Attorney General Jeff Jackson described the collaboration with OpenAI as "basically an experiment" in preventing harm rather than only punishing it afterward, while the coverage notes OpenAI faces pressure and lawsuits over alleged harms to children. inference202122
Sources quoted
At a Monday press briefing in Washington, DC, OpenAI announced a classifier it says can better detect abusive imagery of kids, including whether it’s AI-generated.
— The Verge, OpenAI wants to stop deepfakes from overwhelming child abuse tiplinesWe’re offering access to the classifier to vetted organizations through the OpenAI API at no cost
— OpenAI, Strengthening the fight against online child sexual abuse with new tools and supportOpenAI released a new tool Monday aimed at detecting possible child sexual abuse material (CSAM), including content made with artificial intelligence.
— The Hill technology, OpenAI unveils tool to better detect child sexual abuse materialThis is the first CSAM classifier with broad availability that has a specific signal on indicating if CSAM may be AI generated.
— OpenAI, Strengthening the fight against online child sexual abuse with new tools and supportit is working with Tech Coalition and ROOST to share access to the tool
— TechCrunch, OpenAI releases a new image classifier and ChatGPT warnings to combat CSAMIt’s also the first broadly available CSAM classifier with a specific flag for AI-generated material, said OpenAI’s head of child safety public policy, John Buckley, at the briefing.
— The Verge, OpenAI wants to stop deepfakes from overwhelming child abuse tiplinesThe company said it is the first image classifier with a “specific signal” for AI-generated content that may contain CSAM.
— The Hill technology, OpenAI unveils tool to better detect child sexual abuse materialwe’ll remove the flagged conversation and pause access to ChatGPT for 24 hours, while keeping specialist support available to help people stop harmful behavior.
— The Hill technology, OpenAI unveils tool to better detect child sexual abuse materialRepeated violations may lead to longer restrictions and ultimately account closure or reports to authorities.
— The Hill technology, OpenAI unveils tool to better detect child sexual abuse materialThe company is also publishing guidelines for developers using OpenAI tools to prevent, detect, and help users report CSAM content.
— TechCrunch, OpenAI releases a new image classifier and ChatGPT warnings to combat CSAMWe’ve published CSAM guidance(opens in a new window) to give developers practical steps to prevent abuse, detect harmful content, and act on it.
— OpenAI, Strengthening the fight against online child sexual abuse with new tools and supportThe CyberTipline received 400,000 generative AI-related reports in 2025, an exponential increase from the 67,000 it received in 2024
— The Verge, OpenAI wants to stop deepfakes from overwhelming child abuse tiplinesflagging about 48 percent fewer images while still finding about the same number of abusive images as existing tools.
— The Hill technology, OpenAI unveils tool to better detect child sexual abuse materialimages flagged by the classifier are twice as likely to be abusive images.
— TechCrunch, OpenAI releases a new image classifier and ChatGPT warnings to combat CSAMThe classifier will still require human review to ensure accuracy, company leaders said Monday.
— The Hill technology, OpenAI unveils tool to better detect child sexual abuse materialwe do not want to hand this tool out individual developers who are not equipped with the specialized review that’s required or registered to report to NMEC or other international reporting hotlines,”
— The Hill technology, OpenAI unveils tool to better detect child sexual abuse materialThis new classifier gives more organizations access to tools that can help detect previously unidentified CSAM
— OpenAI, Strengthening the fight against online child sexual abuse with new tools and supportOpenAI’s classifier is the best we’ve seen
— OpenAI, Strengthening the fight against online child sexual abuse with new tools and supportwith false positives below 1% on legal adult content
— OpenAI, Strengthening the fight against online child sexual abuse with new tools and supportAnd I would say it’s still basically an experiment.”
— The Verge, OpenAI wants to stop deepfakes from overwhelming child abuse tiplinesLast month eight states sued OpenAI for a separate set of alleged harms to children
— The Verge, OpenAI wants to stop deepfakes from overwhelming child abuse tiplinesOpenAI has had several lawsuits against the company blaming its technology for harming users, especially children.
— TechCrunch, OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM
Who reported it
- The Vergeown facts: OpenAI unveiled a classifier to detect child abuse imagery, including AI-generated material, with free access for vetted groups and law enforcement training. It cuts false positives 48 percent.
- TechCrunchrepeats OpenAI: OpenAI unveils a CSAM image classifier with NCMEC, ChatGPT warnings and 24-hour suspensions for child-sexualizing prompts, developer guidelines, and law enforcement tools.
- OpenAIannouncement: Releases a free-to-vetted-orgs classifier detecting potential CSAM, including AI-generated material, with early partner test results reported.
- The Hill technologyown facts: Image classifier for vetted organizations and law enforcement, trained to spot visual signs of abuse, including AI-generated content. OpenAI says it flags 48 percent fewer images than existing tools.
- Techdirtcommentary: OpenAI announced new tools and support to strengthen the fight against online child sexual abuse.
Facts and takes
Facts: 8 checked facts from 2 sources
- OpenAI released CSAM classifier
- CSAM classifier is available on OpenAI API
- CSAM classifier: images flagged down 48%
- CSAM classifier: returns scores that help reviewers decide which images may need attention first
- CSAM classifier: specific signal indicating if CSAM may be AI generated
- OpenAI released image classifier
- image classifier: images flagged down 48 percent
- image classifier: first image classifier with a “specific signal” for AI-generated content that may contain CSAM
Timeline
- · The Verge: OpenAI wants to stop deepfakes from overwhelming child abuse tiplines
- · TechCrunch: OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM
- · OpenAI: Strengthening the fight against online child sexual abuse with new tools and support
- · The Hill technology: OpenAI unveils tool to better detect child sexual abuse material
- · Techdirt: Ctrl-Alt-Speech: Make America Break Again