OpenAI Releases Free CSAM Image Classifier and Adds 24-Hour ChatGPT Suspensions

OpenAI released a free CSAM image classifier for vetted organizations on 16 November 2026, built with NCMEC and able to flag AI-generated material. ChatGPT now warns users who try to find abusive content, removes the conversation and pauses access for 24 hours.

Christopher Ort
By Christopher Ort · 3 min read
Share
A trust and safety review office at night.
Image: AI-generated, i10X
On this page
  1. Quick Take
  2. In plain English
  3. What happened
  4. What's in the developer guidance
  5. Why it matters
  6. What's still open
  7. Sources
  8. i10x Perspective

OpenAI has released a free image classifier that detects child sexual abuse material (CSAM), including AI-generated images, and is adding warnings and 24-hour suspensions in ChatGPT for people who try to find such content. The company announced the tools on 16 November 2026, together with new guidance for developers and AI tools for child-safety police investigators.

i10X Quick Take

Quick Take

  1. The classifier: detects potential CSAM, including novel images and AI-generated material, and returns risk scores so human reviewers know what to look at first. OpenAI says it is the first broadly available CSAM classifier with a specific signal for whether material may be AI-generated.
  2. Access: free through the OpenAI API for vetted organizations, via an intake form. Built with help from the National Center for Missing and Exploited Children (NCMEC); access is also shared through the Tech Coalition and ROOST.
  3. Results: in OpenAI’s evaluation, it would flag 48% fewer images than the current tool while finding roughly the same number of abusive images, and flagged images were about twice as likely to contain abuse.
  4. In ChatGPT: attempts to find abusive material trigger a warning, removal of the conversation and a 24-hour pause on ChatGPT access. Repeat violations can lead to account closure or reports to authorities.
  5. For investigators: plugins and tools to review long chat logs and legal process returns, find connections and build timelines, with access managed by program administrators.

In plain English

OpenAI built a tool that can spot images of child sexual abuse, including fake ones made by AI, and it is giving that tool to safety teams at other companies for free. Inside ChatGPT, anyone trying to get this kind of material will now see a warning, lose access for a day and be pointed to help services. Normal users do not need to do anything.

What happened

OpenAI said it trained, evaluated and designed the classifier “with assistance from the National Center for Missing and Exploited Children,” which runs the CyberTipline, the US reporting hub for online child exploitation. Scores from the classifier indicate risk to help prioritize review; they do not on their own confirm that an image is CSAM.

Early access partners reported their own results. In tests by fal on human-reviewed production images, reviewers confirmed 72% of the classifier’s high-confidence flags as novel CSAM. invideo AI said one in four flagged cases led to a ban. SafetyKit said the classifier detected 90% of cases involving drawings or animations that sexualize children.

OpenAI said the ChatGPT warnings were developed with Protect Children, the Lucy Faithfull Foundation, Caoilte Ó Ciardha of the University of Kent and Joel Scanlan of the University of Tasmania, who independently evaluated a trial of deterrent messages.

What’s in the developer guidance

OpenAI also published CSAM guidance for developers, written with input from the Tech Coalition, Thorn, NCMEC and the Internet Watch Foundation. It covers clear rules, user reporting, detection tools, and processes for reviewing and reporting suspected abuse, plus how safety identifiers can link misuse to individual users. OpenAI says the guidance has already led more developers to adopt child-safety tooling and register to report CSAM to NCMEC.

Why it matters

For platforms that host images, especially AI image and video generators, a free classifier with an AI-generated signal fills a gap that hash matching, which only catches known images, cannot cover.

For trust and safety teams, fewer false positives means less exposure of human reviewers to harmful material and faster action on real cases.

For OpenAI, the launch comes as it faces mounting pressure over safety, including the California lawsuit over its AI agents and outside scrutiny of its models through embedded safety assessments.

What’s still open

  • How OpenAI decides which organizations count as vetted, and how long approval takes.
  • Independent evaluations of the classifier beyond OpenAI’s and its partners’ own tests.
  • How the 24-hour suspensions handle false positives, and how users can appeal.

Sources

  • OpenAI, “Strengthening the fight against online child sexual abuse with new tools and support,” 16 November 2026
  • OpenAI, CSAM Image Classifier model card and Help Center access page
  • TechCrunch, “OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM,” 16 November 2026

i10x Perspective

Giving a safety tool away is the right call here. CSAM detection only works if smaller platforms can afford it, and many AI image startups cannot build this themselves. The AI-generated signal matters most: synthetic abuse material is the problem generative AI created, and the industry needs shared defenses against it. More in our Policy & Safety section.

Christopher Ort

Christopher Ort

Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU). He is the author of “The Style Penalty”, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.

Timeline

What happened before

  1. Release

    GPT-6.1 Terra

    1.05M context · $1 / $5 per 1M tokens

    openai.com (source, opens in a new tab)
  2. Release

    GPT-6.1 Sol

    1.05M context · $2 / $10 per 1M tokens

    developers.openai.com (source, opens in a new tab)
  3. Release

    GPT-6 Sol & Luna

    1.05M context · $2 / $10 per 1M tokens

    Two GPT-6 reasoning models. Price shown is GPT-6 Sol (≤272K prompt); GPT-6 Luna costs $0.10 / $0.50.

    developers.openai.com (source, opens in a new tab)
  4. Release

    GPT-6 Astra

    1.05M context · $10 / $50 per 1M tokens

    OpenAI's most capable model for reasoning, coding, computer use and research.

    openai.com (source, opens in a new tab)
  5. Release

    GPT-5.6

    1.05M context · $4 / $20 per 1M tokens

    GPT-5.6 family: Sol (frontier), Terra (balanced) and Luna (high-volume).

    developers.openai.com (source, opens in a new tab)
Full ChatGPT timeline ›

Editor's picks

  1. Genesys Launches Standalone AI Agents and Arena, With Pricing Based on How Hard Each Task Is
  2. Seedance 2.5 4K Reaches Developers: 10-Bit Video up to 30 Seconds With 480p Draft Mode
  3. Perplexity Computer Adds Multiagent Mode, Where Up to 16 Agents on Rival Models Check Each Other
  4. Gemini Can Now Make Calls, Pay Bills and Shop, Free in Six Countries With Gemini 4 Hydrogen
  5. Hinton on Firing Line: AI Is Making ‘Alien Beings’ and Self-Regulation Is ‘Absurd’