OpenAI Will Limit Weapons Information for Teens Even Without Signs of Violent Intent, and Says It Made Over 200 Police Referrals in Q3
OpenAI said on October 30 that ChatGPT will restrict practical information about weapons and security systems for users it believes are under 18, even when a question shows no violent intent, and will give all users less detail about past mass attacks. ChatGPT will also be able to end chats that fixate on violence and may pause accounts. OpenAI said it made over 200 law enforcement referrals in the third quarter and will publish a Community Safety Report every six months, starting in early 2027. The changes roll out over the next few weeks.
OpenAI is moving some of ChatGPT's violence safeguards from judging intent to judging the topic. For users it predicts are under 18, the company said on October 30 that ChatGPT will restrict practical information about weapons and security systems "even when there's no sign of violent intent." For everyone, it will give less detail about past mass attacks, "regardless of a user's age or reason for asking." It also put a number on its escalations: over 200 law enforcement referrals in the third quarter of 2026.
What changes for all users#
OpenAI said ChatGPT will restrict reconstructions of past mass attacks, including details about the weapons and equipment used, how they were obtained, and comparisons of scale that could amplify an attacker's notoriety. People can still ask about how victims and communities were affected and how to recognize warning signs, the company said.
When a conversation shows signs that someone is fixating on violence or on seriously harming another person, ChatGPT will be able to end the chat automatically. If it ends multiple chats for that reason, OpenAI may temporarily pause the account. When recent chats show warning signs of possible violence, ChatGPT will answer more conservatively on information that could be misused, building on a summary-of-warning-signs feature it described in May.
What changes for teens#
The stricter limits apply when OpenAI predicts a user is under 18, through the ChatGPT for Teens experience. OpenAI said its age-prediction system now keeps assessing new signals as people use ChatGPT and moves teens into the under-18 experience when appropriate; adults placed there by mistake can verify their age through Persona. Teens can still use ChatGPT to seek support, de-escalate violence and connect with a trusted adult, the company said.
Parents with linked accounts have, since July, been alerted if a teen's account is deactivated for violating OpenAI's violence policies. OpenAI said it is working on alerts for when a teen's account is paused for repeatedly discussing violence. Reuters noted that Common Sense Media found earlier this month that the teen version often alerted parents late or not at all about conversations on suicide, self-harm or eating disorders, a report we covered at the time.
The reporting promise#
OpenAI said it will publish a Community Safety Report on violence prevention and the effectiveness of its safeguards, with the first edition in early 2027 covering the second half of 2026 and updates every six months. The report will include anonymized examples and "relevant data," the company said. The changes announced on Friday will begin rolling out in the next few weeks.
The announcement comes as OpenAI faces state lawsuits over child safety, including suits from eight states that allege ChatGPT is unsafe for children.
Limits#
- The 200-plus referral figure is OpenAI's own, with no total of flagged conversations or outcomes to compare it against.
- OpenAI calls the new publication both a "Community Safeguards Report" and a "Community Safety Report" in the same post; we use the latter.
- The post gives no accuracy rate for age prediction, so it is not known how many teens the stricter limits will miss or how many adults they will catch.
- None of the new safeguards has been independently tested; they have not yet rolled out.