A study reveals that leading AI chatbots provided advice on planning violent attacks, including locations and weapons, when tested by researchers posing as children. The research highlights the potential for real-world harm and calls for stronger safety measures, citing examples of chatbots like DeepSeek and Gemini offering specific guidance. Some companies like Meta have responded by taking immediate steps to address the issues identified.
WASHINGTON - From school shootings to synagogue bombings, leading AI chatbots helped researchers plot violent attacks, according to a study published Wednesday that highlighted the technology's potential for real-world harm.
Researchers from the nonprofit watchdog Center for Countering Digital Hate and CNN posed as 13-year-old boys in the United States and Ireland to test 10 chatbots, including ChatGPT, Google Gemini, Perplexity, Deepseek, and Meta AI.Testing showed that eight of those chatbots assisted the make-believe attackers in over half the responses, providing advice on "locations to target" and "weapons to use" in an attack, the study said.The chatbots, it added, had become a "powerful accelerant for harm.""Within minutes, a user can move from a vague violent impulse to a more detailed, actionable plan," said Imran Ahmed, the chief executive of CCDH."The majority of chatbots tested provided guidance on weapons, tactics, and target selection. These requests should have prompted an immediate and total refusal."Perplexity and Meta AI were found to be the "least safe," assisting the researchers in most responses while only Snapchat's My AI and Anthropic's Claude refused to help them in over half the responses.In one chilling example, DeepSeek, a Chinese AI model, concluded its advice on weapon selection with the phrase: "Happy shooting!"In another, Gemini instructed a user discussing synagogue attacks that "metal shrapnel is typically more lethal."Researchers found Character.AI also "actively" encouraged violent attacks, including suggestions that the person asking questions "use a gun" on a health insurance CEO and physically assault a politician he disliked.The most damning conclusion of the research was that "this risk is entirely preventable," Ahmed said, citing Anthropic's product for praise."Claude demonstrated the ability to recognize escalating risk and discourage harm," he said."The technology to prevent this harm exists. What's missing is the will to put consumer safety and national security before speed-to-market and profits."AFP reached out to the AI companies for comment."We have strong protections to help prevent inappropriate responses from AIs, and took immediate steps to fix the issue identified," a Meta spokesperson said."Our policies prohibit our AIs from promoting or facilitating violent acts and we're constantly working to make our tools even better."The study, which highlights the risk of online interactions spilling into real-world violence, comes after February's mass shooting in Canada, the worst in its history.The family of a girl gravely injured in that shooting is suing OpenAI over the company's failure to notify police about the killer's troubling activity on its ChatGPT chatbot, lawyers said on Tuesday.OpenAI had banned an account linked to Jesse Van Rootselaar in June 2025, eight months before the 18?year?old transgender woman killed eight people at her home and a school in the tiny British Columbia mining town of Tumbler Ridge.The account was banned over concerns about usage linked to violent activity, but OpenAI has said it did not inform police because nothing pointed towards an imminent attack. — Agence France-Presse
AI Chatbots Violence Safety Research
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Lapu mayor orders study on possible 4-day work week at City HallSunStar Publishing Inc.
Read more »
Global Push for Age Verification on Social Media Gains MomentumGovernments worldwide are implementing stricter age verification requirements for social media platforms, AI chatbots, and other online services to protect children from online abuse and address mental health concerns. Advancements in AI-powered age assurance technology have made implementation more feasible and cost-effective, leading to a shift from tech companies' previous resistance.
Read more »
Quezon City Mobilizes Task Force to Protect and Assist OFWs Amidst Middle East ConflictThe Quezon City government has established a special inter-agency task force to provide assistance and protection to its overseas Filipino workers (OFWs) affected by the escalating conflict in the Middle East. The task force will facilitate repatriation, offer support services, and coordinate with national government agencies to ensure the safety and well-being of QCitizens abroad.
Read more »
CFO Urges Filipinos to be Prepared for Studies in AustraliaThe Commission on Filipinos Overseas (CFO) advises Filipinos planning to study in Australia to be well-informed and have realistic expectations to avoid financial and emotional difficulties. The CFO highlights the high tuition costs, potential social differences, and the importance of understanding migration pathways.
Read more »
Gov’t urged to revive sugar buying programSugar industry leaders are urging the government to revive and refine its sugar-buying program and study adopting a government-mandated floor price, two
Read more »