Talk about a major AI fail! Imagine just chilling with your friends after school, enjoying a snack, when suddenly, police are rolling up with guns drawn, thinking you’re armed. That’s exactly what happened to Taki Allen, a student at Kenwood High School in Baltimore, all because an artificial intelligence system mistook his bag of Doritos for a firearm.
When Chips Become a Threat
On Monday night, October 20, 2025, Allen was simply hanging out and snacking when the alarming situation unfolded. As he told WBAL-TV 11 News, cops approached him with weapons drawn, ordering him to the ground. ‘At first, I had no clue what was happening until I saw them approaching with their weapons drawn, telling me to ‘Get on the ground.’ I was like, ‘What’s going on?’’ Allen recounted.
After being ordered to kneel and handcuffed, Allen was searched, only for officers to find nothing. They then showed him the image that had triggered the alert: a photo of him holding a bag of Doritos. ‘I was just holding a Doritos bag—two hands and one finger out, and they said it looked like a gun,’ he explained.
How AI Gun Detection Systems Work (and Fail)
Baltimore County high schools implemented an AI gun detection system last year. This technology uses surveillance cameras to monitor for potential weapons, aiming to flag threats before they occur. When the system identifies something resembling a gun, it sends an alert to school officials and law enforcement.
While intended to enhance student safety, this incident highlights the system’s significant flaws. Experts have long warned about AI’s struggles with accuracy in real-world visual recognition, especially in diverse settings. Misidentifications like this can easily lead to dangerous encounters, particularly when law enforcement is involved.
School District and Police Respond
Baltimore County Public Schools released a statement acknowledging the incident. In a letter to families, the district stated, ‘We understand how upsetting this was for the individual involved and others who witnessed the incident. Our counselors will provide direct support to the students affected and are also available for any student in need of assistance.’
The district is reportedly reviewing the AI system’s accuracy and the response protocols. Baltimore County police confirmed the details, stating officers responded to reports of a ‘suspicious individual with a weapon,’ but upon arrival, the individual was searched and found to be unarmed.
Community Raises Concerns About AI Bias
The community’s reaction has been varied, with some parents calling for the removal of AI surveillance systems altogether. Many Black families, in particular, are voicing deep concerns, pointing out that false assumptions and overreactions by law enforcement can have severe, even deadly, consequences for young Black men. Advocates argue that technology developed without cultural and racial awareness can inadvertently reinforce existing biases.
AI didn’t mistake a bag—it mistook a Black boy with a snack as a threat. — Local Parent
This incident underscores the critical need for accountability and transparency in AI systems used in schools. The promise of ‘safety through technology’ falters when it leads to racial profiling and public humiliation. Experts emphasize that AI should assist human judgment, not replace it, and that rigorous testing for accuracy, cultural bias, and accountability is essential before widespread implementation.
What do you think about the use of AI in schools? Should these systems be removed, or do they need better oversight? Share your thoughts in the comments below!
