In a chilling example of technology gone wrong, a 16-year-old student in Baltimore found himself facing armed police officers, handcuffed, and searched – all because an AI system mistook his bag of Doritos for a gun. This alarming incident at Kenwood High School raises serious questions about the reliability and implementation of AI in law enforcement and school safety.
A Terrifying Misidentification
Taki Allen was simply sitting outside his school waiting for a ride after finishing his chips when chaos erupted. Suddenly, around eight police cars swarmed the area, and officers approached him and his friends with guns drawn, ordering them to the ground. Allen recounted the terrifying experience, stating, “They made me get on my knees, put my hands behind my back, and cuffed me.” After realizing he had nothing, officers investigated the spot where he’d been standing and found the discarded bag of chips.
Allen explained that the way he was holding the bag – with two hands and one finger extended – apparently triggered the school’s AI gun detection system, Omnilert. This system automatically alerted law enforcement and school administration. The incident left Allen feeling unsafe, even days later, stating, “I don’t think no chip bag should be mistaken for a gun at all.” He now avoids going outside after practice, fearing for his safety.
Concerns Over AI and Safety
While school superintendent Dr. Myriam Rogers defended the AI system, stating it “did what it was supposed to do which was to signal an alert and for humans to take a look,” Allen and his grandfather, Lamont Davis, are unconvinced. Davis expressed the universal fear, “Nobody wants this to happen to their child.”
The school’s principal, Kate Smith, sent a letter to parents assuring them that student safety is a top priority and that counselors would be available to support students affected by the incident. However, the lack of a direct outreach to Allen from the principal’s office three days later has further fueled concerns about the school’s genuine care for the situation. This incident occurs at a time when AI systems are under scrutiny, with calls for stronger regulations and public input on technologies that could shape our future.
What are your thoughts on using AI for security in schools? Do you believe the system’s alert was justified, or was this a dangerous overreach? Share your perspective in the comments below!