Armed Police Swarm Student After AI Mistakes Bag of Doritos for a Weapon
Posted3 months agoActive2 months ago
dexerto.comTechstoryHigh profile
heatednegative
Debate
85/100
AISurveillancePolice Brutality
Key topics
AI
Surveillance
Police Brutality
An AI-powered gun detection system mistakenly identified a bag of Doritos as a gun, leading to armed police swarming a student, sparking concerns about the safety and reliability of such systems.
Snapshot generated from the HN discussion
Discussion Activity
Very active discussionFirst comment
4m
Peak period
145
0-12h
Avg / period
26.7
Comment distribution160 data points
Loading chart...
Based on 160 loaded comments
Key moments
- 01Story posted
Oct 23, 2025 at 2:09 PM EDT
3 months ago
Step 01 - 02First comment
Oct 23, 2025 at 2:14 PM EDT
4m after posting
Step 02 - 03Peak activity
145 comments in 0-12h
Hottest window of the conversation
Step 03 - 04Latest activity
Oct 28, 2025 at 7:58 PM EDT
2 months ago
Step 04
Generating AI Summary...
Analyzing up to 500 comments to identify key contributors and discussion patterns
ID: 45684934Type: storyLast synced: 11/22/2025, 11:47:55 PM
Want the full context?
Jump to the original sources
Read the primary article or dive into the live Hacker News thread when you're ready.
* Even hundreds of cops in full body armor and armed with automatic guns will not dare to engage a single "lone wolf" shooter doing a killing spree in a school; the heartless cowards may even prevent the parents from going inside to rescue their kids: Uvalde school shooting incident
* Cop on a ego trip, will shoot down a clearly harmless kid calmly eating a burger in his own car (not a stolen car): Erik Cantu incident
* Cops are not there to serve the society, they are not there to ensure safety and peace for the neighborhood, they are merely armed militia to protect the rich and powerful elites: https://www.alternet.org/2022/06/supreme-court-cops-protect-...
Doesn't mean they are perfect or shouldn't criticised but claiming that's all they are doing isn't reasonable either.
If you look at actual per capita statistics you will easily see this.
https://en.wikipedia.org/wiki/Lists_of_killings_by_law_enfor...
In the United States, law enforcement officers shoot and kill more than 1,100 civilians each year, with a significant number of these incidents involving unarmed individuals, particularly among Black Americans who are disproportionately affected. The FBI has begun collecting data on these use-of-force incidents to provide better insights into the circumstances surrounding police shootings.
Police killed more than 1,300 people in the U.S. last year, an estimated 0.3% increase in police killings per million people. The increase makes 2024 the deadliest year for police violence by a slim margin since Mapping Police Violence began tracking civilian deaths more than a decade ago.
https://www.usatoday.com/story/news/nation/2025/02/26/police...
There is no national database that documents police killings in the U.S., and the report comes days after the Justice Department removed a database tracking misconduct by federal law enforcement. Researchers spent thousands of hours analyzing more than 100,000 media reports to compile the Mapping Police Violence database.
https://en.wikipedia.org/wiki/List_of_mass_shootings_in_the_...
In 2025, the U.S. has experienced significant gun violence, with 11,197 shooting deaths reported through September 30, along with 20,425 nonfatal injuries. The year has seen a total of 341 mass shootings, resulting in 331 fatalities and 1,499 injuries.
Shootings have happened in all 50 states, at all times of day, and in locations as varied as schools, gas stations, gyms, Walmarts, and homes. Some involved handguns, others rifles or shotguns.
10.3 million guns have been sold across the U.S. in 2025 through September 30.
https://www.thetrace.org/2025/10/shooting-gun-violence-data-...
Mass shootings in the United States are incidents where one or more individuals use firearms to kill or injure multiple people, typically in public settings. The frequency and definitions of these events can vary, but they have been a significant concern in recent years, with the U.S. experiencing more mass shootings than any other country.
GVA has recorded 325 mass shootings in the U.S. this year through three quarters. Those have resulted in 309 deaths and 1,490 injuries.
Mass shootings in the last quarter included the high-profile shooting at a New York skyscraper, as well as the shooting of 29 people, 26 of them children, at a church in Minneapolis. Two children, aged 8 and 10, were killed in that incident.
Someone being unarmed doesn't mean they can't be deadly. They could be driving a vehicle or otherwise physically assault somebody which would justify deadly force.
Otherwise 1100 is actually quite low compared to the total gun death and per capita in which blacks are over represented compared to all other groups. That includes black on black and black on cops.
> The Department of School Safety and Security quickly reviewed and canceled the initial alert after confirming there was no weapon. I contacted our school resource officer (SRO) and reported the matter to him, and he contacted the local precinct for additional support. Police officers responded to the school, searched the individual and quickly confirmed that they were not in possession of any weapons.
What's unclear to me is the information flow. If the Department of School Safety and Security recognized it as a false positive, why did the principal alert the school resource officer? And what sort of telephone game happened to cause local police to believe the student was likely armed?
1. https://www.wbaltv.com/article/student-handcuffed-ai-system-...
Yeah, cause cops have never shot somebody unarmed. And you can bet your ass that the possible follow-up lawsuit to such a debacle's got "your" name on it.
https://legalclarity.org/false-report-under-the-texas-penal-...
Furthermore, anyone who files a false report can be sued in civil court.
I can make a system that flags stuff, too. That doesn't mean it's any good. If they can show there was no reasonable cause then they've got a leg to stand on.
It's ok everyone, you're safer now that police are pointing a gun at you, because of a bag of chips ... just to be safe.
/s
Absolutely ridiculous. We're living "computer said you did it, prove otherwise, at gunpoint".
Cyberpunk always sucked for all but the corrupt corporate, political and military elites, so it’s all tracking
The ones I see don't tend to lean cute.
We got dark, but also lame and stupid.
Meanwhile, tons of you watched star trek and apparently learned(?) that the "bright future" it promised us was.... talking computers? And not, you know, post scarcity and enlightenment that allowed people to focus on things that brought them joy or they were good at, and an entire elimination of the concept of "capitalism" or personal profit or resource disparity that could allow people to not be able to afford something while some asshole in the right place at the right time gets to take a percentage cut of the entire economy for their personal use.
The primary "technology" of star trek was socialism lol.
My point is exactly that we got the dystopia but also it's not even a little cool, and it's very stupid. We could have at least gotten the cool dystopia where bad things happen but at least they're part of some kind of sensible longer-term plan. What we got practically breaks suspension of disbelief, it's so damn goofy.
> The primary "technology" of star trek was socialism lol.
Yep. Socialism, and automatic brainwashing chairs. And sending all the oddball non-conformists off to probably die on alien planets, I guess. (The "Original Series" is pretty weird)
It's sadly the exact future that we are already starting to live in.
prioritize your own safety by not attending any location fitted with such a system, or deemed to be such a dangerous environment that such a system is desired.
the AI "swatted" someone.
How many packs of Twizzlers, or Doritos, or Snickers bars are out there in our schools?
First time it happens, there will be an explosion of protests. Especially now that the public knows that the system isn't working but the authorities kept using it anyway.
This is a really bad idea right now. The technology is just not there yet.
Why do you believe this? In the US, cops will cower outside of a school with an armed gunman actively murdering children, forcibly detain parents who wish to go in if the cops wont, and then re-elect everyone involved
In the US, an entire segment of the population will send you death threats claiming you are part of some grand (democrat of course) conspiracy for the crime of being a victim of a school shooting. After every school shooting, republican lawmakers wear an AR-15 pin to work the next day to ensure you know who they care about.
Over 50% of the country blamed the protesting students at Kent state for daring to be murdered by the national guard.
Cops can shoot people in broad daylight, in the back, with no justification, or reasonable cause, or can even barge into entirely the wrong house and open fire on homeowners exercising their basic right to protect themselves from strangers invading their homes, and as long as the people who die are mostly black, half the country will spout crap like "They died from drugs" or "they once sold a cigarette" or "he stole skittles" or "they looked at my wife wrong" while the cops take selfies reenacting the murder for laughs and talk about how terrified they are by BS "training" that makes them treat every stranger as a wanted murderer armed to the teeth. The leading cause of death for cops is still like heart disease of course.
Trump sent unmarked forces to Portland and abducted people off the street into unmarked vans and I think we still don't really know what happened there? He was re-elected.
The technology literally can NEVER be there. It is completely impossible to positively identify a bulge in clothing as a handgun. But that doesn’t stop irresponsible salesmen from making the claim anyway.
In the Menezes case the cops were playing a game of telephone that ended up with him being shot in the head.
<https://en.wikipedia.org/wiki/Killing_of_Amadou_Diallo>
Now we get the privilege of walking by AI security cameras placed in random locations, hoping they don't flag us.
There's a ton of money to be made with this kind of global frisking, so lots of pressure to roll out more and more systems.
How does this not spiral out of control?
(I suppose if I attended pro sports games or large concerts, I'd be doing it for those, too)
I started looking at people trying to decide who looked juicy to the security folks and getting in line behind them. They can’t harass two people in rapid succession. Or at least not back then.
The one I felt most guilty about, much later, was a filipino woman with a Philippine passport. Traveling alone. Flying to Asia (super suspect!). I don’t know why I thought they would tag her, but they did. I don’t fly well and more stress just escalates things, so anything that makes my day tiny bit less shitty and isn’t rude I’m going to do. But probably her day would have been better for not getting searched than mine was.
Would probably eliminate the need for the TSA security theater so that will probably never happen.
There weren't a lot of people voicing opposition to TSA's ending of the shoes off policy earlier this year.
Right from the beginning it was a handout to groups who built the scanning equipment, who were basically personal friends with people in the admin. We paid absurd prices for niche equipment, a lot of which was never even deployed and just sat in storage.
Several of the hijackers were literally given extended searches by security that day.
A reminder that what actually stopped hijackings (like, nearly entirely) was locking the cabin door, which was always doable, and has not ever been breached. Not only did this stop terrorist hijackings, it stopped more casual hijackings that used to be normal, it could also stop "inside man" style hijackings like that one with a disgruntled FedEx pilot, it was nearly free to implement, always available, harms no one's rights, doesn't turn airport security into a juicy bombing target, doesn't slow down an important part of the economy, doesn't invent a massive bureaucracy and LEO in the arms of a new american agency that has the goal of suppressing domestic problems and has never done anything useful. Keep in mind, shutting the cockpit door is literally how the terrorists themselves protected themselves from being stopped and is the reason Flight 93 couldn't be recovered.
TSA is utterly ineffective. They have never stopped an attack, regularly fail their internal audits, the jobs suck, and they pay poorly and provide minimal training.
Not even. It's that they rarely pass the audits. Many of the audits have a 90-95% "missed suspect item/s" result.
Email the state congressman and tell them what you think.
Since (pretty much) nobody does this, if a few hundred people do it, they will sit up and take notice. It takes less people than you might think.
Since coordinating this with a bunch of strangers (I.e. the public) is difficult, the most effective way is to normalise speaking up in our culture. Of course normalising it will increase the incoming comm rate, which will slowly decrease the effectiveness but even post that state, it’s better than where we are, which is silent public apathy
A friend of mine once got pulled aside for extra checks and questioning after he had already gone through the scanners, because he was waiting for me on the other side to walk to the gates together and the agent didn't like that he was "loitering" – guess his ethnicity...
I have shoes that I know always beep on the airport scanners, so if I choose to wear them I know it might take longer or I might have to embarrassingly take them off and put them on the tray. Or I can not wear them.
Yes, in an ideal world we should all travel without all the security theatre, but that's not the world we live in, I can't change the way airports work, but I can wear clothes that make it faster, I can put my liquids in a clear bag, I can have bags that make it easy to take out electronics, etc. Those things I can control.
But people can't change their skin color, name, or passport (well, not easily), and those are also all things you can get held up in airports for.
Not sure, but I bet they were looking at their feet kinda dusting off the bottoms, making awkward eye contact with the security guard on the other side of the one way door.
In fact, they will probably demonize the victim to find sn excuse why he deserved to get shot.
Also, no need to escalate this into a race issue.
https://scholar.harvard.edu/files/fryer/files/empirical_anal...
https://www.prisonpolicy.org/blog/2022/12/22/policing_survey...
Note: Precheck is incredibly quick and easy to get; and GE is time consuming and annoying, but has its benefits if you travel internationallly. Both give the same benefits at TSA.
Second note: let's pretend someone replied "I shouldn't have to do that just to be treated...blah blah" and that I replied, "maybe not, but a few bucks could still solve this problem, if it bothers you enough that's worth it to you."
Sure, can't argue with that. But doesn't it bug you just a little that (paying a fee to avoid harassment) doesn't look all that disimilar from a protection racket? As to whether it's a few bucks or many, now you're just a mark negotiating the price.
It actually doesn't! Plenty of people never fly at all and many fly incredibly rarely. The Precheck and GE programs cost money to administer as they have to do background checks and conduct interviews. This actually accomplishes actual security goals, since it allows them to flag risky behavior and examine it.
Who benefits from these programs? Primarily heavy travelers (and optimizers like me who value their time saved more than the $24 a year). These programs also actually make everything better for everyone since I'm no longer taking up a space in the slower-moving, shoes-off line, and TSA/CBP get an actual background check done on me.
The way it is now, heavy travelers who can easily afford it, pay the full costs of the program.
Would you rather:
1. Precheck is free and paid for by all taxpayers even though a lot of people will never bother to enroll (you have to assume -- the cost is so low today that it can't be a barrier for almost anyone who can afford to fly, so it seems a ton of people can't be bothered to follow simple instructions and go get fingerprinted at Staples)
2. Precheck is eliminated and everyone has to go back to the dumb liquids-out, shoes-off thing
3. Precheck is eliminated and we just treat everyone like the Precheck people today, without doing any background checks. Basically like pre-9/11.
Also my partner has told me that apparently my armpits sometimes smell of weed or beer, despite me not coming in contact with either of those for a very long time, and now I definitely don't want to get taken into a small room by a TSA person (After some googling, apparently those smells can be associated with high stress)
That ship has long sailed buddy.
No. If you're investigating someone and have existing reason to believe they are armed then this kind of false positive might be prioritizing safety. But in a general surveillance of a public place, IMHO you need to prioritize accuracy since false positives are very bad. This kid was one itchy trigger-pull away from death over nothing - that's not erring on the side of safety. You don't have to catch every criminal by putting everyone under a microscope, you should be catching the blatantly obvious ones at scale though.
How on Earth does a person walk with a concealed gun? What does a woman in a skirt with one taped to her thigh walk like? What does a man in a bulky sweatshirt with a pistol on his back walk like? What does a teenager in wide legged cargo jeans with two pistols and a extra magazines walk like?
[1]: https://www.omnilert.com/blog/what-is-visual-gun-detection-t...
Gait analysis is really good these days, but normal, small objects in a bag don't impact your gait.
Given that there's no relevant screening step here and it's just being applied to everyone who happens to be at a place it's truly incredible that such an analysis would shake out in favor of this tech. The false positive rate would have to be vanishingly tiny, and it's simply not plausible that's true. And that would have to be coupled with a pretty low false negative rate, or you'd need an even lower false positive rate to make up for how little good it's doing even when it's not false-positiving.
So I'm sure that analysis was either deliberately never performed, or was and then was ignored and not publicized. So, yes, it's a fraud.
(There's also the fact that as soon as these are known to be present, they'll have little or no effect on the very worst events involving firearms at schools—shooters would just avoid any scheme that involved loitering around with a firearm where the cameras can see them, and count on starting things very soon after arriving—like, once you factor in second order effects, too, there's just no hope for these standing up to real scrutiny)
https://www.youtube.com/watch?v=wzybp0G1hFE
What?
This case was a horrifying failure of the entire system that up until that point had fairly decent results for children who end up having to be taken away from their parents and later returned once the Mom/Dad clean up their act.
I think that’s a level of f-ed up which is so far removed from questioning AI that I wonder why people even tolerate it and somehow seem to view the premise as normal.
The cop thing is just icing on the cake.
Imagine the head scratching that's going on with execs who are surprised things might work when a probabilistic software is being used for deterministic purposes without realizing there's a gap between it kind of by nature.
I can't. The execs won't care and probably in their sadist ways, cheer.
Or am I kidding? AI is only as good as its training and humans are...not bastions of integrity...
tl;dr if you want to make a broad point, make the effort to put it in context so people can appreciate it properly.
I expect a school to be smart enough to say “Yes, this is a terrible situation, and we’re taking a closer look at the risks involved here.”
> Baltimore County Public Schools echoed the company’s statement in a letter to parents, offering counseling services to students impacted by the incident.
(Emphasis mine)
But ……
Doritos should definitely use this as an advertisement, Doritos - The only weapon of mass deliciousness, or something like that
And of course pay the kid, so something positive came come out of the experience for him
I wonder how effective an apology and explanation would have been? Just some respect.
(* see also "how to lie with statistics").
We've got a model out there now that we've just seen has put someone's life at risk... Does anyone apart from that company actually know how accurate it is? What it's been trained on? Its false positive rate? If we are going to start rolling out stuff like this, should it not be mandatory for stats / figures to be published? For us to know more about the model, and what it was trained on?
[1] https://arxiv.org/abs/1506.02640
Behold - a real life example of a "Not a hotdog" system, except this one is gun / not-a-gun.
Except the fictional one from the series was more accurate...
I thought those two things were impossible?
276 more comments available on Hacker News