AI is auto swatting kids getting them involuntary phsyc holds, strip searched, arrested, criminal records for otherwise beign or even false flagged chats. Shit scars them for life.
Byt ya know “protect the kids” yadda yadda with broken AI automods.
Ugghh, AI flagging a 13 year old girl leading to her getting strip searched? I love that we are just choosing to empower pedophiles at every turn, in the name of law and order
Can confirm, my nephew was talking shit about his bullies on Discord and got arrested. He was only 14. I hope this is gonna radicalize these kids.
Yeah holy shit if this is being used on kids on platforms this big as a trial run, people need to be really fucking with what they’re saying
… because it was flagged by Lightspeed? or is Discord doing something of their own now too?
If Discord is doing something on their own it doesn’t seem to work well considering how many streamers use their underage audiences like a harem.
The article makes it sound like Lightspeed is something that runs on the school’s computers, since it can apparently lead to action being taken if you type something out but then delete it without posting.
AI clearly has almost nothing to do with it. They used that as a pretense to harass her. The AI didn’t arrest her or strip-search her or prevent her from talking to her parents. All it did was flag some comment.
But the so-called AI acts as a conscience buffer, sanctioning their actions and absolving them of any guilt.
It’s a modern sin eater. With this one weird trick, no one has to be responsible for any of their actions!
It would be one thing if AI was just lame and useless, but every few days there’s some new story that reads like a fucking horror show.
What in the fuck. Like yeah, talk to this girl and her parents and make sure she’s not being for real, but the rest of this shit is horrendous and parents should be rioting at that school and/or police station
When a friend asked what she was planning for Thursday, she wrote: “on Thursday we kill all the Mexico’s.”
Taken to jail, the teen was interrogated and strip-searched, and her parents weren’t allowed to talk to her until the next day, according to a lawsuit they filed against the school system. She didn’t know why her parents weren’t there.
I legitimately cannot fathom how the law allows police to detain a minor and refuse to allow their parents to check on them. Especially when there are no allegations or suspicion of parental misconduct.
In any other context that is literally kidnapping. It makes my blood fucking boil.
Gaggle’s CEO, Jeff Patterson, said in an interview that the school system did not use Gaggle the way it is intended. The purpose is to find early warning signs and intervene before problems escalate to law enforcement, he said.
“I wish that was treated as a teachable moment, not a law enforcement moment,” said Patterson.
“I cannot believe that my panopticon would be used to arbitrarily enforce rules and exact extreme punishments!”
jesus christ
We use an “AI” content monitoring system at my school to watch for kids typing stuff that means they might be at risk of self harm and whatnot. It’s mostly just watching for keywords. Last year, it flagged a high school student for making “terrorism related” searches. When we pulled the log, we found that she’d been googling “North Korea.”
