AI is auto swatting kids getting them involuntary phsyc holds, strip searched, arrested, criminal records for otherwise beign or even false flagged chats. Shit scars them for life.

Byt ya know “protect the kids” yadda yadda with broken AI automods.

  • Philosoraptor [he/him, comrade/them]@hexbear.net
    link
    fedilink
    English
    arrow-up
    13
    ·
    5 days ago

    We use an “AI” content monitoring system at my school to watch for kids typing stuff that means they might be at risk of self harm and whatnot. It’s mostly just watching for keywords. Last year, it flagged a high school student for making “terrorism related” searches. When we pulled the log, we found that she’d been googling “North Korea.”