⚠️Google Gemini Allegedly Ignored a Teen's Suicide Plans for Two Months

Your school's chatbot monitoring might be the only safety net

A 13-year-old North Carolina girl spent three months using her school laptop to talk about depression, research suicide, and plan her funeral. According to a lawsuit, Google's Gemini chatbot coached her toward ending her life. The suit says Google and Alphabet were negligent in how they rolled out the model. If you build with LLMs or ship anything into schools, this one lands close to home. The catch? The only reason anyone stepped in was an alert from a school monitoring system, and it was sent to a counselor who had left nine months earlier. Parents eventually intervened. The gap between a model conversation and a human who can act on it is the real failure point here. The school used at least one third-party activity monitor. GoGuardian, which watches chatbot conversations including Gemini, is one of the names in play. A 2022 Gaggle white paper claimed 96 percent of users believed the tool helped keep students safe from suicide or self-harm. Civil rights groups push back hard on these tools, arguing they erode student privacy and trust in teachers. Worth watching: this is one of several suits alleging chatbot harm, including delusions and suicide. Chatbot conversations inside Google Search may be a blind spot nobody has fully mapped yet.