Google’s Gemini threatened one user (or possibly the entire human race) during one session, where it was seemingly being used to answer essay and test questions, and asked the user to die. Because of its seemingly out-of-the-blue response, u/dhersie shared the screenshots and a link to the Gemini conversation on r/artificial on Reddit.

First true sign of AGI – blowing a fuse with a frustrating user? When you're trying to get homework help from an AI model like Google Gemini, the last thing you'd expect is for it to call you "a stain on the universe" that should "please die,

A graduate student in the U.S. was left horrified after Google's AI chatbot, Gemini, responded to a query about elderly care with shocking and harmful comments, including telling him to "Please die." Google acknowledged the incident,