One user on social media commented, "Boy it sure seems like this new AI thing might be not such a great idea."

Google’s AI chatbot Gemini gave a threatening response to a Michigan college student, telling him to “please die.” The artificial intelligence program and the student, Vidhay Reddy, were engaging in a back-and-forth conversation about aging adults and their challenges.

WARNING: Graphic Content. The chatbot was responding to an innocent true or false question about the number of households in the US led by grandparents.

Vidhay Reddy, a graduate student from Michigan, received a chilling response from Google’s Gemini Artificial Intelligence (AI) chatbot while discussing challenges faced by older adults on Nov. 13. According to the company,

Gemini is supposed to have restrictions that stop it from encouraging or enabling dangerous activities, including suicide, but somehow, it still managed to tell one "thoroughly freaked out" user to "please die".

Google Gemini AI chatbot told a student to 'please die' when he asked for help with his homework. Here's what Google has to say.

Google’s flagship AI chatbot, Gemini, has written a bizarre, unprompted death threat to an unsuspecting grad student. Twenty-nine-year-old Vidhay Reddy was deep into a back-and-forth homework session with the AI chatbot when he was told to “please die”.