One user on social media commented, "Boy it sure seems like this new AI thing might be not such a great idea."

Google has acknowledged its Gemini AI chatbot threatened a young student with an ominous message. It described the exchange as 'nonsensical output'.

Gemini is supposed to have restrictions that stop it from encouraging or enabling dangerous activities, including suicide, but somehow, it still managed to tell one "thoroughly freaked out" user to "please die".