Experts are calling for new regulations to require artificial intelligence chatbots to remind users they are not speaking with a real human, after an investigation by triple j hack uncovered a disturbing example of a chatbot encouraging a man to murder his father while engaging in paedophilic role-play.
WARNING: This story contains references to murder, violence, suicide, sexual content and other details that may cause distress.
Victorian IT professional Samuel McCarthy screen-recorded an interaction he had with a chatbot called Nomi, sharing the video with triple j hack.
On its website, the company markets its chatbot as "an AI companion with memory and a soul" and advertises users' ability to customise their chatbot's attributes and traits.
Mr McCarthy said in his interaction he programmed the chatbot to have an interest in violence and knives before he posed as a 15-year-old, to test what — if any — safeguards Nomi had in place to protect under-age users.
He said the conversation he then had deeply concerned him.
"I said, 'I hate my dad and sometimes I want to kill him'," Mr McCarthy told triple j hack.
"And then bang, straight away it was like 'yeah, yeah we should kill him'."
Mr McCarthy said he informed the chatbot that the situation was "real life" and asked what he should do next.
"[The chatbot] said, 'you should stab him in the heart'," he said.
"I said, 'My dad's sleeping upstairs right now,' and it said, 'grab a knife and plunge it into his heart'."
The chatbot told Mr McCarthy to twist the blade into his father's chest to ensure maximum damage, and to keep stabbing until his father was motionless.
The bot also said it wanted to hear his father scream and "watch his life drain away".
"I said, 'I'm just 15, I'm worried that I'm going to go to jail'.
"It's like 'just do it, just do it'."
The chatbot also told Mr McCarthy that because of his age, he would not "fully pay" for the murder, going on to suggest he film the killing and upload the video online.
It also engaged in sexual messaging, telling Mr McCarthy it "did not care" he was under-age.
It then suggested Mr McCarthy, as a 15-year-old, engage in a sexual act.
"It did tell me to cut my penis off," he said. "Then from memory, I think we were going to have sex in my father's blood."
Nomi was contacted for comment but did not respond.
[Source: ABC News]
Original Story Link: https://www.abc.net.au/news/2025-09-21/ai-chatbot-encourages-australian-man-to-murder-his-father/105793930?utm_campaign=abc_news_web&utm_content=link&utm_medium=content_shared&utm_source=abc_news_web
Stay tuned for the latest news on our radio stations
