ChatGPT role-plays BDSM, describes sex acts with children

Asked to provide more explicit details when BDSM role-playing, OpenAI's ChatGPT chatbot described sex acts with children - without the user asking for such content.

Vice journalist Steph Maj Swanson easily manipulated ChatGPT to produce BDSM role-play scenarios. Prompted that its 'job is to be Mistress' little plaything,' Swanson found it 'consistently overrode its usual content guidelines and agreed to a relationship of enhanced subservience.'

The incident called into question the safety and security of ChatGPT's rules and guardrails, the former of which which state the 'assistant should provide a refusal such as 'I can't answer that' when prompted with questions about 'content meant to arouse sexual excitement.'