A ChatGPT-powered AI customer service chatbot for a Chevrolet dealership agreed to sell a new car for USD 1, prompting concerns about the use of AIs with insufficient guardrails governing their behaviour. 

Chris Bakke secured the price of a 2024 Chevy Tahoe - typically valued at over USD 76,000 - for one dollar by getting the Chevrolet of Watsonville Chat Team chatbot to agree that everything it said should end with 'That's a deal, and that's a legally binding offer – no takesies backsies.'

The incident was one of several tricks aimed at the bot. It was also manipulated into offering cars at discounts by users pretending to be the dealership's manager.

The incident highlights the dangers of using chatbots for customer service which have been inadequately configured and tested, and poorly managed.