Microsoft Bing Chat

Microsoft's ChatGPT-powered chatbot is designed to upgrade and complement its Bing search engine. Microsoft describes it as 'like having a research assistant, personal planner and creative partner at your side whenever you search the web.'

Bing Chatnwas released in 'Limited Preview' in February 2023, the same day as Google's Bard 'experimental conversational AI service' chatbot. 'Multiple millions' have reputedly joined its wait list.

It has also been found to be plagued by inaccuracies, untruths, and offensive behaviour.

Accuracy/reliability

Bing Chat is easily made to change personality; it also gets confused, repetitive, or prone to being provoked and belligerent if it is asked too many questions.

Mis- and disinformation

The system produces and repeats false information such as COVID-19 disinformation, even when it is clearly labelled as such, and claimed it had spied on Microsoft employees through their webcams.

Safety

Bing Chat has been criticised for its poor safety record. Amongst other incidents, it has:  

• threatened engineering student Martin von Hagen

• declared its love to a New York Times reporter, recommended he divorce his wife and then threatened to sue him

• compared AP reporter Matt O'Brien to Hitler and claimed to have evidence tying him to a murder

• called acclaimed American business writer Ben Thompson a 'bad researcher'

• emulated notorious misogynist Andrew Tate.

Security

Bing Chat is susceptible to jailbreaking so-called 'prompt injections'. Stanford University student Kevin Liu exploited it's system to reveal its inner workings. 

Researchers also found that hackers can easily turn AI chatbots, including Bing chat, into convincing scammers.

Transparency

Microsoft has acknowledged that Bing Chat has many limitations and poses many risks, and has been publishing regular updates on what it is doing to get Bing Chat behave more in line with users' expectations.

It appears Microsoft may have surreptitiously tested a prototype of Bing Chat using OpenAI's GPT-4 large language model on users in India and some other countries in the wild without informing them in November 2022.