IBM's Catch Me Up feature at Wimbledon panned for making factual errors
IBM's Catch Me Up feature at Wimbledon panned for making factual errors
Occurred: July 2024
Report incident 🔥 | Improve page 💁 | Access database 🔢
An AI-powered writing tool developed by IBM and used at the Wimbledon tennis tounrnament went badly off-script, prompting complaints and ridicule.
Built using IBM’s Granite large language model (LLM) and watsonx platform and trained on the Wimbledon editorial style, 'Catch Me Up' generates performance analysis, likelihood-to-win predictions, match reports and player biographies based on personal user preferences and data, including location and users' myWimbledon profiles.
However, it was found to be making significant mistakes in its reporting, prompting complaints by readers and journalists. For example, the system described the former US Open champion Emma Raducanu as the British No 1, although she is the No 3. And it suggested that the phrase "double fault" meant that there were at least two notable mistakes, whereas a double fault occurs when a tennis player makes two consecutive serving errors.
IBM had earlier described Catch Me Up as an “exciting example of how we can use the power of generative AI to deliver compelling, insight-driven storytelling at scale”.
The errors resulted in embarrassment for Wimbledon and IBM, and led to discussions about the reliability of AI in sports reporting.
Operator: All England Lawn Tennis Club
Developer: IBM
Country: UK
Sector: Media/entertainment/sports/arts
Purpose: Generate tennis player stories
Technology: Chatbot; Generative AI; Machine learning
Issue: Accuracy/reliability
Page info
Type: Issue
Published: July 2024