Trendii AI shopping ads appear on Gaza destruction photos

Occurred: November 2024

Report incident ๐Ÿ”ฅ | Improve page ๐Ÿ’ | Access database ๐Ÿ”ข

AI-powered "Shop This Image" buttons encouraging web users to buy products seemingly connected with bombed-out buildings in Gaza and the 1986 Challenger space shuttle disaster inflamed web users and damaged the reputation of companies running the technology.

What happened

Buzzfeed Australia published "Shop This Image" graphics on images of bombed out buildings in Gaza, grotesque medical conditions and other unpleasant scenarios, drawing complaints from readers as inappropriate and distressing.ย 

In each case, the graphic linked to products that "matched" the objects in the image.

In one case, a Shop This Image graphic over a photograph of the seven Challenger space shuttle astronauts, all of whom were killed in the disaster, suggested readers buy a blue puffer jacket or hoodie that matches the shade of their blue uniforms.

In another, a Shop This Image graphic encouraging people to buy a beanie hat appeared on a photograph of Brett Helling, who died by suicide after suffering from empty nose syndrome. A photograph of Helling shows him wearing a beanie hat.

The graphics were provided by Trendii, a company that uses AI to identify objects in images, match them with products for sale from participating retailers, and link readers to those products in the hope of generating sales.

Why it happened

Despite describing its proprietary technology as "unrivalled", Trendii has not explained what went wrong in this instance.ย 

According to 404 Media, which first reported the snafu, much hinges on the context in which these kinds of technologies are used.

For example, being seen to be trying to capitalise on human tragedy is different to a Shop This Image feature being applied to celebrity websites.

What it means

The backlash against Trendii's ads highlights the pitfalls of automated advertising systems that fail to understand the broader context in which they are operating and lack adequate human oversight.ย 

Critics argue that such practices are unethical in that they can trivialise serious issues and exploit sensitive content for profit.

Buzzfeed has since stated that the ads related to Helling's story are no longer running and acknowledged the concerns raised by users.

System ๐Ÿค–


Operator:ย 
Developer: Trendii
Country: Australia
Sector: Retail
Purpose: Match products to images and videos
Technology: Machine learning
Issue: Accuracy/reliability; Oversight/review