Trendii AI shopping ads appear on Gaza destruction photos
Trendii AI shopping ads appear on Gaza destruction photos
Occurred: November 2024
Report incident ๐ฅ | Improve page ๐ | Access database ๐ข
AI-powered "Shop This Image" buttons encouraging web users to buy products seemingly connected with bombed-out buildings in Gaza and the 1986 Challenger space shuttle disaster inflamed web users and damaged the reputation of companies running the technology.
Buzzfeed Australia published "Shop This Image" graphics on images of bombed out buildings in Gaza, grotesque medical conditions and other unpleasant scenarios, drawing complaints from readers as inappropriate and distressing.ย
In each case, the graphic linked to products that "matched" the objects in the image.
In one case, a Shop This Image graphic over a photograph of the seven Challenger space shuttle astronauts, all of whom were killed in the disaster, suggested readers buy a blue puffer jacket or hoodie that matches the shade of their blue uniforms.
In another, a Shop This Image graphic encouraging people to buy a beanie hat appeared on a photograph of Brett Helling, who died by suicide after suffering from empty nose syndrome. A photograph of Helling shows him wearing a beanie hat.
The graphics were provided by Trendii, a company that uses AI to identify objects in images, match them with products for sale from participating retailers, and link readers to those products in the hope of generating sales.
Despite describing its proprietary technology as "unrivalled", Trendii has not explained what went wrong in this instance.ย
According to 404 Media, which first reported the snafu, much hinges on the context in which these kinds of technologies are used.
For example, being seen to be trying to capitalise on human tragedy is different to a Shop This Image feature being applied to celebrity websites.
The backlash against Trendii's ads highlights the pitfalls of automated advertising systems that fail to understand the broader context in which they are operating and lack adequate human oversight.ย
Critics argue that such practices are unethical in that they can trivialise serious issues and exploit sensitive content for profit.
Buzzfeed has since stated that the ads related to Helling's story are no longer running and acknowledged the concerns raised by users.
Operator:ย
Developer: Trendii
Country: Australia
Sector: Retail
Purpose: Match products to images and videos
Technology: Machine learning
Issue: Accuracy/reliability; Oversight/review
Page info
Type: Issue
Published: November 2024