An algorithm used by Twitter to crop photos and other images on user timelines came under fire for perceived gender and racial bias.

The company's 'saliency' algorithm decided how images would be cropped in Twitter previews. However, researcher Bogdan Kulynyc discovered that the algorithm preferred to show faces that were slimmer, younger, and with lighter skin, and seemed to favour stereotypically feminine facial traits.

Kulynyc also discovered that the “saliency” of a face in an image could be increased, making it less likely to be hidden by the cropping algorithm, by making the person’s skin lighter or warmer and smoother.

Earlier, Twitter’s own research had found the algorithm had a bias towards cropping out black faces. When two faces were in the same image, the preview crop appeared to favour white faces, hiding the black faces until users clicked through.

The company also said the algorithm produced an "objectification" bias that focused on a woman's chest or legs, described as "male gaze." 

Twitter’s own subsequent analysis showed a "4 percent difference from demographic parity, in favor of white individuals".

In response, Twitter decided to scrap the image-cropping system; Twitter’s then director of software engineering, Rumman Chowdhury, stated that "how to crop an image is a decision best made by people". 

This controversy highlighted the challenges and potential pitfalls of using algorithms in social media platforms and the importance of continually testing and refining these systems to ensure they are fair and unbiased.

Research, advocacy 🧮

• https://twitter.com/hiddenmarkov/status/1424472328197525505

• https://github.com/bogdan-kulynych/saliency_bias

• https://hackerone.com/h1c-twitter-algorithmic-bias

• https://github.com/twitter-research/image-crop-analysis

Timeline ⏰

• 2018. Twitter deploys saliency-based cropping algorithm.​

• September 2020. Users report it cropping out Black faces in mixed-race photos.​

• May 2021. Twitter audit confirms racial/gender biases; the company begins phasing out algorithm, starting with its mobile apps.

• August 2021. HackerOne contest reveals age, weight, skin tone biases; Twitter scraps it fully, stating cropping is "best made by people."

News, commentary, analysis 🗞️

• https://www.wired.com/story/twitters-photo-cropping-algorithm-favors-young-thin-females/

• https://www.cnet.com/tech/mobile/twitter-offers-bug-bounty-to-spot-and-fix-ai-bias-in-its-algorithms/

• https://www.cnet.com/tech/mobile/twitter-ai-bias-contest-shows-beauty-filters-hoodwink-the-algorithm/

• https://www.theguardian.com/technology/2021/aug/10/twitters-image-cropping-algorithm-prefers-younger-slimmer-faces-with-lighter-skin-analysis

• https://www.msn.com/en-us/money/other/twitter-e2-80-99s-photo-cropping-algorithm-prefers-young-beautiful-and-light-skinned-faces/ar-AAN93Wf

• https://www.msn.com/en-us/money/other/twitter-e2-80-99s-racist-algorithm-is-also-ageist-ableist-and-islamaphobic-researchers-find/ar-AAN7cV5

• https://www.marktechpost.com/2021/08/10/twitter-algorithmic-bias-challenge-winner-finds-beauty-filters-can-fool-twitters-ai/