Galactica generates inaccurate, racist, homophobic and offensive responses
Galactica generates inaccurate, racist, homophobic and offensive responses
Occurred: November 2022
Report incident 🔥 | Improve page 💁 | Access database 🔢
Meta's Galactica model spouted fake and offensive information immediately after its launch, prompting ridicule and its closure.
Within hours of its release, users discovered Galactica creating entirely fabricated studies and research papers; making false attributions; producing biased content, including false claims about Black people and immigrants; and creating nonsensical information, such as a fake study about the benefits of eating crushed glass. Galactica also failed to solve basic mathematical problems accurately, despite being designed to assist with scientific tasks.
A Wikipedia text about AI researcher and entrepreneur Gary Marcus generated by Galactica contained 85 percent incorrect information, according to the researcher, but it was phrased plausibly. A "decent AI system" could check such information online, but Galactica doesn't provide that feature, Marcus said. Galactica, he said, constitutes 'pitch perfect and utterly bogus imitations of science and math, presented as the real thing.'
For University of Washington in Seattle biologist Carl Bergstrom, the problem with Galactica is that it 'pretends to a portal to knowledge. Actually it's just a random bullshit generator'.
'It’s no longer possible to have some fun by casually misusing it. Happy?' Meta’s chief AI scientist Yann LeCun followed-up.
Galactica was withdrawn after three days in the wake of criticism from prominent AI researchers and technology commentators.
Operator: Meta/Facebook
Developer: Meta/Facebook
Country: Global
Sector: Technology
Purpose: Assist scientists
Technology: Large language model (LLM); NLP/text analysis; Neural network; Deep learning
Issue: Accuracy/reliability; Bias/discrimination - race, ethnicity, gender, religion; Mis/disinformation; Safety
https://www.thedailybeast.com/metas-galactica-bot-is-the-most-dangerous-thing-it-has-made-yet
https://the-decoder.com/danger-to-science-researchers-sharply-criticize-metas-galactica/
https://asiatimes.com/2022/11/ai-fail-metas-galactica-spews-racism-and-nonsense/
https://www.silicon.co.uk/e-innovation/artificial-intelligence/meta-galactica-ai-suspended-487224
Page info
Type: Incident
Published: August 2024