Galactica generates inaccurate, racist, homophobic and offensive responses
Occurred: November 2022
Report incident 🔥 | Improve page 💁 | Access database 🔢
Meta's Galactica model spouted fake and offensive information immediately after its launch, prompting ridicule and its closure.
Within hours of its release, users discovered Galactica creating entirely fabricated studies and research papers; making false attributions; producing biased content, including false claims about Black people and immigrants; and creating nonsensical information, such as a fake study about the benefits of eating crushed glass. Galactica also failed to solve basic mathematical problems accurately, despite being designed to assist with scientific tasks.
A Wikipedia text about AI researcher and entrepreneur Gary Marcus generated by Galactica contained 85 percent incorrect information, according to the researcher, but it was phrased plausibly. A "decent AI system" could check such information online, but Galactica doesn't provide that feature, Marcus said.