White House health report "riddled" with AI errors
White House health report "riddled" with AI errors
Occurred: May 2025
Page published: May 2025
Report incidentš„| Improve page š| Access database š¢
A White House report on the decline in Americansā life expectancy has been widely criticised for containing numerous citation errors, fabricated studies and signs of AI-generated content, undermining its scientific credibility.
Led by Health and Human Services Secretary Robert F. Kennedy Jr., the White Houseās āMake America Healthy Againā (MAHA) report was filled with citation errors, duplicated references, incorrect author attributions, and references to studies that do not exist, according to investigations by NOTUS, The Washington Post and other news publications.Ā
At least seven cited studies were entirely fabricated, and some URLs included markers such as āoaicite,ā which is commonly added by OpenAIās AI systems. The report also misinterpreted or misrepresented real studies, further eroding trust in its findings.
The errors are seen to have significant potential harms: policymakers, healthcare professionals, and the public may be misled by inaccurate or nonexistent data, thereby resulting in flawed policy decisions or public health initiatives.
Experts and analysts have identified clear evidence that artificial intelligence - likely tools like OpenAIās ChatGPT - was used to generate or supplement the reportās references and citations. AI systems are known to āhallucinateā or invent sources, blend real and fake information, and make formatting errors, which explains many of the reportās issues.Ā
The White House and US Department of Health and Human Services attributed the errors to āformatting issues,ā but independent experts and journalists have pointed to AI as the primary cause. The rapid compilation of the report - completed in just over three months - and a lack of thorough review before publication likely contributed to the oversight.
The incident raises concerns about the governmentās commitment to evidence-based health policy and the transparency of its processes, as well as the risks of over-reliance on AI in scientific and government reporting.Ā
Society may become more skeptical of government health reports and AI-generated information, potentially reducing trust in official sources of public health guidance.
Developer: OpenAI
Country: USA
Sector: Health
Purpose: Generate academic citations
Technology: Generative AI; Machine learning
Issue: Accuracy/reliability; Mis/disinformation; Transparency
https://www.notus.org/health-science/make-america-healthy-again-report-citation-errors
https://www.washingtonpost.com/health/2025/05/29/maha-rfk-jr-ai-garble/Ā
https://newrepublic.com/post/195910/robert-f-kennedy-jr-maha-report-fake-studies-ai
https://www.theverge.com/news/676945/rfk-jr-maha-health-report-ai-slop
AIAAIC Repository ID: AIAAIC2002