Men's Journal AI journalism
Occurred: February 2023
The first AI-generated article published by Men's Journal has been found to be full of factual inaccuracies. The article 'What All Men Should Know About Low Testosterone' set forth multiple medical claims and advice, including recommending testosterone replacement therapy.
However, medical expert Bradley Anawalt told Futurism that it contained 18 distinct errors, from basic factual mistakes and unsupported claims to sweeping mischaracterisations of medical science. The article was swiftly re-written and the disclosure removed, though no mention of its first incarnation and its mistakes is visible.
Each Men's Journal AI article has a disclosure at the top of the page stating 'This article is a curation of expert advice from Men’s Fitness, using deep-learning tools for retrieval combined with OpenAI’s large language model for various stages of the workflow. This article was reviewed and fact-checked by our editorial team.'
Days before, Men's Journal owner Arena Group had said it was partnering with AI companies Nota and Jasper 'to speed and broaden its AI-assisted efforts in content workflows, video creation, newsletters, sponsored content, and marketing campaigns.'
Announcing the partnerships, Arena Group CEO Ross Levinsohn told the Wall Street Journal 'It’s not about ‘crank out AI content and do as much as you can.' 'Google will penalize you for that and more isn’t better; better is better.'
Arena Group bought Men's Journal in December 2022. The Journal thought to have three full-time employees. Arena also owns Sports Illustrated and other brands.
The incident comes weeks after CNET was revealed to have been quietly publishing AI-generated articles, some of which also turned out to be factually incorrect.
Operator: Arena Group/Men's Journal
Developer: Arena Group/Men's Journal; OpenAI; Jasper
Purpose: Automate journalism
Technology: Large language model (LLM); NLP/text analysis; Neural networks; Deep learning; Machine learning
Issue: Accuracy/reliability; Mis/disinformation
Transparency: Governance; Marketing
News, commentary, analysis
Published: February 2023