GPT-4o generation of realistic fake receipts raises scam concerns
GPT-4o generation of realistic fake receipts raises scam concerns
Occurred: April 2025
Report incident 🔥 | Improve page 💁 | Access database 🔢
OpenAI's GPT-4o created hyper-realistic fake receipts, raising alarms about its potential misuse in financial scams and undermining verification systems.
The updated model’s image generator can produce receipts with realistic text, wrinkles, stains, and background details, making them nearly indistinguishable from genuine ones.
Examples include fabricated bills from real restaurants like San Francisco’s Epic Steakhouse, complete with itemised purchases and totals. While minor errors (eg. comma-decimal confusion, arithmetic mistakes) persist, these can be easily corrected with basic editing tools.
The risks span fraudulent expense reimbursements, bogus tax deductions, fabricated crowdfunding claims, and forged financial records. Systems relying on receipts for verification - such as workplace reimbursement platforms, gig economy apps, and online marketplaces - are considered particularly vulnerable.
The technical leap stems from ChatGPT-4o’s improved ability to render text within images, a feature intended for creative applications like educational content or advertising.
However, users quickly exploited this capability for malicious purposes, sharing prompt templates and refining outputs to enhance authenticity.
Businesses may face increased fraud costs, while individuals could be deceived into reimbursing fake expenses or donating to scams.
Erosion of trust in digital verification systems, potential regulatory pressures on AI developers, and accelerated arms races between fraudsters and detection tools.
OpenAI has noted that generated images include metadata identifying their AI origin and that policy violations are addressed. However, critics argue this fails to mitigate risks, as metadata can be stripped or ignored in manual review processes.
GPT-4o 🔗
Operator:
Developer: OpenAI
Country: USA
Sector: Retail
Purpose: Create images
Technology: Generative AI; Machine learning
Issue: Authenticity; Dual/multi-use
Page info
Type: Issue
Published: April 2025