Scammers use AI doctor videos to sell harmful supplements, advice

Scammers have taken their deceptive tactics to the next level by leveraging AI-generated deepfake videos of respected medical professionals. These fraudulent ads promote unproven health supplements and misinformation, preying on vulnerable individuals seeking health solutions. This alarming trend underscores the ethical and legal challenges posed by AI misuse and its implications for public health.

The Scam: AI-Generated Health Misinformation

Deepfake technology is being used to impersonate reputable health experts like Professor Jonathan Shaw and media personalities like Karl Stefanovic. These highly convincing videos promote supplements such as Glyco Balance, claiming to treat type 2 diabetes effectively.

• Products Promoted: Dietary supplements containing cinnamon, berberine, and bitter melon.
• False Claims: These ads allege that commonly prescribed medications like metformin are ineffective or unsafe, potentially endangering lives.
• Target Audience: Vulnerable individuals managing chronic conditions like diabetes.

Professor Shaw, deputy director of the Baker Heart and Diabetes Institute, became a victim when patients approached him regarding an ad falsely featuring him endorsing a supplement. He raised concerns about how these scams could erode trust in healthcare professionals and harm patients by spreading dangerous misinformation.

Rising Sophistication in AI Scams:

The surge in generative AI tools like ChatGPT has made creating realistic deepfake content easier and more accessible for scammers. Key highlights of the scam evolution include:

• Convincing Content: Videos of well-known figures endorsing products, supplemented with fake interviews, fabricated research, and false testimonials.
• Broader Impact: These scams often exploit platforms like Facebook and Instagram to reach a wide audience rapidly.
• Regulatory Challenges: Platforms struggle to identify and remove fraudulent content promptly, leaving room for harm.

Legal and Ethical Concerns:

The use of deepfakes to mimic medical professionals creates significant ethical and legal challenges:

1. Undermining Public Trust: Victims may distrust genuine medical advice after falling for scams.
2. Legal Implications: Health professionals could face reputation damage or legal entanglements due to these impersonations.
3. Regulatory Oversight: Current mechanisms, such as Australia’s Therapeutic Goods Administration (TGA), are ill-equipped to address the sheer volume and complexity of such scams.

Combating the Scams: Tools and Tips

Efforts are underway to curb AI-driven scams, but challenges persist. Some measures include:

• Facial Recognition Pilots: Meta is testing AI tools to identify and remove deepfake videos. However, this program is limited to select public figures.
• Regulatory Actions: The TGA is actively working with digital platforms to remove false therapeutic goods advertisements.
• Awareness Campaigns: Educating consumers to critically evaluate online content is crucial.

Tips to Protect Yourself:

• Verify the source of health-related claims or endorsements.
• Avoid purchasing products promoted in unsolicited ads.
• Cross-check information with credible medical authorities or government health sites.

The Bigger Picture: Ethical Use of AI

The rapid evolution of generative AI calls for urgent ethical guidelines to prevent misuse. While AI holds immense potential for good, its dark side must be addressed through global collaboration between governments, tech companies, and civil society.

Conclusion:

The misuse of AI in creating deepfake videos to promote harmful health advice is a wake-up call for stronger regulatory measures and ethical AI practices. Public awareness, combined with technological safeguards, is essential to combat this growing threat and protect individuals from falling victim to such scams.

By fostering skepticism and leveraging innovative solutions, society can counteract the misuse of AI and ensure it remains a force for good.