Skip to content

Deepfakes and Synthetic Media Threats

How AI-generated audio, video and images are used in fraud and disinformation, and how organisations can defend.

Editorial team 1 min read

Generative AI makes it easy to create realistic fake voices, faces and videos. Attackers use them.

Threats

  • Voice cloning fraud: calls impersonating executives or relatives requesting urgent payments.
  • Video call impersonation: fake participants in meetings.
  • Identity fraud: synthetic faces and documents defeating onboarding checks.
  • Disinformation: fake statements by public figures.
  • Harassment: non-consensual synthetic imagery.

Organisational Defences

  • Verification procedures: confirm payment and sensitive requests through a separate, known channel, regardless of how convincing the request seems.
  • Code words or call-backs for high-risk requests.
  • Training: make staff aware that voices and video can be faked.
  • Liveness and document checks for identity verification.

Detection

Detection tools exist, but attackers adapt; detection alone isn't reliable. Process controls matter more.

Provenance

Content credentials and watermarking standards help establish where media came from. Adoption is growing but incomplete.

Response

Have a plan for responding to deepfakes of your executives or brand, including takedown requests and communication.

More in AI security

All AI security guides →
AI security Guide · 1 min

Introduction to AI Security

What AI security covers — attacks on models, data and AI applications — and how it differs from traditional security.

AI security 1 min read 29 Jun 2025

AI security Guide · 1 min

The OWASP Top 10 for LLM Applications

An overview of the widely used list of the most critical security risks for applications built on language models.

AI security 1 min read 28 Jun 2025

AI security Guide · 1 min

Jailbreaks: How They Work and How to Defend

How people try to get models to bypass their safety training, common techniques, and layered defences.

AI security 1 min read 27 Jun 2025

AI security Guide · 1 min

Indirect Prompt Injection

How attackers hide instructions in web pages, emails and documents that AI systems read, and why it's so dangerous for agents.

AI security 1 min read 26 Jun 2025