Skip to main content
Neural Defend

What Is Manipulated Media? Types, Digital Forgeries and How to Check

Manipulated media is an image, video, audio clip or document that has been altered so it shows or implies something different from what was captured. The change can be AI-driven, like a face swap or cloned voice, or simple, like a slowed clip, a splice or a false caption. Deepfakes are one subset. Neural Defend's NeuroDetect localizes signal-level edits for investigators.

Organization authorNeural Defend Editorial
Updated April 8, 2025
Siva Shankar, Co-founder and CTO of Neural Defend.
Siva ShankarCo-founder & CTO
Conservation table shows one media source subjected to several different manipulations.

What Is Manipulated Media, and How Is It Different From a Deepfake?

Manipulated media is content whose meaning was changed after capture or generation. The test is the effect on the viewer: if an edit makes a recording show an event, a statement or a person differently from how it happened, the media is manipulated. Routine work such as colour correction, noise reduction or a crop that keeps the scene intact usually does not qualify.

A deepfake is the AI-built subset. The EU AI Act (Article 3(60)) defines a deep fake as AI-generated or manipulated image, audio or video that resembles real people, objects, places or events and would falsely appear authentic. Plenty of manipulated media involves no AI at all. The U.S. Department of Homeland Security's 2021 paper Increasing Threats of Deepfake Identities notes that audio tape could be cut and spliced to change a recording's meaning long before machine learning, and it describes cheapfakes as simple digital edits, such as slowed speech or accelerated video, that alter how an event is perceived.

The difference matters for the response. A cheapfake built from a genuine clip often has no synthesis traces for a detector to find, so the evidence that exposes it is the original footage. A face swap or cloned voice may carry generator traces even when the context looks plausible.

What Are the Main Types of Manipulated Media?

Manipulation techniques fall into a handful of families. Each changes a different part of the file, and each needs a different check.

Signal-level techniques alter the content itself: a swapped or reenacted face, a cloned or converted voice, an inpainted object, a composite of two photos, or audio stitched from several recordings. Presentation-level techniques leave the pixels mostly alone and change the frame around them: a clip trimmed to remove the answer to a question, footage slowed to make a speaker sound impaired, an old photo reposted with a new date, or a genuine file attached to a false claim.

TechniqueWhat changesTypical exampleCheck that helps most
Face swap or reenactmentIdentity or expression in video or imageExecutive's face on an impostor in a video callForensic detection, live challenge, callback on a known number
Voice cloning or conversionSpeaker identity in audioRelative's voice asking for urgent moneyAudio deepfake detection, shared code word
Inpainting and compositingObjects or people added or removedDamage added to a claims photoRegion-level forensic analysis, earlier copies
Audio or video splicingOrder or content of speechTwo sentences joined into one admissionWaveform and frame continuity, full original recording
Speed and timing editsPace, duration, sequenceSpeech slowed to sound slurredComparison with source footage
Miscaptioning and recontextualizationClaimed date, place or meaningOld disaster photo shared as today's eventReverse image search, metadata, eyewitness records
Common manipulation techniques, what they change and the check that usually exposes them.

What Is a Digital Forgery?

A digital forgery is a fabricated or altered digital artifact presented as genuine so that it misleads about its origin, content or meaning. The DHS Science and Technology Directorate's Digital Forgeries Report, dated 24 January 2023 and the first of five annual assessments required by the FY2021 National Defense Authorization Act, describes digital content forgery technologies as tools that fabricate or manipulate audio, visual or text content with the intent to mislead. It calls deepfakes a subset of digital forgeries created through machine learning.

The forgery frame is wider than media. A real photo can travel with fabricated EXIF data, a generated portrait can anchor a fake profile, and a genuine voice note can sit inside a forged chat history. The same report covers face morphing, where two faces are blended into one passport-style photo that both people can match, as an identity-document problem. Investigators therefore separate the file, the metadata, the account, the message thread and the claimed identity, and test each layer on its own. One authentic layer does not vouch for the others.

Intent is the other dividing line. Manipulated media describes what was done to the content. Calling something a forgery adds a claim about deception, which usually needs evidence beyond the file, such as who sent it and what they asked for.

Evidence layers including a media file, metadata, account record and message history laid out separately for inspection.

How Is Manipulated Media Used for Fraud and Deception?

The most expensive documented case involved a fully fabricated video call. In January 2024 a finance employee at the engineering firm Arup in Hong Kong joined a call with what appeared to be the company's chief financial officer and other colleagues, all of them deepfake recreations, according to Hong Kong police. The employee made 15 transfers totalling HK$200 million, about US$25.6 million. Arup confirmed to CNN in May 2024 that fake voices and images were used.

The FBI's Internet Crime Complaint Center listed the broader pattern in a public service announcement on 3 December 2024: generated profile photos for romance and investment scams, forged driver's licences and banking credentials, fabricated disaster imagery for fake charity appeals, cloned voices of relatives in staged emergencies, and real-time video chats impersonating executives or police.

Human judgement does not close the gap. In a pre-registered experiment published in iScience in November 2021, Nils Köbis and colleagues found 210 participants identified deepfake videos with 57.6% accuracy, barely above chance. Participants labelled 67.4% of the videos authentic although half were fake, and the least accurate people were the most confident.

How Do You Check Whether Media Has Been Manipulated?

Work backwards from the circulating copy toward the original, and record each step so someone else can repeat it. The sequence below suits a newsroom, a fraud team or an HR investigation.

When you write up the result, name the change you can support, such as an inserted region, a splice at 00:41 or a caption that does not match the earliest upload. Leave the production method and the motive open unless separate evidence settles them. A report that says the available copy contains an altered region will survive scrutiny better than one that calls the whole item fake.

  • Preserve the file as received, with its URL, sender, timestamps and any message that came with it, before it is deleted or re-encoded.
  • Search for earlier copies with reverse image search or keyframe search and note the oldest reliable upload.
  • Compare the circulating version with the source frame by frame or waveform by waveform to find cuts, speed changes or added material.
  • Inspect provenance: C2PA Content Credentials where present, EXIF and container metadata, and platform upload records.
  • Run forensic analysis on the best-quality copy you can obtain, and record the tool, model version and score.
  • Corroborate the event or statement with records that did not arrive in the same message chain.

Where Does Automated Detection Help, and Where Does It Fall Short?

Forensic detectors earn their place on signal-level manipulation. Face swaps, generated faces, inpainted regions and synthetic speech leave statistical traces that software can measure even when a person sees nothing wrong. A good tool also localizes the evidence, which turns a vague suspicion into a specific region or segment an analyst can examine.

Detection has hard limits on the presentation layer. An unedited clip with a false caption is, at the pixel level, authentic, so no classifier will flag it; only the source record shows the lie. Re-encoding and resizing on messaging apps also erode the fine traces detectors depend on. Deepfake-Eval-2024 (arXiv 2503.02857), built from deepfakes that circulated in 2024, found open-source detectors lost about 50% of their AUC on video, 48% on audio and 45% on images compared with earlier academic benchmarks.

NIST's AI 100-4 report (November 2024) treats provenance tracking and synthetic content detection as complementary, and that is the practical lesson: run detection on the content, check provenance and source history for the context, and let a person make the final call when the stakes are high.

How Does Neural Defend Analyse Manipulated Media?

NeuroDetect is Neural Defend's forensic workspace for this job. An analyst uploads an authorized image, audio file, video or document into a case, and the analysis keeps the model and version context attached. Explainability heatmaps and attention views point to the regions, frames and audio segments that drove the result, which is the evidence an investigator needs to describe a manipulation precisely instead of labelling the whole file.

An LLM-assisted summary explains the findings in plain language and links each statement to the underlying evidence; the analyst still makes the final call. The case exports as a forensic report covering observations, uncertainty, provenance, model context and analyst notes, plus structured results for other systems.

Underneath is ARCAS 1B, Neural Defend's proprietary detection model. The ARCAS paper reports pooled accuracy of 99.99% on GenImage, 99.82% on AIGC-Detect and 97.65% on OpenFake. For real-time checks on faces in onboarding or account recovery, NeuroVerify runs six signals in one API call, including Face Manipulation Detection and AI Pixel-Level Manipulation, in under 200 ms p95 on eligible image requests. Neither product can tell you a caption is false; that still takes source work.

Evidence boundary

Limitations

  • Detection examines the content signal. It cannot expose a genuine, unedited file presented with a false caption, date or location.
  • The earliest copy found online may itself be a re-encoded derivative, and re-encoding can erase traces without any deceptive edit.
  • A finding that a file was altered does not establish who altered it, why, or whether the person depicted consented.
  • Benchmark accuracy figures, including those reported in the ARCAS paper, describe the tested datasets and may not hold on heavily compressed or novel media.

Frequently asked questions

Is all manipulated media a deepfake?

No. Deepfakes are the subset made or altered with AI, such as face swaps, cloned voices and generated scenes. A large share of misleading media uses ordinary tools: a clip trimmed to remove context, footage slowed down, two audio files joined, or an old photo reposted with a new date and place. These cheapfakes can be just as persuasive and often carry no synthesis traces, so the evidence that exposes them is usually the original source rather than a detector score.

Does editing a photo count as manipulated media?

Only when the edit changes what the image shows or implies. Exposure, colour correction, sharpening and a crop that keeps the scene intact are routine. Removing a person, adding damage, swapping a face, or cropping out the detail that explains the scene does change the meaning. A useful test is whether a viewer would reach a different conclusion from the edited version than from the original capture.

Can software detect manipulated media automatically?

Software can detect many signal-level edits, such as face swaps, AI-generated regions, inpainting and synthetic speech, and the better tools show where in the file the evidence sits. It cannot detect a genuine, unedited file attached to a false claim, because nothing in the pixels changed. Heavy compression also weakens detection. Use a detector on the best copy available, and pair it with reverse image search, provenance checks and source verification.

What is the difference between manipulated media and synthetic media?

Synthetic media describes how content was produced: generated or substantially modified by computational systems, whether the result is harmless or deceptive. Manipulated media describes an effect: content altered so that it misrepresents what happened. A disclosed AI avatar in a training video is synthetic but not manipulative. A real clip slowed to make a politician sound drunk is manipulated but contains no synthetic content. The two overlap in deepfakes used to deceive.

Is creating or sharing manipulated media illegal?

It depends on the jurisdiction and the use. Using altered media to commit fraud, impersonate someone, harass them or distribute non-consensual intimate imagery is unlawful in many countries. Disclosure rules are also arriving: under Article 50 of the EU AI Act, which applies from 2 August 2026, deployers who generate or manipulate deepfake image, audio or video content must disclose that it is artificial, with lighter duties for evidently artistic or satirical work. Take legal advice for specific cases.

Source record

Sources and references

  1. U.S. Department of Homeland Security, Science and Technology DirectorateS&T Digital Forgeries Report: Technology Landscape Threat AssessmentPublished January 24, 2023. Verified October 19, 2026.
  2. U.S. Department of Homeland SecurityIncreasing Threats of Deepfake IdentitiesVerified October 19, 2026.
  3. FBI Internet Crime Complaint CenterCriminals Use Generative Artificial Intelligence to Facilitate Financial Fraud (I-120324-PSA)Published December 3, 2024. Verified October 19, 2026.
  4. CNNArup revealed as victim of $25 million deepfake scam involving Hong Kong employeePublished May 16, 2024. Verified October 19, 2026.
  5. iScience (via PubMed Central)Fooled twice: People cannot detect deepfakes but think they canPublished November 19, 2021. Verified October 19, 2026.
  6. arXivDeepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024Published March 4, 2025. Verified October 19, 2026.
  7. National Institute of Standards and TechnologyReducing Risks Posed by Synthetic Content (NIST AI 100-4)Verified October 19, 2026.
  8. Future of Life Institute (EU AI Act Explorer)EU AI Act Article 3: DefinitionsVerified October 19, 2026.

Investigate a suspect file

See exactly where a file was altered with NeuroDetect

Open a case, upload an authorized image, video, audio file or document, and get region-level heatmaps and a forensic report that records the model version and the uncertainty.

Explore NeuroDetect