Sealed on Base.

{"canonicalPath":"/v/deepfake-detection-tools-can-fail-84i7c","receipt":{"challengePrompt":"Can you provide a peer-reviewed study showing a commercial deepfake detector that maintains its accuracy when tested on completely unseen out-of-distribution datasets?","claim":"Deepfake detection tools can fail on real-world content outside their training data.","confidence":"High","createdAt":"2026-06-19T17:16:32.914Z","kicker":"Deepfake Detection","paidAt":"2026-06-19T17:16:32.952Z","reasons":[{"body":"The strongest available evidence supports the main direction of the claim.","stance":"supports","title":"Severe generalization gap"},{"body":"There are context details worth keeping, but they do not overturn the central point.","stance":"context","title":"Environmental degradation"},{"body":"A fact check lands harder when the sources are visible and easy to inspect.","stance":"supports","title":"Rapid generator evolution"}],"score":40,"shareLine":"FactPage check: TRUE. Deepfake detection tools routinely fail when analyzing real-world content outside their training data.","slug":"deepfake-detection-tools-can-fail-84i7c","sources":[{"imageUrl":null,"publisher":"Direct source","title":"SoK: Deepfake Benchmarking Study","url":"https://arxiv.org/abs/2401.04364","usedFor":"The record that should answer the claim most directly."},{"imageUrl":null,"publisher":"Public data or reporting","title":"Why Do Facial Deepfake Detectors Fail?","url":"https://arxiv.org/abs/2302.13156","usedFor":"A second source that shows what the claim leaves out."},{"imageUrl":null,"publisher":"Opposing evidence","title":"The Generalisability Gap","url":null,"usedFor":"The strongest source someone could use to challenge this result."}],"summary":"Deepfake detection tools struggle significantly with out-of-distribution real-world media. While they achieve near-perfect accuracy under controlled lab conditions on their training sets, their performance drops drastically when facing compressed files, poor lighting, or deepfakes generated by novel algorithms.","vaultCategory":"Internet","verdict":"MIXED"},"type":"factpage.receipt","version":"fp-receipt-v1"}