Venus-DefakerOne2: A Vision-Forensics Foundation Model with Broader Coverage
Authors & Institutions
Chenfan Qu
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Yachao Liang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Mingqi Fang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Jiangwei Xie
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Zhenming Wang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Baoyue Zhang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Changjiang Jiang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Zheng Chang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Fanli Jin
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Xuekang Zhu
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Kaiwen Feng
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Junchi Li
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Weihong Zhang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Haoyue Wang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Chenfeng Zhang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Yinan Xia
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Fangming Cui
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Yongshuo Zhang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Dong Fan
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Jingjing Liu
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Tianyi Zhang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Luobin Chen
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Ji-Zhe Zhou
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Sheng Li
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Wei Wang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Bin Li
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Ran He
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Xinpeng Zhang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Linna Zhou
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Jian Liu
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
Weiqiang Wang
GuangJian Team, Ant Group
Technical Committee on Digital Media Forensics and Security, CSIG
What Problem It Solves
Venus-DefakerOne2 aims to provide one binary forensic foundation model across digital and physical forgery in images and videos. The challenge is to add domains and difficult samples without catastrophic forgetting or forcing one prediction interface onto every media type.
Key Result
The paper reports balanced accuracy of 96.7% for deepfake faces, 93.3% for AI-generated images, 87.6% for tampered documents, 89.6% for manipulated natural images, 93.1% for physical spoofs, and 96.0% for AI-generated videos. On the two highlighted broad domains, physical forgery improves from DefakerOne's 60.8% to 93.1%, and AI-video detection from 72.5% to 96.0%.
Abstract
Real-world forgery is inherently heterogeneous: it manifests not only as digital manipulation but also as physical spoofing, and is carried not only by images but also by videos. Despite substantial progress, a unified anti-forgery foundation model covering such a broad threat spectrum remains absent. In this paper, we present Venus-DefakerOne2, which substantially extends the forensic capability boundary along both the forgery-form and media-type dimensions. Trained on tens of millions of open-source and in-house samples, it incorporates two key designs. Tide-Style-Tuning alternates LoRA and full-parameter fine-tuning to balance computational efficiency, generalization, and hard-sample fitting while mitigating catastrophic forgetting. Entropy-based Test Adaptation determines the optimal prediction modality by analyzing prediction entropy. Venus-DefakerOne2 achieves new state-of-the-art performance across a comprehensive suite of benchmarks, including DeepFake faces (96.7%), AI-generated images (93.3%), tampered documents (87.6%), manipulated natural images (89.6%), physical spoofs (93.1%), and AI-generated videos (96.0%). It significantly outperforms both specialized expert models and its predecessor, DefakerOne, establishing itself as a powerful and versatile foundation model for binary-decision forensic tasks.
Research Starting Point
Operational forgery screening spans deepfake faces, generated images and videos, edited documents, natural-image tampering, and physical presentation attacks. Separate specialist models increase integration cost and can leave inconsistent blind spots across media and attack forms.
Method
The model is trained on tens of millions of open-source and internal samples. Tide-Style-Tuning alternates parameter-efficient LoRA phases with full-parameter fine-tuning to preserve broad generalization while fitting hard cases. Entropy-based test adaptation compares available prediction modalities and selects the lower-uncertainty route; additional components support video aggregation and pixel-level localization.
Paper Summary
A broad foundation detector can simplify a multi-media review stack, but the headline average spans many benchmarks and includes internal training data. Enterprise evaluation still needs attack-specific thresholds, calibration, latency, and testing on unseen generators and capture devices.