Adaptive Identity Anchoring: Closed-Loop Keyframe Placement for Synthetic Paired Supervision in Video Face Swapping
Authors & Institutions
Logan Robbins
Independent researcher
What Problem It Solves
The paper focuses on the data factory behind a swap model rather than adding another student architecture. It asks how many identity anchors a synthetic pair needs, where they should be placed, and how clips that cannot maintain identity should be filtered before they become supervision.
Key Result
This is a research proposal, not a completed empirical result. It specifies drift-versus-anchor-gap curves, uniform versus adaptive placement at equal budgets, downstream student training, texture ablations, and a human beauty-filter study as falsifiable tests, but reports no measured identity, temporal, spectral, or user-study gains yet.
Abstract
Video face swapping has no natural paired supervision: no real footage exists of one person's face performing another person's video. The strongest current answer, DreamID-V's SyncID-Pipe, mints pairs by replacing the identity in exactly two frames of a real clip -- the first and the last -- and regenerating the rest from a pose sequence alone. Pose carries no appearance evidence of the swapped-in identity, so over long clips, occlusions, and extreme pose excursions the synthesized identity has a long unanchored span on which to drift; no published ablation examines anchor count or placement. We propose Adaptive Identity Anchoring (AIA): (i) generalize the synthesizer to arbitrary anchor sets, architecturally natural for diffusion-forcing-style transformers where conditioning on a frame is clamping its tokens to zero noise; (ii) place anchors by a closed feedback loop that scores every generated frame against the real reference identity and inserts an image-face-swapped anchor at the worst-scoring frame until the pair passes a threshold or exhausts a budget; (iii) reuse the loop's verdict as an automatic data filter. A second pathology, the beauty-filter look of over-smoothed skin, has the same root cause: micro-texture, like identity, is priced by none of the pipeline's objectives. We therefore pair AIA with Reality-Referenced Texture Restoration: matched re-graining from each real frame's non-face regions, band-split transfer of sub-identity micro-texture from the real footage, and a second, spectral acceptance channel refereed by the footage's own spectrum. Identity-anchor density, we argue, is a controllable quality dial, and we specify falsifiable experiments -- drift-versus-gap curves, uniform-versus-adaptive placement at matched budgets, student training on AIA-minted data, and texture ablations with a human beauty-filter study -- that would validate or refute the proposal.
Research Starting Point
Video face swapping lacks natural paired ground truth: the target identity never actually performed the source video. Existing synthetic supervision can anchor only the boundary frames, leaving long intervals, profile motion, and occlusion without direct appearance evidence and allowing identity or skin texture to drift.
Method
Adaptive Identity Anchoring generalizes a diffusion-forcing video synthesizer to arbitrary conditioned frames. A closed loop scores every generated frame against the real target identity, inserts an image-swapped anchor at the worst frame, and repeats until a threshold or anchor budget is reached. Reality-Referenced Texture Restoration separately transfers non-identity microtexture and grain from real footage and adds a spectral acceptance test to reduce over-smoothed skin.
Paper Summary
AIA is useful as a design checklist for teams building synthetic paired video data: monitor per-frame identity, spend anchors where drift is worst, reject nonconvergent clips, and score texture separately. Its value is currently methodological; implementation and benchmark evidence are still required before choosing it over an existing pipeline.