← Back to Blog
Research RadarFace SwappingarXivOctober 2026

Monthly arXiv Radar

October 2026 Face Swapping Papers: One Step, Real-Time Streams, and Expressive Identity

The October face-swapping papers focus on constraints that matter outside a demo image. ALADDIN tackles still-image cost and evaluation bias, StreamingSwap targets long live video, and expression-diverse reference conditioning addresses an identity gap that appears when the face moves far from the enrollment pose.

What This Month Signals

ALADDIN initializes a one-step adversarial generator from a flow model and matches the strongest multi-step baseline with one rather than 28 network evaluations, while exposing identity-evaluator bias. StreamingSwap narrows generation to the face region and a short rollout context, reaching 20 FPS on one RTX 4090 and stable ten-minute output. Expression-diverse references raise extreme-expression identity similarity from 60.95 to 74.80 with real galleries and to 68.36 with synthesized galleries. Together, these studies move the discussion from isolated visual quality toward throughput, evaluator independence, temporal stability, and enrollment coverage.

Paper 012026-10-27cs.CV

ALADDIN: Adversarial Latent Diffusion Distillation for One-Step Identity Swapping

Authors & Institutions

Ivan Shchekotov

Constructor University

Timofei Gritsaev

Constructor University

Viacheslav Pirogov

Sumsub

Dmitry Vetrov

Constructor University

What Problem It Solves

ALADDIN seeks one-step identity swapping with diffusion-level realism and a controllable balance between source identity transfer and preservation of target pose, expression, hair, lighting, accessories, and background. It also introduces an identity evaluation protocol based on an encoder independent of every compared method.

Key Result

On 1,000 FFHQ pairs, the balanced student reports FID 4.49, independent-encoder identity similarity 0.50, and 97.4% top-1 identity retrieval. A preservation-focused variant reaches FID 3.34 and matches APPLE's 0.40 identity score while improving pose error from 1.86 to 1.56. It uses one network evaluation instead of APPLE's 28 and about 0.115 million training pairs rather than 1.28 million.

Abstract

Face swapping transfers a source identity onto a target image while preserving the target's pose, expression, hair, and lighting. The most realistic current methods are diffusion-based, but they need many network evaluations per image. GAN-based methods are fast, yet trained from scratch they must learn realism from the adversarial signal alone and produce visibly weaker results. We present ALADDIN (Adversarial Latent Diffusion Distillation for One-Step Identity Swapping), a one-step face swapper obtained by initialising the generator from a pre-trained multi-step flow-matching model and training it adversarially under identity and target-preservation constraints. We expose a controllable trade-off between identity transfer and target-attribute preservation by training a student model with triplet pseudo-label supervision. We additionally identify a bias in the standard evaluation protocol, which favours methods trained against the same identity encoder used to score them, and re-evaluate all baselines with an independent one. ALADDIN is state-of-the-art among one-step methods in realism and target preservation at comparable identity transfer, and matches the best multi-step model with 28 times fewer network evaluations and an order of magnitude fewer training pairs.

Research Starting Point

Diffusion face swappers can be realistic but require many network evaluations, while one-step GAN systems are fast and often less faithful. Evaluation can also be biased when a method is trained against the same face encoder later used to score its identity similarity.

Method

The generator is initialized from a pretrained multi-step flow-matching model and trained adversarially. Its discriminator reads intermediate features from a frozen diffusion model rather than raw latents, while identity and target-preservation losses constrain the output. A second student uses triplet pseudo-label supervision to expose an adjustable reconstruction weight and therefore a useful identity-versus-attribute trade-off.

Paper Summary

ALADDIN materially lowers the inference and training cost of high-quality still-image swapping. Its independent identity evaluation is equally important for procurement: a favorable score can be partly caused by sharing the evaluator used during training.

Paper 022026-10-19cs.CV

From Short Clips to Real-Time Streams: Identity-Aware Supervision and Context-Efficient Generation for Video Face Swapping

Authors & Institutions

Zekai Luo

Zhejiang University

Yuwei Liang

Zhejiang University

Ruiqi Ma

Zhejiang University

Haoyu Huang

Zhejiang University

Xuehao Wang

Zhejiang University

Huanyi Zheng

Zhejiang University

Mingyu Liu

Zhejiang University

Linhao Zhong

Zhejiang University

Chenchen Jing

Zhejiang University of Technology

Yuling Xi

Zhejiang University

Hao Chen

Zhejiang University

What Problem It Solves

StreamingSwap targets faithful, real-time face swapping over minutes rather than short offline clips. It concentrates supervision on identity and removes redundant background and temporal computation while preserving bidirectional generation inside a small window.

Key Result

The system runs at 20 frames per second on one NVIDIA RTX 4090 and remains stable on videos up to ten minutes. Across short and long evaluations it reports competitive identity transfer and visual quality while avoiding full-frame, long-context denoising. The result is a concrete throughput milestone, although it is tied to a high-end desktop GPU and the paper's curated face-region pipeline.

Abstract

Video face swapping transfers the reference identity to a target video while preserving its other attributes and motion. Despite recent progress in reference-guided flow-based methods, jointly achieving faithful identity transfer, high fidelity, and real-time generation over long video streams remains challenging. To address this challenge, we rethink the task-specific structure of reference-guided video face swapping. First, face swapping changes only identity while preserving most visual content, yet flow-matching supervision is weakly sensitive to these changes. We therefore develop Joint Rec-ID Loss, which balances explicit identity supervision and latent reconstruction according to the noise level. Second, the target video already provides non-edited attributes and temporal dynamics, enabling generation with fewer spatial tokens and shorter temporal contexts through Face-RoI Generation and Short-Context Rollout Training. By integrating these designs, we propose StreamingSwap, a reference-guided flow-matching framework for real-time streaming video face swapping. We also introduce HumanFaceVid, comprising 1,000 hours of cinematic training data and evaluation sets of 200 short and 200 long videos. Experiments demonstrate that our method achieves competitive identity transfer and visual quality at 20 FPS on a single NVIDIA RTX 4090 GPU, with stable generation over videos up to 10 minutes long. Project webpage: https://aim-uofa.github.io/StreamingSwap/

Research Starting Point

Video face swapping must preserve identity and target attributes without flicker, and long streams magnify drift and memory cost. Reference-guided flow models process large full-frame token sets and long contexts even though only the face identity changes.

Method

Joint Rec-ID Loss mixes clean-latent reconstruction with explicit face-recognition supervision according to noise level. Face-RoI Generation limits conditioning and synthesis to facial tokens, and Short-Context Rollout Training exposes the model to its own short generated history so streaming inference does not diverge from training. HumanFaceVid adds 1,000 hours of cinematic training video plus 200 short and 200 long evaluation clips.

Paper Summary

StreamingSwap moves diffusion-style video swapping closer to live production and long-form workflows. Buyers should reproduce end-to-end latency with their detector, crop compositor, resolution, and hardware rather than treating the reported 20 FPS as a universal number.

Paper 032026-10-08cs.CV

Expression-Diverse References for Identity-Preserving Video Generation

Authors & Institutions

Tianwen Fu

Institute for Creative Technologies, University of Southern California

Wenbin Teng

Institute for Creative Technologies, University of Southern California

Gonglin Chen

Institute for Creative Technologies, University of Southern California

Junyi Ouyang

Institute for Creative Technologies, University of Southern California

Haolin Xiong

Institute for Creative Technologies, University of Southern California

Yajie Zhao

Institute for Creative Technologies, University of Southern California

What Problem It Solves

The paper uses expression-diverse reference galleries both to condition identity-preserving generation and to evaluate it. The goal is to separate genuine identity drift from harmless expression-dependent appearance change, especially in intense motion.

Key Result

On 10 subjects and 48 prompts per subject, extreme-expression CurricularFace similarity rises from 60.95 for the strongest baseline to 74.80 with real galleries and 68.36 with synthesized galleries. Similarity to a single neutral reference in real photographs has a Spearman correlation of -0.701 with expression intensity. The real-gallery model wins on at least 97.9% of matched subject-prompt pairs across recognizers and baselines.

Abstract

Identity-preserving video generation aims to maintain a subject's identity while synthesizing realistic videos. Yet a single reference portrait captures the subject's appearance under only one facial configuration. As expressions change, facial appearance can vary in highly identity-specific ways, leaving the subject's appearance under unseen expressions underdetermined by the reference alone. This expression-dependent variation also complicates evaluation: similarity to a neutral reference may decrease under strong expressions even for real images of the same person. We investigate this limitation from both generation and evaluation perspectives. First, we quantify how face-recognition similarity varies with expression intensity using controlled photographs and MEAD videos. We then construct a compact yet expressive reference gallery that captures diverse expression-dependent facial configurations. Matching against this gallery provides a more robust measure of identity similarity under expressive motion. To further expose performance degradation with expression intensity, we report identity similarity separately for mild, intense, and extreme expressions. For generation, we extend Stand-In to condition on our expression-diverse reference sets and develop a data-curation pipeline that extracts consistent yet diverse face crops from training videos. In practical settings where only a single portrait is available, we construct the reference set by synthesizing additional expressions with a pretrained facial reenactment model. On our controlled benchmark, both real and synthesized reference sets outperform the evaluated baselines in identity similarity across all three expression-intensity regimes, with the largest improvements for extreme expressions.

Research Starting Point

A single neutral portrait does not show how one person's eyes, mouth, cheeks, and skin deform under a strong expression. It can therefore under-specify identity for video generation and also make evaluation unfair, because even real images of the same person score lower against a neutral reference as expression intensity rises.

Method

Each identity is represented by a gallery of one neutral and seven expressive configurations, and generated frames are scored against their nearest gallery embedding within mild, intense, and extreme expression bands. Stand-In is extended with multi-reference conditioning and trained with curated face crops. When only one portrait is available, LivePortrait synthesizes the missing expression references, allowing the same generator to operate without a real gallery.

Paper Summary

Multi-reference enrollment can improve both generation and measurement when expressive motion matters. Synthetic references are a useful fallback, but teams should check whether reenactment artifacts bias the identity signal for their population.