Improving Low-Resolution Face Recognition under Limited Data: How Synthetic Data Generation Can Close the Domain Gap
Authors & Institutions
Luis S. Luevano
Idiap Research Institute, Switzerland
Ünsal Öztürk
Idiap Research Institute, Switzerland
Hatef Otroshi Shahreza
Idiap Research Institute, Switzerland
Anjith George
Idiap Research Institute, Switzerland
Sébastien Marcel
Idiap Research Institute, Switzerland
What Problem It Solves
The study asks which synthetic low-resolution strategy actually helps a compact face recognizer when labeled native data is limited, and whether conclusions drawn from artificially downsampled LFW-style tests survive on real TinyFace probes. It also establishes a direct-input baseline so that super-resolution and translation modules must prove they preserve identity rather than merely improve visual appearance.
Key Result
Synthetic tests favored a 28-pixel degradation, but that same setting fell below the high-resolution-trained baseline on real TinyFace. Milder 56-pixel interpolation augmentation was the best compact configuration, raising TinyFace mAP from 52.55 to 54.68 and rank-1 identification from 59.66% to 61.40%. The learned RRDB super-resolution plus domain-translation pipeline reached only 57.53 mAP with EdgeFace-base, versus 65.12 for direct input. Knowledge distillation delivered the largest synthetic gains but did not transfer to native low resolution, showing that synthesis fidelity, not synthesis complexity, is the limiting factor.
Abstract
Face Recognition (FR) systems in surveillance settings often encounter Low Resolution (LR) faces, those whose face region falls below the standard 112 $\times$ 112 input size. While labelled High Resolution (HR) training data is abundant, labelled native-LR data, and above all paired native LR/HR data, is scarce. One workaround is to synthesize LR data from the available HR faces, but how much synthesis effort is repaid in recognition accuracy remains unclear. We present a study of simple synthetic generation strategies for a compact, edge device-oriented face recognition system, spanning interpolation-based degradation, knowledge distillation, a Prepended Domain Transformer (PDT), Real ESRGAN-style degradation, and a learned Super Resolution (SR) front-end with an identity-aware loss. We evaluate these strategies on synthetic cross-resolution face benchmarks (LFW, CFP-FP, AgeDB-30) and on TinyFace, a real-world native LR dataset, and expose a synthetic-real gap: the degradation setting that is optimal on synthetic benchmarks is not the one that is optimal on real LR. We find that more synthesis effort does not help monotonically: the learned SR front-end does not surpass a direct feed of the aligned LR image into a strong backbone, while simple interpolation augmentation of a compact backbone is the only synthesis that improves over its own baseline. We conclude that generative methods for LR face recognition must be validated on real LR and against a direct-feed baseline, and release our pipeline at https://idiap.ch/paper/synth-lrfr
Research Starting Point
Surveillance and watchlist systems routinely compare a high-quality enrollment image with a probe whose aligned face is far smaller than the standard 112 by 112 input. Native low-resolution identities, especially paired low- and high-resolution captures of the same person, are scarce, so teams commonly manufacture low-resolution training data from abundant high-resolution faces. The practical risk is that a degradation recipe can score well on synthetic benchmarks while teaching the recognizer cues that do not resemble blur, noise, compression, and alignment errors from real cameras.
Method
The authors use the 3.65-million-parameter EdgeFace-S backbone and compare five levels of adaptation effort: interpolation-based downsample-and-upsample augmentation, high-resolution teacher knowledge distillation, a prepended domain transformer, a native 32-pixel stem trained with Real-ESRGAN-style degradations, and an identity-aware learned super-resolution front end. They evaluate high-to-low and low-to-low verification on LFW, CFP-FP, and AgeDB-30, then repeat the comparison on native low-resolution TinyFace under two alignment pipelines. A larger frozen EdgeFace-base model provides the reference for testing whether a generative front end beats feeding the aligned probe directly to a strong recognizer.
Paper Summary
For an edge or surveillance deployment, validate every low-resolution recipe on genuinely captured low-resolution faces and keep a strong direct-feed baseline. Simple, mild interpolation augmentation can be a better investment than a super-resolution stack; synthetic-only gains at aggressive resolutions are not reliable evidence of field performance.