Podrobno

SelfMAD++ : self-supervised foundation model with local feature enhancement for generalized morphing attack detection
ID Ivanovska Preskar, Marija (Avtor), ID Todorov, Leon (Avtor), ID Peer, Peter (Avtor), ID Štruc, Vitomir (Avtor)

.pdfPDF - Predstavitvena datoteka, prenos (14,37 MB)
MD5: 60D170B366A83A54358C7C42CC88FF32
URLURL - Izvorni URL, za dostop obiščite https://www.sciencedirect.com/science/article/pii/S1566253525009832 Povezava se odpre v novem oknu

Izvleček
Face morphing attacks pose a growing threat to biometric systems, exacerbated by the rapid emergence of powerful generative techniques that enable realistic and seamless facial image manipulations. To address this challenge, we introduce SelfMAD++, a robust and generalized single-image morphing attack detection (S-MAD) framework. Unlike our previous work SelfMAD, which introduced a data augmentation technique to train off-the-shelf classifiers for attack detection, SelfMAD++ advances this paradigm by integrating the artifact-driven augmentation with foundation models and fine-grained spatial reasoning. At its core, SelfMAD++ builds on CLIP–a vision-language foundation model–adapted via Low-Rank Adaptation (LoRA) to align image representations with task-specific text prompts. To enhance sensitivity to spatially subtle and fine-grained artifacts, we integrate a parallel multi-scale convolutional branch specialized in dense, multi-scale feature extraction. This branch is guided by an auxiliary segmentation module, which acts as a regularizer by disentangling bona fide facial regions from potentially manipulated ones. The dual-branch features are adaptively fused through a gated attention mechanism, capturing both semantic context and fine-grained spatial cues indicative of morphing. SelfMAD++ is trained end-to-end using a multi-objective loss that balances semantic alignment, segmentation consistency, and classification accuracy. Extensive experiments across nine standard benchmark datasets demonstrate that SelfMAD++ achieves state-of-the-art performance, with an average Equal Error Rate (EER) of 3.91 %, outperforming both supervised and unsupervised MAD methods by large margins. Notably, SelfMAD++ excels on modern, high-quality morphs generated by GAN and diffusion–based morphing methods, demonstrating its robustness and strong generalization capability. SelfMAD++ code and supplementary resources are publicly available at: https://github.com/LeonTodorov/SelfMADpp.

Jezik:Angleški jezik
Ključne besede:morphing attack detection, MAD, face biometrics, deep learning, foundation models, self-supervised learning, localized visual reasoning
Vrsta gradiva:Članek v reviji
Tipologija:1.01 - Izvirni znanstveni članek
Organizacija:FE - Fakulteta za elektrotehniko
FRI - Fakulteta za računalništvo in informatiko
Status publikacije:Objavljeno
Različica publikacije:Objavljena publikacija
Leto izida:2026
Št. strani:16 str.
Številčenje:Vol. 127, pt. C, art. 103921
PID:20.500.12556/RUL-175992 Povezava se odpre v novem oknu
UDK:004.93
ISSN pri članku:1872-6305
DOI:10.1016/j.inffus.2025.103921 Povezava se odpre v novem oknu
COBISS.SI-ID:257476867 Povezava se odpre v novem oknu
Datum objave v RUL:17.11.2025
Število ogledov:594
Število prenosov:283
Metapodatki:XML DC-XML DC-RDF
:
Kopiraj citat
Objavi na:Bookmark and Share

Gradivo je del revije

Naslov:Information fusion
Založnik:Elsevier
ISSN:1872-6305
COBISS.SI-ID:148692227 Povezava se odpre v novem oknu

Licence

Licenca:CC BY 4.0, Creative Commons Priznanje avtorstva 4.0 Mednarodna
Povezava:http://creativecommons.org/licenses/by/4.0/deed.sl
Opis:To je standardna licenca Creative Commons, ki daje uporabnikom največ možnosti za nadaljnjo uporabo dela, pri čemer morajo navesti avtorja.

Sekundarni jezik

Jezik:Slovenski jezik
Ključne besede:zaznavanje napadov z zlivanjem obrazov, obrazna biometrija, globoko učenje, temeljni modeli, samonadzorovano učenje, lokalizirano vizualno sklepanje

Projekti

Financer:ARIS - Javna agencija za znanstvenoraziskovalno in inovacijsko dejavnost Republike Slovenije
Številka projekta:P2-0250
Naslov:Metrologija in biometrični sistemi

Financer:ARIS - Javna agencija za znanstvenoraziskovalno in inovacijsko dejavnost Republike Slovenije
Številka projekta:P2-0214
Naslov:Računalniški vid

Financer:ARIS - Javna agencija za znanstvenoraziskovalno in inovacijsko dejavnost Republike Slovenije
Številka projekta:J2-50065
Naslov:Odkrivanje globokih ponaredkov z metodami zaznave anomalij (DeepFake DAD)

Podobna dela

Podobna dela v RUL:
Podobna dela v drugih slovenskih zbirkah:

Nazaj