Details

SelfMAD++ : self-supervised foundation model with local feature enhancement for generalized morphing attack detection
ID Ivanovska Preskar, Marija (Author), ID Todorov, Leon (Author), ID Peer, Peter (Author), ID Štruc, Vitomir (Author)

.pdfPDF - Presentation file, Download (14,35 MB)
MD5: B2EA8D6CBB71879E3789026FA7E79A1F
URLURL - Source URL, Visit https://www.sciencedirect.com/science/article/pii/S1566253525009832 This link opens in a new window

Abstract
Face morphing attacks pose a growing threat to biometric systems, exacerbated by the rapid emergence of powerful generative techniques that enable realistic and seamless facial image manipulations. To address this challenge, we introduce SelfMAD++, a robust and generalized single-image morphing attack detection (S-MAD) framework. Unlike our previous work SelfMAD, which introduced a data augmentation technique to train off-the-shelf classifiers for attack detection, SelfMAD++ advances this paradigm by integrating the artifact-driven augmentation with foundation models and fine-grained spatial reasoning. At its core, SelfMAD++ builds on CLIP–a vision-language foundation model–adapted via Low-Rank Adaptation (LoRA) to align image representations with task-specific text prompts. To enhance sensitivity to spatially subtle and fine-grained artifacts, we integrate a parallel multi-scale convolutional branch specialized in dense, multi-scale feature extraction. This branch is guided by an auxiliary segmentation module, which acts as a regularizer by disentangling bona fide facial regions from potentially manipulated ones. The dual-branch features are adaptively fused through a gated attention mechanism, capturing both semantic context and fine-grained spatial cues indicative of morphing. SelfMAD++ is trained end-to-end using a multi-objective loss that balances semantic alignment, segmentation consistency, and classification accuracy. Extensive experiments across nine standard benchmark datasets demonstrate that SelfMAD++ achieves state-of-the-art performance, with an average Equal Error Rate (EER) of 3.91 %, outperforming both supervised and unsupervised MAD methods by large margins. Notably, SelfMAD++ excels on modern, high-quality morphs generated by GAN and diffusion–based morphing methods, demonstrating its robustness and strong generalization capability. SelfMAD++ code and supplementary resources are publicly available at: https://github.com/LeonTodorov/SelfMADpp.

Language:English
Keywords:morphing attack detection (MAD), face biometrics, deep learning, foundation models, self-supervised learning, localized visual reasoning
Work type:Article
Typology:1.01 - Original Scientific Article
Organization:FE - Faculty of Electrical Engineering
Publication status:Published
Publication version:Version of Record
Year:2026
Number of pages:16 str.
Numbering:Vol. 127, Part C, art. 103921
PID:20.500.12556/RUL-175992 This link opens in a new window
UDC:004.93
ISSN on article:1872-6305
DOI:10.1016/j.inffus.2025.103921 This link opens in a new window
COBISS.SI-ID:257476867 This link opens in a new window
Publication date in RUL:17.11.2025
Views:114
Downloads:22
Metadata:XML DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Record is a part of a journal

Title:Information fusion
Publisher:Elsevier
ISSN:1872-6305
COBISS.SI-ID:148692227 This link opens in a new window

Licences

License:CC BY-NC 4.0, Creative Commons Attribution-NonCommercial 4.0 International
Link:http://creativecommons.org/licenses/by-nc/4.0/
Description:A creative commons license that bans commercial use, but the users don’t have to license their derivative works on the same terms.

Secondary language

Language:Slovenian
Keywords:zaznavanje napadov z zlivanjem obrazov, obrazna biometrija, globoko učenje, temeljni modeli, samonadzorovano učenje, lokalizirano vizualno sklepanje

Projects

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:P2-0250
Name:Metrologija in biometrični sistemi

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:P2-0214
Name:Računalniški vid

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:J2-50065
Name:Odkrivanje globokih ponaredkov z metodami zaznave anomalij (DeepFake DAD)

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Back