Details

Zaznavanje ponarejanja identitetnih dokumentov z uporabo temeljnih modelov
ID Peterlin, Marko (Author), ID Batagelj, Borut (Mentor) More about this mentor... This link opens in a new window

.pdfPDF - Presentation file, Download (17,77 MB)
MD5: E414FBF073BA93A4F1BA4E1BF4D73AF3

Abstract
Sistemi za oddaljeno preverjanje identitete morajo razlikovati med pristnimi osebnimi izkaznicami ter tiskanimi, zaslonskimi in kompozitnimi napadi. Razlike med njimi se pogosto kažejo le v drobnih teksturnih in barvnih sledeh, katerih izrazitost je odvisna od naprave in pogojev zajema. Ker se uspešnost modelov pri novih dokumentih pogosto poslabša, analiziramo vpliv izbire temeljnega modela (angl. foundation model), predobdelave slike ter dodatnih binarnih modelov na končno uspešnost sistema. Predlagani cevovod združuje lokalizacijo dokumenta z modelom YOLOv11, večrazredni osnovni klasifikator in binarne modele za zaznavanje posameznih vrst napadov. Osnovni model razlikuje med pristnimi, kompozitnimi, tiskanimi in zaslonskimi primeri ter poda začetno oceno pristnosti dokumenta. Vključeni binarni modeli to oceno dopolnijo s ciljno presojo posameznih vrst napadov, končni rezultat sistema pa je binarna ocena pristnosti. Pri kompozitnih napadih primerjamo uporabo izreza celotne kartice z uporabo izreza portreta. Kot osnovne modele ovrednotimo CLIP z metodo LoRA ter modele DINOv2, DINOv3, ConvNeXt, EfficientNetV2, CAFormer in EVA-02. Pristop smo ovrednotili na zbirkah PAD-IDCard 2025 in Kid34K s stopnjo enakih napak (EER), stopnjama napačne razvrstitve napadov (APCER) in pristnih predstavitev (BPCER) ter povprečno oceno. Najbolj uravnotežena konfiguracija je na testni množici interne porazdelitve dosegla EER 1,07 % in povprečno oceno 3,78 %. Pri zunanjem vrednotenju na zbirki Kid34K je DINOv2 med obravnavanimi osnovnimi modeli dosegel najnižji EER 27,24 % in najnižjo povprečno oceno 81,41 %. Rezultati kažejo, da selektivna uporaba binarnih modelov in dodatnega roba izreza izboljšata delovanje sistema. Hkrati pa se pokaže, da je prenos na neodvisne podatke še vedno zahteven.

Language:Slovenian
Keywords:zaznavanje predstavitvenih napadov, preverjanje pristnosti osebnih izkaznic, temeljni vizualni modeli, binarni modeli, domensko posploševanje
Work type:Bachelor thesis/paper
Organization:FRI - Faculty of Computer and Information Science
Year:2026
PID:20.500.12556/RUL-187050 This link opens in a new window
Publication date in RUL:08.09.2026
Views:27
Downloads:4
Metadata:XML DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Secondary language

Language:English
Title:Detecting Identity Document Forgery Using Foundation Models
Abstract:
Remote identity-verification systems must distinguish bona fide identity cards from print, screen, and composite attacks. The differences between them are often apparent only in subtle texture and color traces whose visibility depends on the device and capture conditions. Because model performance often deteriorates on new documents, we analyze how the choice of foundation model, image preprocessing, and additional binary models affects the overall performance of the system. The proposed pipeline combines document localization using YOLOv11, a multiclass base classifier, and binary models for detecting individual attack types. The base model distinguishes among bona fide, composite, print, and screen examples and produces an initial document-authenticity score. The included binary models complement this score with targeted assessments of individual attack types, while the final system output is a binary authenticity score. For composite attacks, we compare the use of a full-card crop with the use of a portrait crop. The evaluated base models are CLIP adapted with LoRA, DINOv2, DINOv3, ConvNeXt, EfficientNetV2, CAFormer, and EVA-02. The approach was evaluated on the PAD-IDCard 2025 and Kid34K datasets using the Equal Error Rate (EER), the Attack Presentation Classification Error Rate (APCER), the Bona Fide Presentation Classification Error Rate (BPCER), and the average score. The most balanced configuration achieved an EER of 1.07% and an average score of 3.78% on the internal test set. In the external evaluation on Kid34K, DINOv2 achieved the lowest EER of 27.24% and the lowest average score of 81.41% among the evaluated base models. The results show that the selective use of binary models and additional crop padding improves system performance. At the same time, generalization to independent data remains challenging.

Keywords:presentation attack detection, identity-card authentication, vision foundation models, binary models, cross-domain generalization

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Back