Details

Generiranje sintetičnih podatkovnih zbirk za razpoznavanje obrazov z uporabo zamenjave obrazov
ID Ogrizek, Leo (Author), ID Štruc, Vitomir (Mentor) More about this mentor... This link opens in a new window, ID Tomašević, Darian (Comentor)

.pdfPDF - Presentation file, Download (5,59 MB)
MD5: 041C51F6857AADED8329100C23347498

Abstract
Učenje modelov za razpoznavanje obrazov zahteva velike in raznolike učne zbirke. Sintetični podatki lahko zmanjšajo odvisnost od realnih identitet, vendar morajo poleg vizualne prepričljivosti ohraniti tudi uporabno razredno strukturo. V nalogi obravnavamo pripravo sintetične zbirke z identitetno pogojeno zamenjavo obrazov v latentnem prostoru. Donorska slika prispeva pozo, izraz, osvetlitev in ozadje, ciljna identiteta pa je podana z vložitvijo ArcFace. Cevovod uporablja generativni model ID-SiT v latentnem prostoru prednaučenega samokodirnika, obrazne maske za omejitev sprememb na obrazno regijo in tangentno-Gaussovo vzorčenje ciljnih identitet. Uporabnost vrednotimo posredno z učenjem ločenega modela za razpoznavanje obrazov na ustvarjeni zbirki ter z verifikacijo na zbirkah LFW, CFP-FP, CPLFW, AgeDB-30 in CALFW. Osnovna filtrirana zbirka s 494.409 slikami in 10.000 sintetičnimi identitetami doseže povprečno točnost 0,870; konzervativno filtriranje po identitetnih diagnostikah izboljša njeno učno uporabnost. Pri polsintetičnem bogatenju, kjer za vsako identiteto ohranimo pet realnih slik in dodamo 45 generiranih slik do skupno 50 slik, se povprečna točnost glede na izbrano podmnožico realne zbirke poveča z 0,688 na 0,890. Pri analizi pristranskosti na zbirki BFW osnovna sintetična zbirka po točnosti preseže zbirko HSFace10K (0,721 proti 0,697), a zmanjšanje pristranskosti glede na razpon točnosti ni razvidno. Rezultati potrjujejo, da je za sintetične podatke ključna geometrija celotne učne zbirke, ne le kakovost posameznih slik.

Language:Slovenian
Keywords:sintetični podatki, razpoznavanje obrazov, zamenjava obrazov, obrazne vložitve, latentno generiranje, prileganje tokov, difuzijski modeli, filtriranje podatkov
Work type:Master's thesis/paper
Organization:FE - Faculty of Electrical Engineering
Year:2026
PID:20.500.12556/RUL-185876 This link opens in a new window
Publication date in RUL:21.08.2026
Views:18
Downloads:11
Metadata:XML DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Secondary language

Language:English
Title:Synthetic Face Recognition Datasets Generation using Face Swapping
Abstract:
Training face recognition models requires large and diverse training datasets. Synthetic data can reduce dependence on real identities, but must preserve a useful class structure in addition to visual plausibility. This thesis studies synthetic dataset generation through identity-conditioned latent face swapping. A donor image provides pose, expression, illumination, and background, while the target identity is defined by an ArcFace embedding. The proposed pipeline uses an ID-SiT generative model in the latent space of a pretrained autoencoder, face masks to constrain changes to the facial region, and tangent-Gaussian sampling of target identities. Utility is evaluated indirectly by training a separate face recognition model and testing it on LFW, CFP-FP, CPLFW, AgeDB-30, and CALFW. The main filtered dataset contains 494.409 images and 10.000 synthetic identities and achieves an average verification accuracy of 0.870; conservative identity-diagnostic filtering improves its utility. In the semi-synthetic augmentation scenario, retaining five real images and adding 45 generated images per identity to obtain 50 images in total increases average accuracy from 0.688 to 0.890 compared with the corresponding real-only dataset. In the bias analysis on BFW, the main synthetic dataset exceeds HSFace10K in accuracy (0.721 vs. 0.697), but the accuracy range does not indicate a reduction in bias. The results show that the geometry of the complete training dataset, not only individual image quality, is crucial for synthetic face recognition data.

Keywords:synthetic data, face recognition, face swapping, face embeddings, latent generation, flow matching, diffusion models, data filtering

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Back