Podrobno

Diff-FIT : generating facial composites with diffusion models
ID Tomašević, Darian (Avtor), ID Peer, Peter (Avtor), ID Štruc, Vitomir (Avtor), ID Miočić, Matej (Avtor)

.pdfPDF - Predstavitvena datoteka, prenos (8,40 MB)
MD5: 8331E2BB047220FFEEB9AD44437FF6F2
URLURL - Izvorni URL, za dostop obiščite https://ieeexplore.ieee.org/document/11426945 Povezava se odpre v novem oknu

Izvleček
Facialcomposites, or police sketches, are essential tools in law enforcement for reconstructing the appearance of suspects from eyewitness descriptions. Traditionally, forensic artists manually produce these composites through intensive and time-consuming collaboration with witnesses. To improve the efficiency of this process, automated approaches have leveraged advancements in deep learning and generative modeling. However, the application of recent diffusion models has remained unexplored, despite their unparalleled text-guided synthesis capabilities. To this end, we present Diff-FIT (Diffusion Facial Identification Technique), a novel multi-pipeline framework for generating photorealistic facial composites in only a few steps with pretrained diffusion models. Diff-FIT enables rapid generation of initial composites from textual descriptions, followed by intuitive sequential edits including global image-to-image translation, local text-based inpainting, and drag-based geometric transformations. Through experiments across multiple latent diffusion models and sampling parameters we determine the configuration that best balances image quality, diversity, image-text alignment, and identity consistency. In a user study involving biometric experts and non-experts, Diff-FIT achieves comparable real-world utility to state-of-the art systems in both subjective evaluations and identification rates with generated facial composites, while enabling greater variation and flexibility through description-based generation and diverse editing pipelines for adding distinct facial features. The source code Diff-FIT framework is publicly available at: https://github.com/matemato/Diff-FIT

Jezik:Angleški jezik
Ključne besede:deep generative models, image-based biometrics, diffusion models, facial composites
Vrsta gradiva:Članek v reviji
Tipologija:1.01 - Izvirni znanstveni članek
Organizacija:FRI - Fakulteta za računalništvo in informatiko
FE - Fakulteta za elektrotehniko
Status publikacije:Objavljeno
Različica publikacije:Objavljena publikacija
Leto izida:2026
Št. strani:Str. 41650 - 41670
Številčenje:Vol. 14
PID:20.500.12556/RUL-181922 Povezava se odpre v novem oknu
UDK:004.932.2:004.8
ISSN pri članku:2169-3536
DOI:10.1109/ACCESS.2026.3672229 Povezava se odpre v novem oknu
COBISS.SI-ID:271510531 Povezava se odpre v novem oknu
Datum objave v RUL:20.04.2026
Število ogledov:164
Število prenosov:297
Metapodatki:XML DC-XML DC-RDF
:
Kopiraj citat
Objavi na:Bookmark and Share

Gradivo je del revije

Naslov:IEEE access
Založnik:Institute of Electrical and Electronics Engineers
ISSN:2169-3536
COBISS.SI-ID:519839513 Povezava se odpre v novem oknu

Licence

Licenca:CC BY 4.0, Creative Commons Priznanje avtorstva 4.0 Mednarodna
Povezava:http://creativecommons.org/licenses/by/4.0/deed.sl
Opis:To je standardna licenca Creative Commons, ki daje uporabnikom največ možnosti za nadaljnjo uporabo dela, pri čemer morajo navesti avtorja.

Sekundarni jezik

Jezik:Slovenski jezik
Ključne besede:globoki generativni modeli, slikovna biometrija, difuzijski modeli, fotoroboti

Projekti

Financer:ARIS - Javna agencija za znanstvenoraziskovalno in inovacijsko dejavnost Republike Slovenije
Številka projekta:P2-0250
Naslov:Metrologija in biometrični sistemi

Financer:ARIS - Javna agencija za znanstvenoraziskovalno in inovacijsko dejavnost Republike Slovenije
Številka projekta:P2-0214
Naslov:Računalniški vid

Financer:ARIS - Javna agencija za znanstvenoraziskovalno in inovacijsko dejavnost Republike Slovenije
Številka projekta:J2-50065
Naslov:Odkrivanje globokih ponaredkov z metodami zaznave anomalij (DeepFake DAD)

Podobna dela

Podobna dela v RUL:
Podobna dela v drugih slovenskih zbirkah:

Nazaj