Details

Diff-FIT : generating facial composites with diffusion models
ID Tomašević, Darian (Author), ID Peer, Peter (Author), ID Štruc, Vitomir (Author), ID Miočić, Matej (Author)

.pdfPDF - Presentation file, Download (8,40 MB)
MD5: 8331E2BB047220FFEEB9AD44437FF6F2
URLURL - Source URL, Visit https://ieeexplore.ieee.org/document/11426945 This link opens in a new window

Abstract
Facialcomposites, or police sketches, are essential tools in law enforcement for reconstructing the appearance of suspects from eyewitness descriptions. Traditionally, forensic artists manually produce these composites through intensive and time-consuming collaboration with witnesses. To improve the efficiency of this process, automated approaches have leveraged advancements in deep learning and generative modeling. However, the application of recent diffusion models has remained unexplored, despite their unparalleled text-guided synthesis capabilities. To this end, we present Diff-FIT (Diffusion Facial Identification Technique), a novel multi-pipeline framework for generating photorealistic facial composites in only a few steps with pretrained diffusion models. Diff-FIT enables rapid generation of initial composites from textual descriptions, followed by intuitive sequential edits including global image-to-image translation, local text-based inpainting, and drag-based geometric transformations. Through experiments across multiple latent diffusion models and sampling parameters we determine the configuration that best balances image quality, diversity, image-text alignment, and identity consistency. In a user study involving biometric experts and non-experts, Diff-FIT achieves comparable real-world utility to state-of-the art systems in both subjective evaluations and identification rates with generated facial composites, while enabling greater variation and flexibility through description-based generation and diverse editing pipelines for adding distinct facial features. The source code Diff-FIT framework is publicly available at: https://github.com/matemato/Diff-FIT

Language:English
Keywords:deep generative models, image-based biometrics, diffusion models, facial composites
Work type:Article
Typology:1.01 - Original Scientific Article
Organization:FRI - Faculty of Computer and Information Science
FE - Faculty of Electrical Engineering
Publication status:Published
Publication version:Version of Record
Year:2026
Number of pages:Str. 41650 - 41670
Numbering:Vol. 14
PID:20.500.12556/RUL-181922 This link opens in a new window
UDC:004.932.2:004.8
ISSN on article:2169-3536
DOI:10.1109/ACCESS.2026.3672229 This link opens in a new window
COBISS.SI-ID:271510531 This link opens in a new window
Publication date in RUL:20.04.2026
Views:162
Downloads:297
Metadata:XML DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Record is a part of a journal

Title:IEEE access
Publisher:Institute of Electrical and Electronics Engineers
ISSN:2169-3536
COBISS.SI-ID:519839513 This link opens in a new window

Licences

License:CC BY 4.0, Creative Commons Attribution 4.0 International
Link:http://creativecommons.org/licenses/by/4.0/
Description:This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.

Secondary language

Language:Slovenian
Keywords:globoki generativni modeli, slikovna biometrija, difuzijski modeli, fotoroboti

Projects

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:P2-0250
Name:Metrologija in biometrični sistemi

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:P2-0214
Name:Računalniški vid

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:J2-50065
Name:Odkrivanje globokih ponaredkov z metodami zaznave anomalij (DeepFake DAD)

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Back