Face deidentification with controllable privacy protection

Meden, Blaž (author), Gonzalez-Hernandez, Manfred (author), Peer, Peter (author), Štruc, Vitomir (author)

Privacy protection has become a crucial concern in today’s digital age. Particularly sensitive here are facial images, which typically not only reveal a person’s identity, but also other sensitive personal information. To address this problem, various face deidentification techniques have been presented in the literature. These techniques try to remove or obscure personal information from facial images while still preserving their usefulness for further analysis. While a considerable amount of work has been proposed on face deidentification, most state-of-the-art solutions still suffer from various drawbacks, and (a) deidentify only a narrow facial area, leaving potentially important contextual information unprotected, (b) modify facial images to such degrees, that image naturalness and facial diversity is suffering in the deidentify images, (c) offer no flexibility in the level of privacy protection ensured, leading to suboptimal deployment in various applications, and (d) often offer an unsatisfactory trade-off between the ability to obscure identity information, quality and naturalness of the deidentified images, and sufficient utility preservation. In this paper, we address these shortcomings with a novel controllable face deidentification technique that balances image quality, identity protection, and data utility for further analysis. The proposed approach utilizes a powerful generative model (StyleGAN2), multiple auxiliary classification models, and carefully designed constraints to guide the deidentification process. The approach is validated across four diverse datasets (CelebA-HQ, RaFD, XM2VTS, AffectNet) and in comparison to 7 state-of-the-art competitors. The results of the experiments demonstrate that the proposed solution leads to: (a) a considerable level of identity protection, (b) valuable preservation of data utility, (c) sufficient diversity among the deidentified faces, and (d) encouraging overall performance.

• Language: English
• Keywords: face deidentification, privacy protection, data utility, privacy-enhancing technologies, face biometrics, deep learning
• Work type: Article
• Typology: 1.01 - Original Scientific Article
• Organization: FRI - Faculty of Computer and Information Science ; FE - Faculty of Electrical Engineering
• Publication status: Published
• Publication version: Version of Record
• Year: 2023
• Number of pages: 19 str.
• Numbering: Vol. 134, art. 104678
• PID: 20.500.12556/RUL-146103
• UDC: 004.93:57.087.1
• ISSN on article: 0262-8856
• DOI: 10.1016/j.imavis.2023.104678
• COBISS.SI-ID: 150487811
• Publication date in RUL: 19.05.2023

Record is a part of a journal

• Title: Image and vision computing
• Shortened title: Image vis. comput.
• Publisher: Elsevier
• ISSN: 0262-8856
• COBISS.SI-ID: 25590016

Licences

• License: CC BY 4.0, Creative Commons Attribution 4.0 International
• Link: http://creativecommons.org/licenses/by/4.0/
• Description: This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.

Secondary language

• Language: Slovenian
• Keywords: deidentifikacija obraza, varovanje zasebnosti, podatkovna uporabnost, tehnologije za izboljšanje zasebnosti, biometrija obrazov, globoko učenje