Making the most of single sensor information : a novel fusion approach for 3D face recognition using region covariance descriptors and Gaussian mixture models
ID Križaj, Janez (Author), ID Dobrišek, Simon (Author), ID Štruc, Vitomir (Author)

.pdfPDF - Presentation file, Download (1,55 MB)
URLURL - Source URL, Visit https://www.mdpi.com/1424-8220/22/6/2388 This link opens in a new window

Most commercially successful face recognition systems combine information from multiple sensors (2D and 3D, visible light and infrared, etc.) to achieve reliable recognition in various environments. When only a single sensor is available, the robustness as well as efficacy of the recognition process suffer. In this paper, we focus on face recognition using images captured by a single 3D sensor and propose a method based on the use of region covariance matrixes and Gaussian mixture models (GMMs). All steps of the proposed framework are automated, and no metadata, such as pre-annotated eye, nose, or mouth positions is required, while only a very simple clustering-based face detection is performed. The framework computes a set of region covariance descriptors from local regions of different face image representations and then uses the unscented transform to derive low-dimensional feature vectors, which are finally modeled by GMMs. In the last step, a support vector machine classification scheme is used to make a decision about the identity of the input 3D facial image. The proposed framework has several desirable characteristics, such as an inherent mechanism for data fusion/integration (through the region covariance matrixes), the ability to explore facial images at different levels of locality, and the ability to integrate a domain-specific prior knowledge into the modeling procedure. Several normalization techniques are incorporated into the proposed framework to further improve performance. Extensive experiments are performed on three prominent databases (FRGC v2, CASIA, and UMB-DB) yielding competitive results.

Keywords:biometrics, computer vision, 3D face recognition, fusion, covariance descriptors, face recognition, 3D images, local descriptors, statistical models
Work type:Article
Typology:1.01 - Original Scientific Article
Organization:FE - Faculty of Electrical Engineering
Publication status:Published
Publication version:Version of Record
Number of pages:26 str.
Numbering:Vol. 22, iss. 6, art. 2388
PID:20.500.12556/RUL-137514 This link opens in a new window
ISSN on article:1424-8220
DOI:10.3390/s22062388 This link opens in a new window
COBISS.SI-ID:101606403 This link opens in a new window
Publication date in RUL:20.06.2022
Copy citation
Share:Bookmark and Share

Record is a part of a journal

Shortened title:Sensors
COBISS.SI-ID:10176278 This link opens in a new window


License:CC BY 4.0, Creative Commons Attribution 4.0 International
Description:This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.
Licensing start date:20.03.2022

Secondary language

Keywords:biometrija, računalniški vid, 3D razpoznavanje obrazov, fuzija, kovariančni opisniki


Funder:ARRS - Slovenian Research Agency
Project number:P2-0250
Name:Metrologija in biometrični sistemi

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections: