Performance evaluation of rPPG approaches with and without the region-of-interest localization step
ID Pirnar, Žan (Author), ID Finžgar, Miha (Author), ID Podržaj, Primož (Author)

.pdfPDF - Presentation file, Download (1,78 MB)
URLURL - Source URL, Visit https://www.mdpi.com/2076-3417/11/8/3467 This link opens in a new window

Traditionally, the first step in physiological measurements based on remote photoplethysmography (rPPG) is localizing the region of interest (ROI) that contains a desired pulsatile information. Recently, approaches that do not require this step have been proposed. The purpose of this study was to evaluate the performance of selected approaches with and without ROI localization step in rPPG signal extraction. The Viola-Jones face detector and Kanade–Lucas–Tomasi tracker (VK) in combination with (a) a region-of-interest (ROI) cropping, (b) facial landmarks, (c) skin-color segmentation, and (d) skin detection based on maximization of mutual information and an approach without ROI localization step (Full Video Pulse (FVP)) were studied. Final rPPG signals were extracted using selected model-based and data-driven rPPG algorithms. The performance of the approaches was tested on three publicly available data sets offering compressed and uncompressed video recordings covering various scenarios. The success rates of pulse waveform signal extraction range from 88.37% (VK with skin-color segmentation) to 100% (FVP). In challenging scenarios (skin tone, lighting conditions, exercise), there were no statistically significant differences between the studied approaches in terms of SNR. The best overall performance in terms of RMSE was achieved by a combination of VK with ROI cropping and the model-based rPPG algorithm. Results indicate that the selection of the ROI localization approach does not significantly affect rPPG measurements if combined with a robust algorithm for rPPG signal extraction.

Keywords:remote photoplethysmography, vital signs monitoring, remote sensing
Work type:Article
Typology:1.01 - Original Scientific Article
Organization:FS - Faculty of Mechanical Engineering
Publication status:Published
Publication version:Version of Record
Number of pages:17 str.
Numbering:Vol. 11, iss. 8, art. 3467
PID:20.500.12556/RUL-126408 This link opens in a new window
ISSN on article:2076-3417
DOI:10.3390/app11083467 This link opens in a new window
COBISS.SI-ID:60569859 This link opens in a new window
Publication date in RUL:21.04.2021
Copy citation
Share:Bookmark and Share

Record is a part of a journal

Title:Applied sciences
Shortened title:Appl. sci.
COBISS.SI-ID:522979353 This link opens in a new window


License:CC BY 4.0, Creative Commons Attribution 4.0 International
Description:This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.
Licensing start date:13.04.2021

Secondary language

Keywords:brezkontaktna fotopletizmografija, spremljanje vitalnih znakov, računalniška obdelava slik


Funder:ARRS - Slovenian Research Agency
Project number:P2-0270
Name:Proizvodni sistemi, laserske tehnologije in spajanje materialov

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections: