Quantitative contact-less estimation of energy expenditure from video and 3D imagery
ID Koporec, Gregor (Author), ID Vučković, Goran (Author), ID Milić, Radoje (Author), ID Perš, Janez (Author)

.pdfPDF - Presentation file, Download (7,87 MB)
MD5: 607FA48151673A572C1797C8AF14AE67
URLURL - Source URL, Visit http://www.mdpi.com/1424-8220/18/8/2435 This link opens in a new window

Measurement of energy expenditure is an important tool in sport science and medicine, especially when trying to estimate the extent and intensity of physical activity. However, most approaches still rely on sensors or markers, placed directly on the body. In this paper, we present a novel approach using a fully contact-less, fully automatic method, that relies on computer vision algorithms and widely available and inexpensive imaging sensors. We rely on the estimation of the optical and scene flow to calculate Histograms of Oriented Optical Flow (HOOF) descriptors, which we subsequently augment with the Histograms of Absolute Flow Amplitude (HAFA). Descriptors are fed into regression model, which allows us to estimate energy consumption, and to a lesser extent, the heart rate. Our method has been tested both in lab environment and in realistic conditions of a sport match. Results confirm that these energy expenditures could be derived from purely contact-less observations. The proposed method can be used with different modalities, including near infrared imagery, which extends its future potential.

Keywords:physical activity, energy expenditure, computer vision, optical flow, scene flow, heart rate, support vector machine, RBF kernel, KCF tracker, Microsoft Kinect, time-of-flight sensor, squash
Work type:Article
Typology:1.01 - Original Scientific Article
Organization:FE - Faculty of Electrical Engineering
FŠ - Faculty of Sport
Publication status:Published
Publication version:Version of Record
Publication date:26.07.2018
Number of pages:32 str.
Numbering:Vol. 18, iss. 8, art. 2435
PID:20.500.12556/RUL-128749 This link opens in a new window
ISSN on article:1424-8220
DOI:10.3390/s18082435 This link opens in a new window
COBISS.SI-ID:12120148 This link opens in a new window
Publication date in RUL:27.07.2021
Copy citation
Share:Bookmark and Share

Record is a part of a journal

Shortened title:Sensors
COBISS.SI-ID:10176278 This link opens in a new window


License:CC BY 4.0, Creative Commons Attribution 4.0 International
Description:This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.
Licensing start date:26.07.2018

Secondary language

Keywords:telesna aktivnost, energijska poraba, računalniški vid, optični tok, prostorski tok


Funder:ARRS - Slovenian Research Agency
Project number:P2-0095
Name:Vzporedni in porazdeljeni sistemi

Funder:ARRS - Slovenian Research Agency
Project number:P5-0147
Name:Kineziologija monostrukturnih, polistrukturnih in konvencionalnih športov

Funder:ARRS - Slovenian Research Agency
Project number:J2-8175
Name:Robustne metode računalniškega vida za avtonomna robotska plovila

Funder:Other - Other funder or multiple funders
Funding programme:Slovenia
Project number:C3330-16-529000

Funder:EC - European Commission
Funding programme:ERDF

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections: