Quantitative contact-less estimation of energy expenditure from video and 3D imagery

Koporec, Gregor (author), Vučković, Goran (author), Milić, Radoje (author), Perš, Janez (author)

Measurement of energy expenditure is an important tool in sport science and medicine, especially when trying to estimate the extent and intensity of physical activity. However, most approaches still rely on sensors or markers, placed directly on the body. In this paper, we present a novel approach using a fully contact-less, fully automatic method, that relies on computer vision algorithms and widely available and inexpensive imaging sensors. We rely on the estimation of the optical and scene flow to calculate Histograms of Oriented Optical Flow (HOOF) descriptors, which we subsequently augment with the Histograms of Absolute Flow Amplitude (HAFA). Descriptors are fed into regression model, which allows us to estimate energy consumption, and to a lesser extent, the heart rate. Our method has been tested both in lab environment and in realistic conditions of a sport match. Results confirm that these energy expenditures could be derived from purely contact-less observations. The proposed method can be used with different modalities, including near infrared imagery, which extends its future potential.

• Language: English
• Keywords: physical activity, energy expenditure, computer vision, optical flow, scene flow, heart rate, support vector machine, RBF kernel, KCF tracker, Microsoft Kinect, time-of-flight sensor, squash
• Work type: Article
• Typology: 1.01 - Original Scientific Article
• Organization: FE - Faculty of Electrical Engineering; FŠ - Faculty of Sport
• Publication status: Published
• Publication version: Version of Record
• Publication date: 26.07.2018
• Year: 2018
• Number of pages: 32 str.
• Numbering: Vol. 18, iss. 8, art. 2435
• PID: 20.500.12556/RUL-128749
• UDC: 004.8:796
• ISSN on article: 1424-8220
• DOI: 10.3390/s18082435
• COBISS.SI-ID: 12120148
• Publication date in RUL: 27.07.2021

Record is a part of a journal

• Title: Sensors
• Shortened title: Sensors
• Publisher: MDPI
• ISSN: 1424-8220
• COBISS.SI-ID: 10176278

Licences

• License: CC BY 4.0, Creative Commons Attribution 4.0 International
• Link: http://creativecommons.org/licenses/by/4.0/
• Description: This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.
• Licensing start date: 26.07.2018

Secondary language

• Language: Slovenian
• Keywords: telesna aktivnost, energijska poraba, računalniški vid, optični tok, prostorski tok