Distance-dependent multimodal image registration for agriculture tasks

Berenstein, Ron (author), Hočevar, Marko (author), Godeša, Tone (author), Edan, Yael (author), Ben-Shahar, Ohad (author)

Image registration is the process of aligning two or more images of the same scene taken at different times; from different viewpoints; and/or by different sensors. This research focuses on developing a practical method for automatic image registration for agricultural systems that use multimodal sensory systems and operate in natural environments. While not limited to any particular modalities; here we focus on systems with visual and thermal sensory inputs. Our approach is based on pre-calibrating a distance-dependent transformation matrix (DDTM) between the sensors; and representing it in a compact way by regressing the distance-dependent coefficients as distance-dependent functions. The DDTM is measured by calculating a projective transformation matrix for varying distances between the sensors and possible targets. To do so we designed a unique experimental setup including unique Artificial Control Points (ACPs) and their detection algorithms for the two sensors. We demonstrate the utility of our approach using different experiments and evaluation criteria.

• Language: English
• Keywords: sensor registration, control points, artificial control points, sensor fusion
• Work type: Article
• Typology: 1.01 - Original Scientific Article
• Organization: FS - Faculty of Mechanical Engineering
• Publication status: Published
• Publication version: Version of Record
• Year: 2015
• Number of pages: Str. 20845-20862
• Numbering: Vol. 15, iss. 8
• PID: 20.500.12556/RUL-130485
• UDC: 631.3:681.586.5(045)
• ISSN on article: 1424-8220
• DOI: 10.3390/s150820845
• COBISS.SI-ID: 14123035
• Publication date in RUL: 15.09.2021

Record is a part of a journal

• Title: Sensors
• Shortened title: Sensors
• Publisher: MDPI
• ISSN: 1424-8220
• COBISS.SI-ID: 10176278

Licences

• License: CC BY 4.0, Creative Commons Attribution 4.0 International
• Link: http://creativecommons.org/licenses/by/4.0/
• Description: This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.
• Licensing start date: 21.08.2015

Secondary language

• Language: Slovenian
• Keywords: registracija senzorjev, kontrolne točke, umetne kontrolne točke, fuzija senzorjev