A new dataset and a distractor-aware architecture for transparent object tracking

Lukežič, Alan (author), Trojer, Žiga (author), Matas, Jiří (author), Kristan, Matej (author)

Performance of modern trackers degrades substantially on transparent objects compared to opaque objects. This is largely due to two distinct reasons. Transparent objects are unique in that their appearance is directly affected by the background. Furthermore, transparent object scenes often contain many visually similar objects (distractors), which often lead to tracking failure. However, development of modern tracking architectures requires large training sets, which do not exist in transparent object tracking. We present two contributions addressing the aforementioned issues. We propose the first transparent object tracking training dataset Trans2k that consists of over 2k sequences with 104,343 images overall, annotated by bounding boxes and segmentation masks. Standard trackers trained on this dataset consistently improve by up to 16%. Our second contribution is a new distractor-aware transparent object tracker (DiTra) that treats localization accuracy and target identification as separate tasks and implements them by a novel architecture. DiTra sets a new state-of-the-art in transparent object tracking and generalizes well to opaque objects.

• Language: English
• Keywords: visual object tracking, tracking transparent objects, deep learning, distractors
• Work type: Article
• Typology: 1.01 - Original Scientific Article
• Organization: FRI - Faculty of Computer and Information Science
• Publication status: Published
• Publication version: Version of Record
• Year: 2024
• Number of pages: Str. 2729–2742
• Numbering: Vol. 132, iss. 8
• PID: 20.500.12556/RUL-155777
• UDC: 004.93:004.8
• ISSN on article: 0920-5691
• DOI: 10.1007/s11263-024-02010-0
• COBISS.SI-ID: 186509827
• Publication date in RUL: 17.04.2024

Record is a part of a journal

• Title: International journal of computer vision
• Shortened title: Int. j. comput. vis.
• Publisher: Springer Nature
• ISSN: 0920-5691
• COBISS.SI-ID: 25641472

Licences

• License: CC BY 4.0, Creative Commons Attribution 4.0 International
• Link: http://creativecommons.org/licenses/by/4.0/
• Description: This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.

Secondary language

• Language: Slovenian
• Keywords: vizualno sledenje objektov, sledenje prosojnih objektov, globoko učenje