Constraint-driven neural network architecture adaptation for image localisation on a miniature mobile robot

Pleterski, Jan (avtor), Puc, Jernej (avtor), Vrabič, Rok (avtor), Podržaj, Primož (avtor), Škulj, Gašper (avtor)

Deploying deep learning models on low-power devices is an increasingly important research challenge. Microcontrollers, in particular, have strict limitations due to the limited processing power and memory. Specifically, object localisation on such devices remains in the early stages of research, showing the need for architectural designs tailored to resource-constrained environments. In this work, we implement and evaluate different architectural configurations of deep learning models on a miniature mobile robot operating in a granular, sand-like terrain, where both robots and rocks must be localised as a prerequisite for robust navigation. The localisation models are based on the MobileNetV2 architecture utilising the FOMO (Faster Objects, More Objects) algorithm with dynamic convolutions. The proposed system consists of an HM01B0 greyscale camera integrated with a low-power RP2040 microcontroller. The object detection models are trained on a custom dataset consisting of 10,000 greyscale images (160×160 px) featuring robots and rocks. Our findings indicate that the best trade-offs between accuracy and memory are achieved by truncating the middle layers of the base model, balancing output resolution with retained pre-trained features and classifier complexity. Additionally, the results indicate that increasing the input image resolution produces a greater improvement in accuracy compared to expanding the model’s classifier head, relative to the increase in inference time. This study presents the first large-scale variation of FOMO truncations for the purpose of object localisation on low-power microcontrollers and offers practical guidance for selecting neural network architectures.

• Jezik: Angleški jezik
• Ključne besede: convolutional neural network, low-power, microcontroller, miniature mobile robot, MobileNet, object localisation, tiny machine learning, TinyML
• Vrsta gradiva: Članek v reviji
• Tipologija: 1.01 - Izvirni znanstveni članek
• Organizacija: FS - Fakulteta za strojništvo
• Status publikacije: Objavljeno
• Različica publikacije: Objavljena publikacija
• Leto izida: 2026
• Št. strani: Str. 13497-13506
• Številčenje: Vol. 26, no. 9
• PID: 20.500.12556/RUL-182360
• UDK: 681.527.7:004.4
• ISSN pri članku: 1530-437X
• DOI: 10.1109/JSEN.2026.3674225
• COBISS.SI-ID: 275091971
• Datum objave v RUL: 08.05.2026

Gradivo je del revije

• Naslov: IEEE sensors journal
• Skrajšan naslov: IEEE sens. j.
• Založnik: Institute of Electrical and Electronics Engineers
• ISSN: 1530-437X
• COBISS.SI-ID: 22563589

Licence

• Licenca: CC BY 4.0, Creative Commons Priznanje avtorstva 4.0 Mednarodna
• Povezava: http://creativecommons.org/licenses/by/4.0/deed.sl
• Opis: To je standardna licenca Creative Commons, ki daje uporabnikom največ možnosti za nadaljnjo uporabo dela, pri čemer morajo navesti avtorja.

Sekundarni jezik

• Jezik: Slovenski jezik
• Ključne besede: konvolucijske nevronske mreže, nizka moč, mikrokrmilniki, miniaturni roboti, MobileNet, lokalizacija objektov, TinyML

Projekti

• Financer: ARIS - Javna agencija za znanstvenoraziskovalno in inovacijsko dejavnost Republike Slovenije
• Številka projekta: P2-0270
• Naslov: Proizvodni sistemi, laserske tehnologije in spajanje materialov