From perception to precision : vision-based mobile robotic manipulation for assembly screwdriving

Stefanov, Aleksandar (avtor), Zorman, Miha (avtor), Šlajpah, Sebastjan (avtor), Podobnik, Janez (avtor), Mihelj, Matjaž (avtor), Munih, Marko (avtor)

Flexible manufacturing demands automation that is both precise and adaptable. However, tasks such as screwdriving are typically automated using costly, rigid robotic cells, making this approach impractical for low-volume, high-mix production. As a scalable solution, mobile manipulators offer a flexible alternative, but achieving the required precision for screwdriving remains challenging due to localization uncertainties. This paper addresses these limitations by presenting a vision-guided mobile robotic manipulation system that performs high-precision screwdriving using only monocular RGB imagery. The proposed pipeline integrates stationary and onboard cameras with perception algorithms for object identification and segmentation, pose estimation, and CAD-based screw hole localization, compensating for base misalignment and object placement variability. Experimental validation using ISO 9283 standard’s metrics demonstrates a translational accuracy between 0.21 mm and 0.50 mm across multiple screw positions. Additionally, the system achieves angular estimation errors as low as 0.07◦ to 0.20◦ , verifying its capability for sub-degree precision in orientation estimation. In 50 independent experiments involving a total of 400 screw insertions, the system achieved a 100 % success rate, confirming its reliability in practical conditions. These results confirm the feasibility of using RGB-only vision for precision screwdriving and highlight the mobile manipulation system’s scalability for real-world semi-structured manufacturing environments.

• Jezik: Angleški jezik
• Ključne besede: mobile manipulation, vision-based control screwdriving, robotics, perception algorithms assembly automation
• Vrsta gradiva: Članek v reviji
• Tipologija: 1.01 - Izvirni znanstveni članek
• Organizacija: FE - Fakulteta za elektrotehniko
• Status publikacije: Objavljeno
• Različica publikacije: Objavljena publikacija
• Leto izida: 2026
• Št. strani: 16 str.
• Številčenje: Vol. 98, art 103148
• PID: 20.500.12556/RUL-174614
• UDK: 007.52
• ISSN pri članku: 0736-5845
• DOI: 10.1016/j.rcim.2025.103148
• COBISS.SI-ID: 252036611
• Datum objave v RUL: 07.10.2025

Licence

• Licenca: CC BY 4.0, Creative Commons Priznanje avtorstva 4.0 Mednarodna
• Povezava: http://creativecommons.org/licenses/by/4.0/deed.sl
• Opis: To je standardna licenca Creative Commons, ki daje uporabnikom največ možnosti za nadaljnjo uporabo dela, pri čemer morajo navesti avtorja.

Sekundarni jezik

• Jezik: Slovenski jezik
• Ključne besede: mobilna manipulacija, računalniški vid, vijačenje robotika, algoritmi zaznave avtomatizirano sestavljanje