Sistem obogatene resničnosti za asistenco pri vzdrževalnih in sestavljalnih delih

KRHLIKAR, ROK (author), Guna, Jože (mentor)

Cilj te magistrske naloge je izdelava sistema, ki omogoča komunikacijo in asistenco na daljavo pri izvajanju vzdrževalnih ali sestavljalnih del z uporabo obogatene resničnosti. Realiziran je bil sistem, ki z uporabo RTP in RTSP protokolov omogoča dvosmerno avdio-vizualno komunikacijo med uporabniki, s pomočjo TCP vtičnic (angl. socket) pa omogoča tudi izmenjavo podatkov o obravnavanih sistemih in obogatitvah. Izdelan je bil aplikacijski strežnik, ki skrbi za izmenjavo podatkov in spletni vmesnik, ki omogoča dostop do audio-video vsebin iz oddaljene naprave. Na drugi strani je bila izdelana aplikacija za prosojna očala za obogateno resničnost, ki komunicira z našim strežnikom. Testna aplikacija je namenjena asistenci pri vzdrževanju električnih omaric ali za njihovo sestavljanje.

• Language: Slovenian
• Keywords: obogatena resničnost, RTP, RTSP, TCP vtičnica, avdio-video komunikacija
• Work type: Master's thesis/paper
• Organization: FE - Faculty of Electrical Engineering
• Year: 2017
• PID: 20.500.12556/RUL-96369
• Publication date in RUL: 29.09.2017

Secondary language

• Language: English
• Title: Augmented reality system for remote assembly tasks assistance

Abstract

The goal of this thesis is the development of a system that allows the user to communicate and assist with maintenance and assembly tasks over long distances with the help of augmented reality. The developed system uses RTP and RTSP protocols to allow audio-visual communication. Using TCP sockets it also allows for exchanging data about the device under assembly, the remote system being worked on and augmentation data. To that end an application server was implemented which exchanges data between the device and web interface which displays the audio-visual data from a remote device. On the other side an augmented reality app for use with see-through augmented reality glasses was developed. The test application is used for assisstance in electrical control systems maintenance or assembly.

• Keywords: augmented reality, RTP, RTSP, TCP socket, audio-video communication