Teaching approach for deep reinforcement learning of robotic strategies

Podobnik, Janez (avtor), Udir, Ana (avtor), Munih, Marko (avtor), Mihelj, Matjaž (avtor)

This paper presents the development of a teaching approach for Reinforcement Learning (RL) for students at the Faculty of Electrical Engineering, University of Ljubljana. The approach is designed to introduce students to the basic concepts, approaches, and algorithms of RL through examples and experiments in both simulation environments and on a real robot. The approach includes practical programs written in Python and presents various RL algorithms. The Q-learning algorithm is introduced and a deep Q network is implemented to introduce the use of neural networks in deep RL. The software is user-friendly and allows easy modification of learning parameters, reward functions, and algorithms. The approach was tested successfully on a Franka Emika Panda robot, where the robot manipulator learned to move to a randomly generated target position, shoot a real ball into the goal, and push various objects into target position. The goal of the presented teaching approach is to serve as a study aid for future generations of students of robotics to help them better understand the basic concepts of RL and apply them to a wide variety of problems.

• Jezik: Angleški jezik
• Ključne besede: augmented reality, reinforcement learning, robotics education, sensors
• Vrsta gradiva: Članek v reviji
• Tipologija: 1.01 - Izvirni znanstveni članek
• Organizacija: FE - Fakulteta za elektrotehniko
• Status publikacije: Objavljeno
• Različica publikacije: Objavljena publikacija
• Leto izida: 2024
• Št. strani: 16 str.
• Številčenje: Vol. 32, iss. 6, art. e22780
• PID: 20.500.12556/RUL-164875
• UDK: 007.52:37.091.3
• ISSN pri članku: 1099-0542
• DOI: 10.1002/cae.22780
• COBISS.SI-ID: 202411267
• Datum objave v RUL: 14.11.2024

Gradivo je del revije

• Naslov: Computer applications in engineering education
• Skrajšan naslov: Comput. appl. eng. educ.
• Založnik: Wiley
• ISSN: 1099-0542
• COBISS.SI-ID: 62994689

Licence

• Licenca: CC BY-NC 4.0, Creative Commons Priznanje avtorstva-Nekomercialno 4.0 Mednarodna
• Povezava: http://creativecommons.org/licenses/by-nc/4.0/deed.sl
• Opis: Licenca Creative Commons, ki prepoveduje komercialno uporabo, vendar uporabniki ne rabijo upravljati materialnih avtorskih pravic na izpeljanih delih z enako licenco.

Sekundarni jezik

• Jezik: Slovenski jezik
• Ključne besede: obogatena resničnost, spodbujevalno okolje, izobraževanje robotike, senzorji

Projekti

• Financer: ARRS - Agencija za raziskovalno dejavnost Republike Slovenije
• Številka projekta: P2-0228
• Naslov: Analiza in sinteza gibanja pri človeku in stroju