Teaching approach for deep reinforcement learning of robotic strategies

Podobnik, Janez (author), Udir, Ana (author), Munih, Marko (author), Mihelj, Matjaž (author)

This paper presents the development of a teaching approach for Reinforcement Learning (RL) for students at the Faculty of Electrical Engineering, University of Ljubljana. The approach is designed to introduce students to the basic concepts, approaches, and algorithms of RL through examples and experiments in both simulation environments and on a real robot. The approach includes practical programs written in Python and presents various RL algorithms. The Q-learning algorithm is introduced and a deep Q network is implemented to introduce the use of neural networks in deep RL. The software is user-friendly and allows easy modification of learning parameters, reward functions, and algorithms. The approach was tested successfully on a Franka Emika Panda robot, where the robot manipulator learned to move to a randomly generated target position, shoot a real ball into the goal, and push various objects into target position. The goal of the presented teaching approach is to serve as a study aid for future generations of students of robotics to help them better understand the basic concepts of RL and apply them to a wide variety of problems.

• Language: English
• Keywords: augmented reality, reinforcement learning, robotics education, sensors
• Work type: Article
• Typology: 1.01 - Original Scientific Article
• Organization: FE - Faculty of Electrical Engineering
• Publication status: Published
• Publication version: Version of Record
• Year: 2024
• Number of pages: 16 str.
• Numbering: Vol. 32, iss. 6, art. e22780
• PID: 20.500.12556/RUL-164875
• UDC: 007.52:37.091.3
• ISSN on article: 1099-0542
• DOI: 10.1002/cae.22780
• COBISS.SI-ID: 202411267
• Publication date in RUL: 14.11.2024

Record is a part of a journal

• Title: Computer applications in engineering education
• Shortened title: Comput. appl. eng. educ.
• Publisher: Wiley
• ISSN: 1099-0542
• COBISS.SI-ID: 62994689

Licences

• License: CC BY-NC 4.0, Creative Commons Attribution-NonCommercial 4.0 International
• Link: http://creativecommons.org/licenses/by-nc/4.0/
• Description: A creative commons license that bans commercial use, but the users don’t have to license their derivative works on the same terms.

Secondary language

• Language: Slovenian
• Keywords: obogatena resničnost, spodbujevalno okolje, izobraževanje robotike, senzorji

Projects

• Funder: ARRS - Slovenian Research Agency
• Project number: P2-0228
• Name: Analiza in sinteza gibanja pri človeku in stroju