Details

SARSA ali DQN za krmiljenje baterijskega hranilnika
ID Sivec, Andraž (Author), ID Meža, Marko (Author)

.pdfPDF - Presentation file, Download (520,96 KB)
MD5: 5AA4E08DC8D11E00A13C4CCF14BE423F
URLURL - Source URL, Visit https://ev.fe.uni-lj.si/1-2-2026/Sivec.pdf This link opens in a new window

Abstract
Zaradi porasta proizvodnje električne energije iz sončnih in vetrnih virov se pojavlja problem viškov generacije in negativnih cen elektrike, kar vpliva na stabilnost elektroenergetskega sistema. Kot možna rešitev se vse bolj uveljavlja uporaba baterijskih hranilnikov, ki pa zahtevajo učinkovito upravljanje za najboljši učinek. V članku primerjamo delovanje dveh metod spodbujevalnega učenja pri optimizaciji delovanja baterije: tabelarično metodo SARSA in metodo z nevronsko mrežo DQN. Agenta se učita na podlagi zgodovinskih podatkov o proizvodnji sončne elektrarne, porabi gospodinjstva in tržnih cenah elektrike, njun cilj pa je minimizacija stroškov nakupa energije. Rezultati kažejo, da uporaba obeh pristopov bistveno zmanjša stroške v primerjavi s primerom brez baterije. DQN dosega najboljše rezultate, saj se bolje prilagodi kompleksnim vzorcem v podatkih in boljše deluje v večjih prostorih stanj. Raziskava potrjuje, da lahko spodbujevalno učenje učinkovito podpira odločanje pri upravljanju hranilnikov in prispeva k večji ekonomski učinkovitosti ter stabilnosti energetskega ˇ sistema ter prikaze nekatere izzive pri implementaciji.

Language:Slovenian
Keywords:spodbujevalno učenje, zeleni prehod, primerjava algoritmov, optimizacija krmiljenja baterije po ceni
Work type:Article
Typology:1.01 - Original Scientific Article
Organization:FE - Faculty of Electrical Engineering
Publication status:Published
Publication version:Version of Record
Year:2026
Number of pages:Str. 63-68
Numbering:Letn. 93, št. 1/2
PID:20.500.12556/RUL-182836 This link opens in a new window
UDC:621.311.243:004.85
ISSN on article:0013-5852
COBISS.SI-ID:279259395 This link opens in a new window
Publication date in RUL:25.05.2026
Views:266
Downloads:160
Metadata:XML DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Record is a part of a journal

Title:Elektrotehniški vestnik
Publisher:Strokovna zadruga koncesijoniranih elektrotehnikov, Elektrotehniška zveza Slovenije
ISSN:0013-5852
COBISS.SI-ID:742916 This link opens in a new window

Licences

License:CC BY 4.0, Creative Commons Attribution 4.0 International
Link:http://creativecommons.org/licenses/by/4.0/
Description:This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.

Secondary language

Language:English
Title:A comparison of tabular and deep reinforcement learning for battery management
Abstract:
The increasing share of solar and wind energy production introduces challenges related to excess electricity generation and its negative prices, which affect the stability of power systems. Battery storage is emerging as a promising solution, but its optimal operation requires advanced control strategies. This paper compares two reinforcement learning methods for battery management: the tabular SARSA and the deep QNetwork (DQN) method. Both methods are trained on historical data from a photovoltaic plant and electricity market prices, with the objective of minimizing energy purchase costs. The results demonstrate that both methods significantly reduce the costs compared to the baseline without storage, with DQN outperforming SARSA due to its ability to capture complex patterns and handle continuous data input. The findings confirm that reinforcement learning can effectively support decision-making in energy storage management, contributing to improved economic efficiency and system stability while also highlighting some implementation challenges, such as training instability and sensitivity to hyperparameters.

Keywords:reinforcement learning, green transition, algorithm comparison, optimization of battery control based on price

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Collection

This document is a part of these collections:
  1. Elektrotehniški vestnik

Back