Details

Optimizacija parametrov in arhitekture nevronskih mrež s pomočjo genetskih algoritmov
ID Naglič, Vita (Author), ID Vračar, Petar (Mentor) More about this mentor... This link opens in a new window

.pdfPDF - Presentation file, Download (26,27 MB)
MD5: A812C1E58424F64E3ED6DD0070616705

Abstract
V diplomskem delu je predstavljena optimizacija arhitektur nevronskih mrež z uporabo genetskih algoritmov. Glavni izziv predstavlja sočasno določanje arhitekture in hiperparametrov, kar je pri klasičnih pristopih pogosto zamudno in neučinkovito. Razvit je bil kromosomski zapis, ki v enotni obliki združuje hiperparametre in parametre skritih plasti, ter postopki selekcije, mutacije in več načinov križanja. Definirana je bila funkcija uspešnosti, ki poleg uspešnosti učenja upošteva kazen za kompleksnost, ter progresivni urnik učenja. V nalogi smo oblikovali celovit algoritem za samodejno iskanje ustreznih arhitektur in hiperparametrov ter ga primerjali z algoritmom NEAT. Predlagani pristop smo ovrednotili na šestih podatkovnih zbirkah iz repozitorija UCI in pokazali, da dosega konkurenčne rezultate glede napovedne uspešnosti, vendar na račun večje kompleksnosti in časovne zahtevnosti v primerjavi z algoritmom NEAT, ki gradi enostavnejše arhitekture in je hitrejši.

Language:Slovenian
Keywords:genetski algoritmi, nevronske mreže, optimizacija arhitektur, optimizacija hiperparametrov, algoritem NEAT
Work type:Bachelor thesis/paper
Typology:2.11 - Undergraduate Thesis
Organization:FRI - Faculty of Computer and Information Science
Year:2025
PID:20.500.12556/RUL-173262 This link opens in a new window
COBISS.SI-ID:250506243 This link opens in a new window
Publication date in RUL:15.09.2025
Views:469
Downloads:197
Metadata:XML DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Secondary language

Language:English
Title:Optimization of Neural Network Parameters and Architectures Using Genetic Algorithms
Abstract:
This thesis presents the optimization of neural network architectures using genetic algorithms. A key challenge in this area is the simultaneous determination of both network architecture and training hyperparameters, which in traditional approaches is often time-consuming and inefficient. To address this, we developed a chromosome representation that encodes hyperparameters and hidden layer parameters in a unified way, together with procedures for selection, mutation, and multiple crossover strategies. The approach incorporates a fitness function that balances predictive performance with a penalty for model complexity, as well as a progressive learning schedule. Based on these components, we designed a comprehensive algorithm for the automated search of suitable architectures and hyperparameters and compared it against the NEAT algorithm. The proposed method was evaluated on six benchmark datasets from the UCI repository, demonstrating competitive predictive performance, though at the cost of higher complexity and computational demand compared to NEAT, which produced simpler and faster models.

Keywords:genetic algorithms, neural networks, architecture optimization, hyperparameter optimization, NEAT algorithm

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Back