izpis_h1_title_alt

Prepoznavanje globokih ponaredkov s konvolucijskimi nevronskimi mrežami
ID KRONOVŠEK, ANDREJ (Author), ID Peer, Peter (Mentor) More about this mentor... This link opens in a new window, ID Batagelj, Borut (Co-mentor)

.pdfPDF - Presentation file, Download (3,71 MB)
MD5: 2C6AED3B0C7EE922714A4C11CCDC6A21

Abstract
V okviru diplomskega dela smo si zadali nalogo, narediti model, ki bi učinkovito prepoznaval globoke ponaredke. Prijavili smo se na tekmovanje DeepFake Game Competition, na katerem smo prepoznavali ponaredke, ki so jih oddali naši sotekmovalci. Skozi proces razvoja modelov za detekcijo globokih ponaredkov smo preizkušali različne modele in ideje. Slike obrazov smo delili na več manjših, takšnih, ki bi zajemale del obraza, za katerega smo predpostavili, da ob ustvarjanju ponaredka postane popačen. V času poteka tekmovanja smo bili omejeni z zahtevami postavljenimi z njihove strani, naš najboljši model je bila fuzija modelov Xception in Efficient\-Net. Da so bili rezultati primerljivi, smo modele, celoten proces, tudi po končanem tekmovanju, učili na primerljivi množici podatkov. Po objavi baz, ki so jih sotekmovalci generirali in na katerih so naše modele testirali, smo ugotovili, da vsebujejo visoko mero šuma na obrazu. Usmerili smo se v izboljšanje rezultata na bazi tekmovanja in v cevovod dodali avtokodirnik, ki bi zaznal tovrsten šum. Končni model je sestavljen iz modelov Xception, EfficientNet, dodan pa je Skip-GANomaly, učen na dvakrat valjčno transformiranih vhodnih slikah. S tem modelom na omenjeni bazi dosežemo velikost območja pod ROC krivuljo enako 0,645902, kar bi nas na tekmovanju uvrstilo na 11. mesto od 28.

Language:Slovenian
Keywords:strojno učenje, nevronske mreže, globoki ponaredki
Work type:Bachelor thesis/paper
Typology:2.11 - Undergraduate Thesis
Organization:FRI - Faculty of Computer and Information Science
Year:2021
PID:20.500.12556/RUL-130300 This link opens in a new window
COBISS.SI-ID:77493251 This link opens in a new window
Publication date in RUL:13.09.2021
Views:1059
Downloads:198
Metadata:XML RDF-CHPDL DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Secondary language

Language:English
Title:Deepfake detection using convolutional neural networks
Abstract:
As part of the thesis, we set ourselves the task of creating a model that would effectively identify deepfakes. We entered the DeepFake Game Competition, where we recognized the fakes submitted by our teammates. Through the process of developing models for the detection of deepfakes, we tested different models and ideas. We divided images of faces into several smaller ones. Ones that would cover the part of the face which we assumed would become distorted when the fake was created. During the competition, we were limited by the requirements set by the organizers. To make the results comparable, we taught the models on a comparable set of data through the whole process, even after the end of the competition. After the publication of the databases generated by the competitors on which our models were tested, we found that they contained a high amount of noise. We focused on improving the result on the competition dataset and added an autoencoder to the pipeline that would detect the noise. The final model consists of the Xception, EfficientNet, and Skip-GANomaly models learned from 2-D second level wavelet transformed input images. With this model, on the mentioned dataset, we achieve the area under the ROC curve equal to 0.645902, which would place us in 11th place out of 28 competitors in the competition.

Keywords:machine learning, neural networks, deepfakes

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Back