izpis_h1_title_alt

Odkrivanje globokih ponaredkov z analizo spremenjenih in nespremenjenih območij
ID Mur, Anže (Author), ID Peer, Peter (Mentor) More about this mentor... This link opens in a new window, ID Batagelj, Borut (Comentor)

.pdfPDF - Presentation file, Download (11,70 MB)
MD5: 5C9FF6B7DDDA91BED6F74B20A9A6EFA2

Abstract
Hiter razvoj na področju globokega učenja je privedel do množične adaptacije koncepta globokih ponaredkov. Globoki ponaredki so sintetični mediji, ki so velikokrat ustvarjeni zlonamerno in tako postajajo vse večji izziv za sodobno družbo. S tem razlogom je ključnega pomena razviti robustne in učinkovite metode za zaznavanje globokih ponaredkov, da bi preprečili njihovo zlonamerno uporabo. V našem delu smo implementirali konvolucijsko nevronsko mrežo Xception, ki smo jo nadgradili z arhitekturo, da deluje po principu dveh ločenih vej učenja. Prva veja se uči samo na manipulirani obrazni regiji, druga veja pa si za napovedovanje končnega rezultata pomaga tudi z nespremenjenimi regijami izven obraza. Implementirana dvovejna arhitektura izboljša delovanje osnovnega Xception modela za 2,45 % vrednosti AUC iz prvotne vrednosti 69,76 %. Implementirana modela smo dodatno učili tudi na novo ustvarjeni sintetični podatkovni zbirki artefaktov globokih ponaredkov, kjer Xception model doseže izboljšavo vrednosti AUC osnovnega modela za 12,5 % iz prvotne vrednosti 69,76 %.

Language:Slovenian
Keywords:globoko učenje, konvolucijske nevronske mreže, detekcija globokih ponaredkov
Work type:Master's thesis/paper
Typology:2.09 - Master's Thesis
Organization:FRI - Faculty of Computer and Information Science
Year:2023
PID:20.500.12556/RUL-150616 This link opens in a new window
COBISS.SI-ID:170117635 This link opens in a new window
Publication date in RUL:21.09.2023
Views:736
Downloads:129
Metadata:XML DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Secondary language

Language:English
Title:Deepfake detection based on the analysis of the manipulated and non-manipulated regions
Abstract:
The rapid development in the field of deep learning has led to the general adoption of the deepfake concept. Deepfakes are synthetic media that are often created maliciously and therefore pose an increasingly significant challenge to modern society. For this reason, it is crucial to develop robust and effective methods for detecting deepfakes to prevent their malicious use. In our work, we implemented the Xception convolutional neural network, which we upgraded with an architecture that operates on the principle of two separate learning branches. The first branch learns only on the manipulated facial region, while the second branch uses non-manipulated regions outside of the face region to predict the final result. The implemented dual-branch architecture improves the performance of the baseline Xception model by 2.45 % in terms of AUC value from the original value of 69.76 %. We additionally trained the implemented models on a newly created synthetic dataset of deepfake artifacts, where the Xception model achieves a 12.5 % improvement in the AUC value of the baseline model with the value of 69.76 %

Keywords:deep learning, convolutional neural networks, deepfake detection

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Back