Ogrodje za sistemsko testiranje procesa ETL

Ojo, Matija (author), Rožanc, Igor (mentor), Pavlovič, Raško (comentor)

Namen diplomske naloge je predstaviti ogrodje za sistemsko testiranje pro- cesa ETL. ETL je proces, ki prenaša podatke med različnimi sistemi zapisov. Podatke najprej prenese iz izvora, jih pretvori v ustrezno obliko ter naloži v ponorni sistem zapisov. ETL proces tako kot vhod dobi določeno stanje v izvornem sistemu zapisov, rezultat pa je spremenjeno stanje v drugem sis- temu zapisov. Na sistemskem nivoju se proces ETL testira s spreminjanjem in preverjanjem stanja (podatkov) v obeh sistemih zapisov, torej pred in po zagonu procesa ETL. Ogrodje za sistemsko testiranje je razdeljeno na jedrni ter zunanji del. Je- dro izvaja testni scenarij, medtem ko zunanji del upravlja s sistemi zapisov. Ogrodje je načrtovano kot razširljivo in mu je naknadno mogoče dodajati podporo za testiranje dodatnih sistemov zapisov. Arhitekturno je podobno procesu ETL, vendar je bolj preprosto, saj se uporablja zgolj za testiranje. Ogrodje je bilo umeščeno tudi v orodje za neprekinjeno integracijo, kar je imelo za posledico hitrejše pridobivanje testnih rezultatov. Rezultat diplomske naloge je testno ogrodje, ki razvojni ekipi pomaga pri hitrejšem odkrivanju napak v procesu ETL.

• Language: Slovenian
• Keywords: testiranje, avomatizacija, sistemsko testiranje, ogrodje za testiranje, neprekinjena integracija
• Work type: Bachelor thesis/paper
• Typology: 2.11 - Undergraduate Thesis
• Organization: FRI - Faculty of Computer and Information Science
• Year: 2023
• PID: 20.500.12556/RUL-149493
• COBISS.SI-ID: 163813635
• Publication date in RUL: 07.09.2023

OJO, Matija, 2023, Ogrodje za sistemsko testiranje procesa ETL [online]. Bachelor’s thesis. [Accessed 17 May 2025]. Retrieved from: https://repozitorij.uni-lj.si/IzpisGradiva.php?lang=eng&id=149493

Secondary language

• Language: English
• Title: Framework for system testing of the ETL process

Abstract

The aim of the diploma thesis is to present the framework for system testing of the ETL process. ETL is a process that transfers data between different systems of records. It first downloads the data from the source, converts it into the appropriate form and uploads it to the target system of records. ETL process actually receives a certain state on a source system of records as input and changes it into another system of records as an output. At the system level, the ETL process is tested by changing and checking the state (data) on the system of records before and after starting the ETL process. The framework for system testing is divided into a core and an external part. The core executes the test scenario, while the outer part manages the systems of records. The frame- work is designed as expandable as it supports addition of various systems of records. Architecturally it is similar to the ETL process, but it is simpler as it is used for testing only. The framework is inserted into a continuous integration tool, which resulted in faster retrieval of test results. The result of the thesis is a testing framework that helps the development team to faster detect errors in the ETL process.

• Keywords: testing, automation, End to End testing, testing framework, continuous integration