izpis_h1_title_alt

Poenostavitev ETL procesa z uporabo platforme Talend
ID ČUFER, TOMAŽ (Author), ID Lavbič, Dejan (Mentor) More about this mentor... This link opens in a new window

.pdfPDF - Presentation file, Download (1,89 MB)
MD5: A21C92945AF02EF64CF0AECCEC7BF2BF
PID: 20.500.12556/rul/b46f4b1b-6e52-4026-82f5-d354b22ee149

Abstract
ETL proces predstavlja širok pojem pridobivanja, preoblikovanja in nalaganja podatkov. Vsaka izmed faz potrebuje podrobno definiran postopek, ki bo podatke prenesel na drugo lokacijo ali preoblikoval v potrebno obliko. Nestrukturirana oblika podatkov in njihova velika količina, ki sta pogosti danes, proces še dodatno otežujeta, kar podaljšuje njegovo izvedbo. S primernim ETL orodjem lahko poenostavimo implementacijo procesa in zagotovimo boljši nadzor nad izvajanjem. V diplomski nalogi se je s takim orodjem hotelo pokazati, kako to poenostavitev narediti v praksi. Primerjani sta dve komercialni in odprtokodni orodji. Izbrano je bilo orodje Talend in nato podrobneje predstavljeno njeno delovanje. Opisano je reševanje problemov z obvladovanjem ter integracijo podatkov pridobljenih s spletnim luščenjem in iz socialnega omrežja Twitter. Za orodje je na koncu opravljena še SWOT analiza.

Language:Slovenian
Keywords:opravilo, proces, integracija podatkov, Talend, orodje, podatkovno skladišče
Work type:Bachelor thesis/paper
Organization:FRI - Faculty of Computer and Information Science
Year:2015
PID:20.500.12556/RUL-30663 This link opens in a new window
Publication date in RUL:24.03.2015
Views:2161
Downloads:310
Metadata:XML RDF-CHPDL DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Secondary language

Language:English
Title:Simplification of ETL processes using Talend Platform
Abstract:
The ETL process presents a broad concept of extracting, transforming and loading data. Each of these phases needs to be well defined to transfer the data efficiently to a different location or transform it into the demanded form. Unstructured forms of data along with its huge volume, which is common nowadays, makes this process even more difficult, and is reflected in the longer execution time. With a suitable ETL tool it is possible to simplify the implementation process and assure better control over it. The thesis describes how to complete such simplifications using an appropriate tool in practice. Two commercial and open source tools were compared. Talend tool was chosen and its workflow was later presented in detail. Handling management and integration problems of data is described, where the used data came from web scraping and the Twitter social network. At the end, a SWOT analysis was made for Talend tool.

Keywords:job, process, data integration, Talend, tool, data warehouse

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Back