Sinhronizacija geografskih in statističnih podatkov

MANFREDA, TIMOTEJ (author), Zrnec, Aljaž (mentor)

V podjetju Flycom Technologies, d. o. o., smo se srečali s problemom vzdrževanja javnih geografskih in statističnih podatkov v interni aplikaciji LIFT, ki je nameščena na naših programskih okoljih ter na okoljih strank. Glavni cilj te naloge je pridobiti, obdelati in uvoziti te podatke v podatkovno bazo v taki obliki, da jih bo aplikacija LIFT lahko prebrala. Pri načrtovanju rešitve tega problema je bil poudarek predvsem na modularnosti aplikacije, da bomo lahko v prihodnosti dodali več virov oz. ponudnikov javnih podatkov. Izdelali smo aplikacijo v ogrodju Laravel, ki pridobi javne podatke iz GURS portala EGP ali JGP in jih uvozi v podatkovno bazo PostGIS. Te podatke lahko zbiramo v polni obliki ali pa zbiramo samo spremembe med lokalnim in oddaljenim stanjem. Te podatke prikazujemo preko API v formatu JSON, ki ga aplikacija LIFT lahko prebere.

• Language: Slovenian
• Keywords: geografija, statistika, podatki, sinhronizacija, GIS, geografski informacijski sistem, spletno strganje
• Work type: Bachelor thesis/paper
• Typology: 2.11 - Undergraduate Thesis
• Organization: FRI - Faculty of Computer and Information Science
• Year: 2024
• PID: 20.500.12556/RUL-164043
• COBISS.SI-ID: 214812163
• Publication date in RUL: 16.10.2024

Secondary language

• Language: English
• Title: Synchronization of geographic and statistical data

Abstract

In the company Flycom Technologies, d. o. o., we were met with a problem of maintaining public geographic and statistical data in internal application called LIFT, which is installed on our own environments and that of our clients. The main objective of this thesis is to acquire, process and import public data into a database in a format that the LIFT application will be able to read. When planning a solution to this problem, the main focus was on modularity of the application, so we could add more resources or providers of public data in the future. We created an application in the Laravel framework, which obtains public data from GURS' EGP or JGP portal and import them into PostGIS database. This data can be collected in full form or only in form of changes between local and remote state. This data is served via the API in JSON format, which can be read by LIFT application.

• Keywords: geography, statistics, data, synchronization, GIS, geographic information system, web scraping