Porazdeljeno računalništvo kot storitev z uporabo vmesne programske opreme ARC

KRAŠOVEC, BARBARA (author), Ciglarič, Mojca (mentor), Filipčič, Andrej (comentor)

Postopki znanstvene računalniške obdelave so se v zadnjih letih hitro razvijali. Znanstvene programske rešitve so postajale vedno bolj kompleksne in zahtevajo za svojo obdelavo veliko količino računskih kapacitet. Močno je narasla uporaba arhitekture grid, ki je za uporabo precej zahtevna, a vendar jo za izvedbo svojih projektov in eksperimentov uporablja ogromno raziskovalcev. Računske in diskovne kapacitete so v gridu omejene, heterogene in pogosto polno zasedene. Heterogena ni le strojna oprema, temveč tudi programska oprema. Nastavitve in spremembe konfiguracije programske opreme v gridu so omejene, kar otežuje prilagajanja izvedbenih okolj in enostavno migracijo aplikacij iz grida v druge računalniške arhitekture. Uporaba arhitekture oblaka bi lahko v znanstvenem svetu odpravila veliko težav. V oblaku so kapacitete na voljo na zahtevo, lahko jih poljubno dodajamo in krčimo. Prav tako arhitektura omogoča več svobode pri izbiri programske opreme in nastavitvah le-te v oblačnih instancah. Zanimanje za združevanje arhitekture grida in oblaka je veliko, saj bi nova infrastruktura lahko omogočila povsem enostavno migracijo aplikacij iz grida v oblak ali obratno. Poraba računskih virov bi bila optimalna, zagotovljena bi bila razširljiva, zanesljiva in trajnostna arhitektura. Na področju oblakov, bi lahko Advanced Resource Connector (ARC) odigral ključno povezovalno vlogo, vlogo razpršenega visokozmogljivega računanja kot storitve. ARC omogoča dostop do razpršenih računskih virov, se razvija v skladu z odprtimi standardi in v smeri, ki bi omogočala lažje združevanje z drugimi arhitekturam. Tudi v hibridni arhitekturi bi ARC omogočil raziskovalcem, da do različnih razpršenih virov dostopajo na že poznan in uveljavljen način, ki ga uporabljajo na gručah grid. Nekaj modelov združevanja arhitektur že obstaja, a ponavadi rešujejo le problematiko točno določene znanstvene discipline. V tem delu bomo predstavili nov model združevanja grida in oblaka, ki bo uporabnikom omogočil uporabo dodatnih računskih kapacitet v zasebnih in javnih oblakih. Za dostop do dodatnih kapacitet bo uporabil odjemalec ARC, ne da bi bil primoran spremeniti svoje izvedbene programe, kodo ali sam eksperiment. Gre za globalno rešitev, ki omogoča postavitev gruče grid v kateremkoli zasebnem ali javnem oblaku, ter ustreza definiciji samodejne razširitve oblaka (ang. cloud bursting).

• Language: English
• Keywords: grid, cloud, interoperability, integration, scientific computing, distributed computing, technology integration, high performance computing, cloud bursting
• Work type: Master's thesis
• Organization: FRI - Faculty of Computer and Information Science
• Year: 2016
• PID: 20.500.12556/RUL-85957
• Publication date in RUL: 30.09.2016

KRAŠOVEC, BARBARA, 2016, Porazdeljeno računalništvo kot storitev z uporabo vmesne programske opreme ARC [online]. Master’s thesis. [Accessed 25 April 2025]. Retrieved from: https://repozitorij.uni-lj.si/IzpisGradiva.php?lang=eng&id=85957

Secondary language

• Language: Slovenian
• Title: Distributed computing as a service with ARC middleware

Abstract

Scientific computing has evolved considerably in the past years. Scientific applications became more complex and require an increasing number of computing resources to perform well on a large scale. Grid computing became widely used and is the chosen infrastructure for many scientific calculations and projects, although it demands a high learning curve. Computing and storage resources in grid are limited, heterogeneous and often overloaded. Heterogeneity is not present only in the hardware setups, but also in software composition, where configuration permissions are limited. This heterogeneity hardens the portability of scientific applications. Usage of cloud resources could eliminate those constraints. In cloud, resources are provisioned on demand and can scale up and down, scientists can easily customize their execution environments in the form of virtualization. The interest for grid and cloud integration is big, since the new infrastructure would enable a relatively simple migration of scientific applications from grid to cloud (or vice versa). The utilization of resources would be more efficient and it would provide scalability, sustainability and reliability of the hybrid infrastructure. In the IaaS domain, Advanced resource connector (ARC) middleware could have a role of distributed high throughput batch computing as a service. ARC has an ability to facilitate distributed computing across organizations. It is strongly committed to open standards and interoperability and in a good position to enable users and research communities to access new resources and new platforms using existing and well-established interfaces and standards. It could provide a way to seamlessly evolve its interfaces to enable existing users and communities to take full advantage of new resources and technologies as they become available. Some integration models exist, but usually only correspond to a specific use case. In this thesis we introduce a new model of grid and cloud integration which enables users to benefit from additional private and public cloud resources via ARC, with no modifications of the code, workload or execution scripts on their side, by setting up a virtual grid cluster on demand in automated way. The solution can be globally used, on all private and public clouds, it is scalable and corresponds to the cloud bursting paradigm.

• Keywords: grid, oblak, računalništvo v oblaku, znanstvena računalniška obdelava, porazdeljeno računalništvo, združevanje tehnologij, visokozmogljivo računanje, razširitev oblaka