Reproducible Cross-border High Performance Computing for Scientific Portals

Kessy Abarenkov, Anne Fouilloux, Helmut Neukirchen, Abdulrahman Azab

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

To reproduce eScience, several challenges need to be solved: scientific workflows need to be automated; the involved software versions need to be provided in an unambiguous way; input data needs to be easily accessible; High-Performance Computing (HPC) clusters are often involved and to achieve bit-to-bit reproducibility, it might be even necessary to execute the code on a particular cluster to avoid differences caused by different HPC platforms (and unless this is a scientist's local cluster, it needs to be accessed across (administrative) borders). Preferably, to allow even inexperienced users to (re-)produce results, all should be user-friendly. While some easy-to-use web-based scientific portals support already to access HPC resources, this typically only refers to computing and data resources that are local. By the example of two community-specific portals in the fields of biodiversity and climate research, we present a solution for accessing remote HPC (and cloud) compute and data resources from scientific portals across borders, involving rigorous container-based packaging of the software version and setup automation, thus enhancing reproducibility.

Original languageEnglish
Title of host publicationProceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages487-492
Number of pages6
ISBN (Electronic)9781665461245
DOIs
Publication statusPublished - 2022
Event18th IEEE International Conference on e-Science, eScience 2022 - Salt Lake City, United States
Duration: 10 Oct 202214 Oct 2022

Publication series

NameProceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022

Conference

Conference18th IEEE International Conference on e-Science, eScience 2022
Country/TerritoryUnited States
CitySalt Lake City
Period10/10/2214/10/22

Bibliographical note

Funding Information: This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 857652 EOSC-Nordic. 1https://www.eosc-nordic.eu/ Publisher Copyright: © 2022 IEEE.

Other keywords

  • Containers
  • Cross-border computing
  • Galaxy
  • HPC
  • PlutoF
  • Reproducibility
  • Scientific portals
  • Workflows

Fingerprint

Dive into the research topics of 'Reproducible Cross-border High Performance Computing for Scientific Portals'. Together they form a unique fingerprint.

Cite this