Besides the present tutorial other material is available in the following links:
- Presentation by Albert Gutiérrez and Tomasz Żok entitled "Remote submission on Marconi with SUMI and uDocker" presented on the WPCD Code Camp at Innsbruck on 18th December 2018.
- Webinar by Albert Gutiérrez and Tomasz Żok based on the previous presentation.
Introduction
Remote submission of IMAS HPC workflows may become a problem given the requirement for an IMAS environment installed as well as the wide amount of supercomputers available. To approach these issues, an approach with virtualized environment with IMAS installed and a remote submission system has been designed.
The use case considered is an IMAS developer working on a environment with IMAS installed. These environments will be mainly the Marconi Gateway, ITER cluster and occasionally a local user computer. From there, the workflow will be submitted from a remote supercomputer (mainly PRACE HPC facilities).
Getting started
This tutorial describes the steps to submit an example uDocker IMAS workflow workflow image to a remote supercomputer. To do so we will make usage of uDocker and SUMI (SUbmission Manager for IMAS).
...