...
Now, we are ready to run SUMI. Execute the option "-h" to see all the
| Code Block |
|---|
sumi -h |
...
usage: sumi.py [-h] [-r] [-u UP] [-d DOWN] [-m MACHINE [MACHINE ...]] |
...
[-j JOBS [JOBS ...]] |
...
Submission Manager for IMAS |
...
optional arguments: |
...
-h, -- |
...
help show this help message and exit -r, -- |
...
-u UP, --upload UP Upload local file
-d DOWN, --download DOWN
Download remote file
...
run Run the configured job on a specific cluster -u UP, --upload UP Upload local file -d DOWN, --download DOWN Download remote file -m MACHINE [MACHINE ...], --machine MACHINE [MACHINE ...] |
...
List of machines were to submit
...
List of machines were to submit -j JOBS [JOBS ...], --job JOBS [JOBS ...] List of jobs to be submitted |
List of jobs to be submitted
Then, SUMI has been installed successfully.
Configure sample job and big Marconi connection
...
The configuration file servers.conf located at local directory $HOME/.sumi/ contains the configuration for the servers where SUMI will connect The sample configuration file located at $SUMI_DIR/conf/servers.conf has the following content.
| Code Block |
|---|
...
[machine] |
...
server = example.com |
...
user = username |
...
manager = slurm |
...
protocol = ssh |
...
upload_files = |
...
upload_to = |
...
download_files = |
...
download_to = |
To configure the login node of y our cluster just specify the login node address, your user name and the name of the resource manager where the accepted are sge, slurm and pbs.
SUMI allows to upload and download files automatically. For this we can assume a directory "mywf" in our remote Marconi directory and another one in our local Gateway account, as well as a mywfresults folder on Gateway. This will
| Code Block |
|---|
...
[machine] |
...
server = login.marconi.cineca.it |
...
user = my_username |
...
manager = slurm |
...
protocol = ssh |
...
upload_files = /afs/eufus.eu/g2itmdev/user/my_username/mywf/* |
...
upload_to = /marconi/home/userexternal/agutierr/mywf/ |
...
download_files = /marconi/home/userexternal/agutierr/mywf/test* |
...
download_to = /afs/eufus.eu/g2itmdev/user/g2agutie/mywfresults/ |
Test connection with Marconi
To use SUMI we need a passwordless connection. This means that Marconi needs to have the public key of our account at Gateway on the list of allowed keys. To copy our key we make usage of the "ssh-copy-id" command
| Code Block | ||
|---|---|---|
|
...
ssh-copy-id username@login.marconi.cineca.it |
Now, if we stablish an SSH connection, the prompt will not ask for any password and will give us a terminal inside Marconi. ssh
| Code Block | ||
|---|---|---|
| ||
ssh username@login.marconi.cineca.it |
Installing uDocker
We will make usage of uDocker. uDocker is based on Docker but it does not require root permissions. Therefore, it does not have some features as TCP/IP sniffing or other action that require root privileges. uDocker will allow to simulate an environment with root permissions (UID = 0) and install IMAS inside.
Therefore, the very first step is installing uDocker. uDokcer will be set up once and used many times
...