You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 7 Next »

All the steps are assumed to be performed at the EUROfusion gateway.

1. Connecting to databases

1.1. JET

Since 1st August 2021 connecting to JET data services via mdsplus.jetdata.eu requires SSH key authentication.

Below are instructions provided by JET codas team

Connecting to JET - instructions
In order to access the new mdsplus.jetdata.eu service, users will need to make a minor change to their codes, changing the host parameter 
in the connection calls from "mdsplus.jet.efda.org" or "mdsplus.jet.uk" to "ssh://<username>@mdsplus.jetdata.eu" 
where <username> is the your JET account username (e.g. jsmith or xy1234)

Users will also need to register their SSH public key with us in order for this to work. 
Please do this by emailing support@it.ukaea.uk with the subject line “MDSplus SSH Key Registration”. 
Please put your SSH Public key into the body of the message – do not add attachments to the email. 
It is important that you provide your public key only and do not include your private key (users should take all reasonable steps to protect their private keys). 
(Due to a limitation of the mdsplus server, please avoid using Ed25519 keys, though ecdsa keys can be used)

Suggested email text to use:

Please register my SSH Public key for use with mdsplus.jetdata.eu. 
My username is : <your shortname>
My SSH Public key is: 

Once your key has been registered we will confirm this back to you and you will then be able to test the connection and your clients

If you need information about creating SSH keys please see the information here:
•	There is some general information here: https://www.digitalocean.com/community/tutorials/how-to-set-up-ssh-keys-2
•	There is a page on how to create key pairs with openssh at https://www.ssh.com/academy/ssh/keygen
•	There is a page on how to create key pairs with putty at https://www.ssh.com/academy/ssh/putty/windows/puttygen
•	The www.ssh.com has pages about generating keys for other ssh clients too.

Important Note: when generating SSH key pairs, we’d suggest that most users will find it more convenient not to use a passphrase (i.e. leave it blank). 
Also, due to a limitation of the mdsplus server, please avoid using Ed25519 keys, though ecdsa keys can be used


2. Saving data to IMAS

Load IMAS environment 

module purge
module load cineca
module load imasenv

The last line loads the latest varsion of imas data dictionary and also idstools which will be used later.

However, loading imasenv does not necessarily provide you with the latest version of data dictionary. In this case: 

~>module list
Currently Loaded Modulefiles:
  1) profile/archive                      18) cmake/3.5.2                          35) IMAS/3.29.0/AL/4.8.3
  2) cineca                               19) mdsplus/7.92.0/gcc/4.8               36) itm-blas/3.8.0/intel/17.0
  3) intel/pe-xe-2017--binary             20) blitz/1.0.1                          37) itm-lapack/3.8.0/intel/17.0
  4) itm-intel/17.0                       21) jaxfront/R1.1                        38) interpos/9.2.0/intel/17.0
  5) intelmpi/2017--binary                22) git/2.23                             39) xmllib/3.3.1/intel/17.0
  6) itm-intelmpi/2017                    23) itm-fftw/3.3.4                       40) libfortranparser/0.0.6/intel/17.0
  7) gnu/7.3.0                            24) szip/2.1--gnu--6.1.0                 41) keplertools/1.8.9
  8) itm-gcc/7.3.0                        25) zlib/1.2.8--gnu--6.1.0               42) kepler/2.5p5-3.1.1
  9) jdk/1.8.0_111                        26) itm-hdf5/1.8.17-old                  43) imas-fc2k/4.13.9
 10) itm-java/1.8.0_111                   27) pspline/20161207                     44) itm-qt/5.8.0
 11) itm-python/3.6                       28) slatec/4.1                           45) imas-viz/2.4.4
 12) matlab/2018b                         29) itm-mkl/2017.1                       46) idstools/1.5.1
 13) itm-matlab/2018b                     30) itm-matheval/1.1.11                  47) autoGui/1.15
 14) netbeans/7.3                         31) itm-netcdf/4.4                       48) ggd/1.9.1/intel/17.0/imas/3.29.0
 15) itm-maven/3.3.9                      32) nag/mark26--binary                   49) libbds/1.0.2/intel/17.0/imas/3.29.0
 16) scripts/R4.9                         33) itm-nag/mark26--binary               50) amns/1.3.3/intel/17.0/imas/3.29.0
 17) totalview/2017.3.8                   34) uda/2.2.5                            51) imasenv/3.29.0/intel/rc

we loaded version 3.29.0/intel/rc . If you want to load the latest version data dictionary check first what versions are available with a command "module avail <required module>":

~>module avail imasenv

---------------------------------------------------------- /gw/modules/environment ----------------------------------------------------------
imasenv/3.10.2                imasenv/3.23.1/ual/4.0.3/1.4  imasenv/3.26.0/gcc/7.3.0/rc   imasenv/3.31.0/intel/17.0/1.0
imasenv/3.11.0                imasenv/3.23.1/ual/4.0.3/1.5  imasenv/3.26.0/intel/17.0/rc  imasenv/3.31.0/intel/17.0/1.1
imasenv/3.12.1                imasenv/3.23.1/ual/4.0.3/1.6  imasenv/3.26.0/intel/rc       imasenv/3.31.0/intel/17.0/rc
imasenv/3.15.1                imasenv/3.23.1/ual/4.0.4/1.0  imasenv/3.26.0/rc             imasenv/3.31.0/intel/rc
imasenv/3.16.0                imasenv/3.23.1/ual/4.0.4/1.1  imasenv/3.28.0/gcc/7.3.0/rc   imasenv/3.31.0/rc
imasenv/3.17.0                imasenv/3.23.1/ual/4.0.4/1.2  imasenv/3.28.0/intel/17.0/rc  imasenv/3.32.0/gcc/7.3.0/rc
imasenv/3.17.1                imasenv/3.23.1/ual/4.1.0/1.0  imasenv/3.28.0/intel/rc       imasenv/3.32.0/intel/17.0/rc
imasenv/3.18.0                imasenv/3.23.2/rc             imasenv/3.28.0/rc             imasenv/3.32.0/intel/rc
imasenv/3.19.0                imasenv/3.23.2/ual/4.1.1/1.0  imasenv/3.28.1/gcc/7.3.0/1.0  imasenv/3.32.0/rc
imasenv/3.19.1                imasenv/3.23.2/ual/4.1.2/0.2  imasenv/3.28.1/gcc/7.3.0/rc   imasenv/3.32.1/gcc/7.3.0/rc
imasenv/3.20.0                imasenv/3.23.2/ual/4.1.2/1.0  imasenv/3.28.1/intel/17.0/1.0 imasenv/3.32.1/intel/17.0/rc
imasenv/3.21.0/ual/3.8.10/1.0 imasenv/3.23.2/ual/4.1.4/0.2  imasenv/3.28.1/intel/17.0/rc  imasenv/3.32.1/intel/rc
imasenv/3.21.0/ual/3.8.5/1.0  imasenv/3.23.2/ual/4.1.4/1.0  imasenv/3.28.1/intel/rc       imasenv/3.32.1/rc
imasenv/3.21.0/ual/3.8.8/1.0  imasenv/3.23.2/ual/4.1.5/1.0  imasenv/3.28.1/rc             imasenv/3.33.0/gcc/7.3.0/rc
imasenv/3.21.1/ual/4.0.0/1.0  imasenv/3.23.2/ual/4.1.5/1.1  imasenv/3.29.0/gcc/7.3.0/1.0  imasenv/3.33.0/intel/17.0/rc
imasenv/3.21.1/ual/4.0.1/1.0  imasenv/3.23.2/ual/4.1.5/1.2  imasenv/3.29.0/gcc/7.3.0/rc   imasenv/3.33.0/intel/rc
imasenv/3.22.0/ual/4.0.2/1.0  imasenv/3.24.0/rc             imasenv/3.29.0/intel/17.0/1.0 imasenv/3.33.0/rc
imasenv/3.22.0/ual/4.0.2/1.1  imasenv/3.24.0/ual/4.1.5/1.0  imasenv/3.29.0/intel/17.0/rc  imasenv/3.7.4
imasenv/3.22.0/ual/4.0.2/1.2  imasenv/3.24.0/ual/4.2.0/1.0  imasenv/3.29.0/intel/rc       imasenv/3.8.0
imasenv/3.22.0/ual/4.0.2/1.3  imasenv/3.25.0/gcc/6.1.0/1.0  imasenv/3.29.0/rc             imasenv/3.9.0
imasenv/3.22.0/ual/4.0.2/1.4  imasenv/3.25.0/gcc/6.1.0/rc   imasenv/3.30.0/gcc/7.3.0/rc   imasenv/3.9.1
imasenv/3.22.0/ual/4.0.2/1.5  imasenv/3.25.0/gcc/7.3.0/1.0  imasenv/3.30.0/intel/17.0/rc  imasenv/newLL/3.18.0
imasenv/3.22.0/ual/4.0.2/1.6  imasenv/3.25.0/gcc/7.3.0/rc   imasenv/3.30.0/intel/rc       imasenv/test
imasenv/3.22.0/ual/4.0.2/1.7  imasenv/3.25.0/gcc/rc         imasenv/3.30.0/rc             imasenvX/3.19.1/ual/3.8.2/1.0
imasenv/3.22.0/ual/4.0.2/1.8  imasenv/3.25.0/intel/17.0/1.0 imasenv/3.31.0/1.0            imasenvX/3.20.0/ual/3.8.3/1.0
imasenv/3.23.1/ual/4.0.3/1.0  imasenv/3.25.0/intel/17.0/rc  imasenv/3.31.0/1.1            imasenvX/3.20.0/ual/3.8.5/1.0
imasenv/3.23.1/ual/4.0.3/1.1  imasenv/3.25.0/intel/rc       imasenv/3.31.0/gcc/7.3.0/1.0  imasenvX/3.21.0/ual/3.8.5/1.0
imasenv/3.23.1/ual/4.0.3/1.2  imasenv/3.25.0/rc             imasenv/3.31.0/gcc/7.3.0/1.1
imasenv/3.23.1/ual/4.0.3/1.3  imasenv/3.25.0/ual/4.2.0/1.0  imasenv/3.31.0/gcc/7.3.0/rc

From the above output we conclude that the latest data disctionary version is 'imasenv/3.33.0/rc'. Using the above list you can also choose a different version if there is such a need.

Let's switch to the latest imas release available on the gateway:

module unload imasenv
module load imasenv/3.33.0/rc


You can now check if there exists ids to store the experimental data by typing: 

dd_doc

Above command opens data dictionary by default in Konqueror. If option "Show/hide error bars" doesn't work, copying the address to Firefox will help. 

By browsing data dictionaries you will find needed fiields. If there are no required fields then a request has to be raised.



Unknown User (michal.poradzinski@ifpilm.pl) 

  • No labels