Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

CONTENT

  1.  Introduction
  2. DYON output
    1. Files provided
    2. Running the scripts
    3. The main files (functions 'put_to_IMAS', 'get_from_IMAS' and test scripts)
    4. IDS core_profiles
    5. IDS core_sources
    6. IDS equilibrium
    7. IDS gas_injection
    8. IDS magnetics
    9. IDS radiation
    10. IDS wall
    11. Service functions
  3. DYON inputquit
  4. To be done

Introduction

This page contains a description of MATLAB scripts supporting the storage of DYON input and output data files in IMAS. 

The repository folder of the DYON output wrapper is ~g2yyakov/public/dyon/stable.

This document can be found on the ACH-PSNC Confluence page (DYON IMASification - Scientific Worfklows - PCSS Confluence (psnc.pl), https://docs.psnc.pl/display/WFMS/DYON+IMASification).

 DYON output

The storage of the DYON output in IMAS is supported by two MATLAB functions, put_to_IMAS and get_from_IMAS. Depending on the situation, they can be integrated to the code or used separately as wrappers providing the connection between DYON and IMAS. The scripts test_put_to_IMAS and test_get_from_IMAS are provided, which illustrate how the functions can be called as wrappers.

The available IMAS Data Dictionary (DD) does not satisfy all requirements of DYON. Therefore, the functions put_to_IMAS and get_from_IMAS are to be extended after the planned extension of the DD. 

Now the output data are placed into 7 IMAS IDS's (Interface Data Structures - sections of the IMAS DD describing tokamak subsystems or tokamak physics chapters): 'core_profiles', 'core_sources', 'equilibrium', 'gas_injection', 'magnetics', 'radiation', and 'wall' (this list is to be extended). The allocation of the data in the IDS's and the functions supporting it are described below.

 Files provided

File name Content
put_to_IMAS.mFunction saving IMAS output data to IMAS
get_from_IMAS.mFunction reading IMAS output data from IMAS
test_put_to_IMAS.mSample script invoking the function put_to_IMAS
test_get_from_IMAS.mSample script that invokes the function get_from_IMAS and compares the recovered data with the initial ones
put_core_profiles.mFunction saving data to the 'core_profiles' IDS
put_core_sources.mFunction saving data to the 'core_sources' IDS
put_equilibrium.mFunction saving data to the 'equilibrium' IDS
put_gas_injection.mFunction saving data to the 'gas_injection' IDS
put_magnetics.mFunction saving data to the 'magnetics' IDS
put_radiation.mFunction saving data to the 'radiation' IDS
put_wall.mFunction saving data to the 'wall' IDS
get_core_profiles.mFunction recovering the saved data from the 'core_profiles' IDS
get_core_sources.mFunction recovering the saved data from the 'core_sources' IDS
get_equilibrium.mFunction recovering the saved data from the 'equilibrium' IDS
get_gas_injection.mFunction recovering the saved data from the 'gas_injection' IDS
get_magnetics.mFunction recovering the saved data from the 'magnetics' IDS
get_radiation.mFunction recovering the saved data from the 'radiation' IDS
get_wall.mFunction recovering the saved data from the 'wall' IDS
arrange_ion_densities.mFunction putting the densities of all charge states and the properties of an ion to 'core_profiles'
arrange_neutral_density.mFunction putting the density and the properties of a neutral atom to 'core_profiles'
arrange_radiation.mFunction arranging the radiation power density (together with all atom attributes) for given radiation type and neutral/ion kind
extract_ion_densities.mFunction extracting the densities of all charge states from the 'core_profiles' IDS
find_source.mFunction finding the location of the source with a given data dictionary index in an AoS
find_species.mFunction finding the location of the species with a given label in AoS
compare_core_profiles.mFunction comparing the data restored from the 'core_profiles' IDS with the initial content
compare_core_sources.mFunction comparing the data restored from the 'core_sources' IDS with the initial content
compare_equilibrium.mFunction comparing the data restored from the 'equilibrium' IDS with the initial content
compare_magnetics.mFunction comparing the data restored from the 'magnetics' IDS with the initial content
compare_radiation.mFunction comparing the data restored from the 'radiation' IDS with the initial content
compare_wall.mFunction comparing the data restored from the 'wall' IDS with the initial content
STEP_10003_N_O_impurities_Cwall_2022_11_12_17_53_27.matExample of MAT-file with DYON results (received from Kim Hyun-Tae)
STEP_10003_v4_600kW_EBWCD_2022_6_20_21_24_29.matExample of MAT-file with DYON results (received from Kim Hyun-Tae)
README.txtBrief user guide
DYON-IMAS_wrappers_user_guide.pdfThis documentation in PDF-format

Running the scripts

To launch the test scripts, do the following:

1. Enter:

module load imasenv/<IMASversion> 

Here <IMASversion> is 3.37.0 or higher.

2. The scripts in its present form use the IMAS database 'step'. If you are planning to use it and this database is non-existent, enter the following command to create the database:
imasdb step

You can replace 'step' with another IMAS database name, but do not forget to create it and change the variable 'machine' in test_put_to_IMAS.m and test_get_from_IMAS.m.

3. Enter either 
     matlab
  or
     matlab -nodesktop -nosplash

In the nodesktop mode, MATLAB should work faster (I did not notice a significant difference - YY). When using the nodesktop mode, do not forget to run the command 'quit()' to end the session (otherwise, a dangling MATLAB session may remain).

4. Run test_put_to_IMAS.m in order to save in IMAS the data from an available DYON output MAT-file (you can change shot, run, IDS comments etc. by changing the parameters in this script).

5. Type 'viz' (on a console with imasenv loaded) to see the content of the IMAS database.

6. To get back the DYON output data, run test_get_from_IMAS.m. 

The main files (functions 'put_to_IMAS', 'get_from_IMAS' and test scripts)

The script test_put_to_IMAS.m loads a MAT-file containing the DYON results (the name of the file is defined in the script). It is assumed that there is a structure with the name 'output' among the variables loaded from the MAT-file and that this structure holds all the data that must be saved.

The script then defines the rest of arguments of the function 'put_to_IMAS' and invokes it. The dummy arguments of this function are as follows:

NameTypeDescription
outputstructstructure containing the DYON output to be saved
H_massfloatmass of the H isotope (in units of the proton mass)
machinesymbol arrayname of the IMAS database (usually a tokamak name)
shotintshot number
runintrun number
commentsymbol arraycomment characterizing the data to be saved (put into each IDS)
data_sourcesymbol array

text describing the origin of the data (put into each IDS)

The function creates an IMAS data entry for the given 'shot' and 'run' parameters (note that the database with the required name must exist; otherwise, an error is raised). Then it invokes several functions that put data to separate IDS's ('put_core_profiles', 'put_core_sources', 'put_equilibrium', 'put_gas_injection', 'put_magnetics', 'put_wall', and 'put_radiation') and closes the database. After that, the content of the 'output' structure is put to IMAS. The DD fields to which the data are placed can be found in the table IMAS interface with DYON - Google Documents. Some more comments will be given in next sections of this document for each IDS separately.

The script test_get_from_IMAS.m defines the input parameters of the function get_from_IMAS and invokes it. The dummy arguments of this function are as follows:

NameTypeDescription
machinesymbol arrayname of the IMAS database (usually a tokamak name)
shotintshot number
runintrun number

The function calls several functions that extract data from separate IDS's ('get_core_profiles', 'get_core_sources', 'get_equilibrium', 'get_gas_injection', 'get_magnetics', 'get_wall', and 'get_radiation') and closes the database. The function returns the 'output' structure, which is to be equivalent (after the script is complete) to the 'output' structure that was initially put to IMAS. In addition, the function prints to the screen the comments extracted from all IDS's.

The script in its current form contains some parts that are used for verification and debugging. It imports the original DYON output and compares it with the one recovered from IMAS. These part should be removed in the future when such comparison is not required.

IDS core_profiles

The quantities stored in this IDS include electron and ion temperatures, densities of electrons, several ion species and several neutral species, loop voltage, and plasma current. Although all these quantities are represented by single values, most of them are stored as 1D-profiles on the formal grid consisting of a single point. When the ion and neutral densities are recovered from the IDS, the species are selected in the array of structures by their labels (not by their places in the array). This is done to permit more flexibility if the set of the ions simulated by the code changes. At present, the storage of ion quantities in the IDS is organized as follows:

ElementIon labelIon indexNeutral labelNeutral index
HH1--
BeBe2Be01
CC3C02
NN4N03
OO5O04
HeHe6He05
NeNe7Ne06

Here 'ion label' and 'ion index' are the label and the index of the species in the core_profiles.profiles1d.ion AoS (array of structures), respectively; 'neutral label' and 'neutral index' are the label and the index of the species in the core_profiles.profiles1d.neutral AoS (array of structures), respectively. 

For all ions except for H, several ion states (charge states) are defined, the index of the 'state' array element being equal to the ion charge number.

The following functions support I/O with the 'core_profiles' IDS:


function put_core_profiles (output, H_mass, idx, comment, data_source, imas_version, access_layer)

Write a suitable part of the 'output' structure to the 'core_profiles' IDS. 

This function invokes the functions 'arrange_ion_densities' and 'arrange_neutral_density'.

NameTypeDescription
outputstructstructure containing the DYON output to be saved
H_massfloatmass of the H isotope (in units of the proton mass)
idxintthe data entry identifies 
commentsymbol arraycomment characterizing the data to be saved
data_sourcesymbol arraytext describing the origin of the data
imas_versionsymbol arrayIMAS major version (prepared in the 'put_to_IMAS' function)
access_layersymbol arrayIMAS access layer version used when writing the IDS (prepared in the 'put_to_IMAS' function)


function [output, comment, data_source, imas_version, access_layer] = get_core_profiles (output, idx, get_time)

Add the data from the 'core_profiles' IDS to the 'output' structure. 

This function invokes the function 'extract_ion_densities'.

NameTypeDescription
outputstructstructure containing the DYON output recovered from IMAS
idxintthe data entry identifies 
get_timebooleanswitch on transferring the IDS time to the output time
commentsymbol arraycomment characterizing the recovered data
data_sourcesymbol arraytext describing the origin of the data
imas_versionsymbol arrayIMAS major version
access_layersymbol arrayIMAS access layer version used when writing the IDS


IDS core_sources

The source densities are stored as 1D-profiles on the formal grid consisting of a single point although they are represented by single values. 

When the data are recovered from the IDS, the sources are sought for in the array of structures by their DD indices (not by their places in the array). This is done to permit more flexibility if the set of the sources calculated by the code changes. At present, the storage of sources in the IDS is organized as follows:

SourceDD indexIDS nameIDS index
Ohmic heating7Ohmic1
Energy loss for ionization601ionization2
Energy loss due to radiation including  excitation, recombination, and bremsstrahlung200radiation3
Electron energy loss due to equilibration with ions402equipartition4
Energy loss due to particle transport400transport5
ECH power absorbed to electrons3ECH6
ECH + EBW power absorbed to electrons901ECH&EBW7
Ion energy loss due to charge exchange305CX8
Net heating power in a unit volume1net_power9

The source 901 (ECH + EBW power absorbed to electrons) is a custom source missing in the DD.

Data exchange with the 'core_sources' IDS is carried out by the functions 'put_core_sources' and 'get_core_sources'. The interface of 'get_core_sources' identical to that of 'get_core_profiles' (Section 2.4). The interface of 'put_core_sources' is as follows:


function put_core_sources (output, idx, comment, data_source, imas_version, access_layer)

NameTypeDescription
outputstructstructure containing the DYON output to be saved
idxintthe data entry identifies 
commentsymbol arraycomment characterizing the data to be saved
data_sourcesymbol arraytext describing the origin of the data
imas_versionsymbol arrayIMAS major version (prepared in the 'put_to_IMAS' function)
access_layersymbol arrayIMAS access layer version used when writing the IDS (prepared in the 'put_to_IMAS' function)


IDS equilibrium

Data exchange with the 'equilibrium' IDS is carried out by the functions 'put_equilibrium' and 'get_equilibrium'. The interface of 'get_equilibrium' identical to that of 'get_core_profiles' (Section 2.4). The interface of 'put_equilibrium' is as follows identical to that of 'get_core_sources' (Section 2.5).

IDS gas_injection

Data exchange with the 'gas_injection' IDS is carried out by the functions 'put_gas_injection' and 'get_gas_injection'. The interface of 'get_gas_injection' identical to that of 'get_core_profiles' (Section 2.4). The interface of 'put_gas_injection' is as follows identical to that of 'get_core_sources' (Section 2.5).

The gas puffing is measured ???

IDS magnetics


IDS radiation


IDS wall


Service functions


 DYON input

Description of the scripts processing the DYON input (to be done).

To be done

  • Extending the input script (pending the planned DD extension)
  • Adding code descriptions to all IDS's.
  • Switching to the HDF5 IMAS backend (pending HDF5 debugging on Gateway).