Changes between Version 3 and Version 4 of training_2020


Ignore:
Timestamp:
09/21/20 10:45:10 (12 months ago)
Author:
yushan
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • training_2020

    v3 v4  
     1 
    12= XIOS training 2020 = 
    2 == 4^[#hn th]^ November - 6^[#hn th]^ November 2020,  IDRIS== 
     3== November 4^th^ - 6^th^, 2020 == 
     4== IDRIS == 
     5 
     6= What is XIOS = 
     7 
     8The climate simulation models launched on super-calculators produce a significant amount of data. At this scale, the management of output files and post-treatment on data become the  performance bottleneck for those climate models. In order to generate efficiently the output from models while taking advantage of the calculate resources, Institut Pierre Simon Laplace has launched the XIOS project. XIOS is a library dedicated to generate efficiently and easily the parallel input/output of climate models. It uses a client-server methodology in which clients (or models) will simulate the physics and send data asynchronously to servers. It is the XIOS servers who are in charge of writing data to files. In this way, we can smooth the I/O peaks by sending to servers a constant data flux all along the simulations and the I/O is overlapped with calculates. What's more, XIOS provides multiple functionalities which allow an "in situ" data post-treatment. For example, we can read the data from models, operate transformations on those data, combine data from different source models, and send results to multiple output files. All these operations are defined from an external XML file with a very compact and flexible way. Any modifications in this XML file will not require re-compilation of XIOS or models. XIOS is written in C++ and uses MPI for asynchronous communications between clients and servers. NETCDF, HDF5, and MPIIO are also used in XIOS for efficient file writing. 
     9 
     10= What is dr2xml = 
     11 
     12DR2XML is a python package useful for climente models whose I/O are handled by XIOS. It has been originally designed to facilitate the configuration of XIOS (automatic generation of XML files) so as to fully satisfy the CMIP6 DataRequest. With DR2XML, the NetCDF files output by the model are directly CMOR3 compliant.  Some extended functionalities were also developed so that DR2XML enables the user to set up his own Data Request. Consequently DR2XML can be used to customize the official CMIP6 DR or even to work off the CMIP6 framework, but benefiting from the CF-NetCDF, CMOR, and CMIP6 standards (file naming convention, file structure, variable definitions, file and variable attributes, etc.). 
     13 
    314= Program = 
    415 
    5     Day 1 : From 10:00 to 17:00 
    6         Introduction on XIOS 
    7             Context of the project XIOS 
    8             How XIOS is useful for the climat simulation models 
    9             How to use XIOS in a model (C interface, Fortran interface) 
    10         Introduction of XML 
    11             XML syntax 
    12             XIOS component with XML (calendar, file, field, grid, ...) 
    13         Hands-on exercise 
    14             Install and compile XIOS 
    15             Pluge XIOS to a model 
    16             Hello World with XIOS 
    17             Visualization of the file generated by XIOS 
    18     Day 2 : From 9:00 to 17:00 
    19         Advanced tutorial of XIOS 
    20             Data transformation (temporal, spatial, ...) 
    21             Filters in XIOS 
    22             Active the workflow graph in XIOS 
    23             Client-server mode of XIOS 
    24             2-level server mode of XIOS 
    25             How buffer works in XIOS 
    26             How to understand the XIOS performance report and parametrize XIOS 
    27             How to debug with XIOS (exception, stack, ...) 
    28         Hands-on exercise (interleaved with lecture) 
    29     Day 3 : From 9:00 to 16:00 
    30         Tutorial of dr2xml 
    31             Présenter la Data Request 
    32             Présenter dr2xml: 
    33                 Objectifs 
    34                 Fonctionnalités 
    35         Hands-on exercise of dr2xml 
    36             Prise en main de dr2xml 
    37             Objectif: prise en main des fichiers de config: settings, ping_file, home_data_request. Visualiser le contenu des XML (file_defs) générés. 
    38             Mise en oeuvre avec XIOS 
    39             Objectif : production des fichiers netCDF, montrer qu’on est conforme CMIP6 
    40         Q&A 
     16    * Day 1 : From 10:00 to 17:00 
     17        * Introduction on XIOS 
     18            * Context of the project XIOS 
     19            * How XIOS is useful for the climat simulation models 
     20            * How to use XIOS in a model (C interface, Fortran interface) 
     21        * Introduction of XML 
     22            * XML syntax 
     23            * XIOS component with XML (calendar, file, field, grid, ...) 
     24        * Hands-on exercise 
     25            * Install and compile XIOS 
     26            * Pluge XIOS to a model 
     27            * Hello World with XIOS 
     28            * Visualization of the file generated by XIOS 
     29    * Day 2 : From 9:00 to 17:00 
     30        * Advanced tutorial of XIOS 
     31            * Data transformation (temporal, spatial, ...) 
     32            * Filters in XIOS 
     33            * Active the workflow graph in XIOS 
     34            * Client-server mode of XIOS 
     35            * 2-level server mode of XIOS 
     36            * How buffer works in XIOS 
     37            * How to understand the XIOS performance report and parametrize XIOS 
     38            * How to debug with XIOS (exception, stack, ...) 
     39        * Hands-on exercise (interleaved with lecture) 
     40    * Day 3 : From 9:00 to 16:00 
     41        * Tutorial of dr2xml 
     42            * Introduction of Data Request 
     43            * Introduction of dr2xml: 
     44            * Hands-on exercise of dr2xml 
     45              * Get started with configuration files: settings, ping_file, home_data_request.  
     46              * Visualize contents of generated XML files. 
     47              * Production of netCDF files, conformality with CMIP6 norms. 
     48        Q&A on XIOS and dr2xml 
    4149 
    42 Location 
     50=== Slides of the training will be available online 
    4351 
    44 IDRIS-CNRS 
     52= Location = 
     53 
     54=== IDRIS-CNRS 
    4555 
    4656Campus Universitaire d'Orsay 
     
    5363 
    546491403 ORSAY CEDEX 
    55 Directions for coming to IDRIS 
    56 Registration for this training 
    5765 
    58 Due to the current health crisis of COVID-19, this training is limited to 16 participants. 
     66[http://www.idris.fr/eng/info/contacts/alleridris-eng.html How to get to IDRIS] 
    5967 
    60 The registration of this training will be open soon. 
     68= Registration for this training = 
     69Please refer to the  [https://framaforms.org/202011-xios-training-registration-1600443231 registration form] 
     70 
     71This training is free of charge. Coffee, snacks and launches are also provided. 
     72 
     73= Additional Information = 
     74For the moment, we have the possibility to give the tutorial onsite. However, this may be changed to a online tutorial if more strict sanitary condition applied. In case of online training, there will be no hands-on exercise. Due to the current health crisis of COVID-19, this onsite training is limited to 12 participants. 
     75 
     76We are maintaining the training session onsite for several reasons. Firstly, a face-to-face tutorial is more efficient and interactive than reading slides online. Secondly, learning XIOS requires lots of hands-on exercises. For the moment we do not have the necessary material nor the human resources to ensure the online exercise. Last but not least, we are aware of the numerous demands on XIOS training sessions. So XIOS team are planning to do XIOS trainings more regularly. The next session is planned for the first trimester of 2021. Others will also be scheduled. 
     77 
     78If you have any questions about this training, please contact Yushan Wang (yushan.wang@lsce.ipsl.fr) of XIOS team.