Set up environment before first time using a new machine: obelix, ciclad, climserv, irene, jean-zay

Author: J. Ghattas
Last revision: 2020/03/19, J. Ghattas

All information on this page can also be found in the igcmg_doc here: ​http://forge.ipsl.fr/igcmg_doc/wiki/Doc/ComputingCenters

Setting up the environment and paths to the input files

Before installing the model for the first time at a new computing platform, you'll need to set up the environment to be adapted for the models. For example, depending on the model versions, you need to load certain modules to compile and run the model.

Depending on which machine you are working on, the input files needed to run the model are stored in a specific directory called IGCM that are given below. The IGCM directories are the same and regularly synchronized between the IPSL computing centers so that they all contain the same files.

For the IPSL computing platforms where the models are maintained, you can find advice for setting up your environment in the igcmg_doc depending on the machine here:

• for Jean-Zay at IDRIS
  • set up environment: ​http://forge.ipsl.fr/igcmg_doc/wiki/Doc/ComputingCenters/IDRIS#HowtoinstallyourenvironmentatIDRIS
  • input files are found in R_IN=$WORK/../../psl/commun/IGCM
• for Irene (Intel Skylake and AMD Rome) at TGCC
  • set up environment: ​http://forge.ipsl.fr/igcmg_doc/wiki/Doc/ComputingCenters/TGCC#HowtoinstallyourenvironmentonTGCC
  • input files are found in R_IN=$CCCWORKDIR/../../igcmg/igcmg/IGCM
• for Obelix at LSCE
  • set up environment: ​http://forge.ipsl.fr/igcmg_doc/wiki/Doc/ComputingCenters/LSCE
  • input files are found in R_IN=/home/orchideeshare/igcmg/IGCM
• for Ciclad and ClimServ at IPSL ESPRI-mesocenter
  • set up environment: ​http://forge.ipsl.fr/igcmg_doc/wiki/Doc/ComputingCenters/ESPRImesocenter
  • input files are found in R_IN=/prodigfs/ipslfs/igcmg/IGCM

At obelix, changing the ARCHIVE folder, where the output files will be stored by libIGCM, can be done by setting ARCHIVE in config.card. By default, ARCHIVE is in /home/scratch01/login which is fine for test simulations but not for simulations you want to keep for longer than a month (/home/scratch01 can be cleaned automatically). Read more here: Documentation/UserGuide/OutputFiles.

Do not change the ARCHVE at TGCC or IDRIS.

Specific settings when coupling to LMDZ, when using libIGCM

• At obelix: During run time the filter using fft must be deactivated in run.def:

  cd modipsl/config/LMDZOR_v6/GENERAL/PARAM
  vi run.def
  # change following into : 
  use_filtre_fft=n
  

• At obelix and ciclad/climserv: Adapt number of cores MPI to maximum 31 (or 32 if running without server XIOS) and number of cores OMP to 1. Sometimes 31MPI is too much at obelix, then change to 15MPI. For example using LMDZOR_v6.2, set following in config.card:

  [Executable]
  ATM= (gcm_${ResolAtm}_${OptMode}.e, lmdz.x, 31MPI, 1OMP)
  SRF= ("", "")
  SBG= ("", "")
  IOS= (xios_server_${OptMode}.exe, xios.x, 1MPI)
  

• At Jean-Zay: Change to use 10 or 20OMP, otherwise libIGCM will stop with an error message. For example using LMDZOR_v6.2, set following in config.card:

  [Executable]
  ATM= (gcm_${ResolAtm}_${OptMode}.e, lmdz.x, 71MPI, 10OMP)
  SRF= ("", "")
  SBG= ("", "")
  IOS= (xios_server_${OptMode}.exe, xios.x, 1MPI)