Changes between Version 47 and Version 48 of Doc/Config/IPSLCM5A2


Ignore:
Timestamp:
10/22/19 16:40:47 (5 years ago)
Author:
aclsce
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • Doc/Config/IPSLCM5A2

    v47 v48  
    1111# IPSL-CM5A2 model # 
    1212 
    13 '''IPSL-CM5A2''' is an ''' IPSL coupled climate model''' including atmosphere, land, ocean, sea ice and carbon cycle. The goal of this model is to reproduce IPSLCM5A-LR version, with reduced computing times to allow to run long simulations (i.e thousands of years) within reasonable time. Main characteritics of this model are '''ORCA2-LIM2-PISCES x LMD 96x95x39, old LMDZ physics, ORCHIDEE with Choisnel hydrology (2 layers)'''. This model uses both recent component versions and recent technical developments (hybrid parallelization MPI-OpenMP, XIOS 2.0 as input-output library, OASIS3-MCT parallel coupler) that allow to reach '''56 simulated years per day''' on about 300 computing cores. This model is available on Ada (IDRIS) and Curie (TGCC) supercomputers and benefits from last developments of libIGCM running environment. 
     13'''IPSL-CM5A2''' is an ''' IPSL coupled climate model''' including atmosphere, land, ocean, sea ice and carbon cycle. The goal of this model is to reproduce IPSLCM5A-LR version, with reduced computing times to allow to run long simulations (i.e thousands of years) within reasonable time. Main characteritics of this model are '''ORCA2-LIM2-PISCES x LMD 96x95x39, old LMDZ physics, ORCHIDEE with Choisnel hydrology (2 layers)'''. This model uses both recent component versions and recent technical developments (hybrid parallelization MPI-OpenMP, XIOS 2.0 as input-output library, OASIS3-MCT parallel coupler) that allow to reach '''80 simulated years per day''' on about 300 computing cores. This model is available on Irene (TGCC) and !JeanZay (IDRIS) supercomputers and benefits from last developments of libIGCM running environment. 
    1414 
    1515'''IPSL-CM5A2''' model includes : 
    … …  
    3838#-H- IPSLCM5A2.1  2nd frozen IPSLCM5A2 version 
    3939#-H- IPSLCM5A2.1  NEMOGCM branch nemo_v3_6_STABLE revision 6665 
    40 #-H- IPSLCM5A2.1  XIOS2 trunk revision 965 
     40#-H- IPSLCM5A2.1  XIOS2 trunk revision 1551 
    4141#-H- IPSLCM5A2.1  IOIPSL/src svn tags/v2_2_2 
    42 #-H- IPSLCM5A2.1  LMDZ5 trunk rev 2621 
    43 #-H- IPSLCM5A2.1  ORCHIDEE version trunk rev 3930 
     42#-H- IPSLCM5A2.1  LMDZ5 branches/IPSLCM5A2.1 rev 3342 
     43#-H- IPSLCM5A2.1  ORCHIDEE  branches/ORCHIDEE-IPSLCM5A2.1 rev 5307 
    4444#-H- IPSLCM5A2.1  OASIS3-MCT 2.0_branch rev 1818 
    4545#-H- IPSLCM5A2.1  IPSLCM5A2 svn 
    46 #-H- IPSLCM5A2.1  libIGCM trunk rev 1373 
     46#-H- IPSLCM5A2.1  libIGCM trunk rev 1477 
    4747#-M- IPSLCM5A2.1  arnaud.caubel@lsce.ipsl.fr 
    4848#-C- IPSLCM5A2.1  IOIPSL/tags/v2_2_2/src                    HEAD         8  IOIPSL/src     modeles 
    49 #-C- IPSLCM5A2.1  trunk/ORCHIDEE                            3930        14  ORCHIDEE       modeles 
     49#-C- IPSLCM5A2.1  branches/ORCHIDEE-IPSLCM5A2.1/ORCHIDEE    5307        14  ORCHIDEE       modeles 
    5050#-C- IPSLCM5A2.1  branches/OASIS3-MCT_2.0_branch/oasis3-mct 1818        15  oasis3-mct     . 
    51 #-C- IPSLCM5A2.1  LMDZ5/trunk                               2621        11  LMDZ           modeles 
    52 #-C- IPSLCM5A2.1  CONFIG/UNIFORM/v6/IPSLCM5A2               HEAD         8  IPSLCM5A2        config 
    53 #-C- IPSLCM5A2.1  trunk/libIGCM                             1373        10  libIGCM        . 
     51#-C- IPSLCM5A2.1  LMDZ5/branches/IPSLCM5A2.1                3342        11  LMDZ           modeles 
     52#-C- IPSLCM5A2.1  CONFIG/UNIFORM/v6/IPSLCM5A2               4041         8  IPSLCM5A2        config 
     53#-C- IPSLCM5A2.1  trunk/libIGCM                             1477        10  libIGCM        . 
    5454#-C- IPSLCM5A2.1  branches/2015/nemo_v3_6_STABLE/NEMOGCM    6665         7  .              modeles 
    55 #-C- IPSLCM5A2.1  XIOS/trunk                                 965        12  XIOS           modeles 
     55#-C- IPSLCM5A2.1  XIOS/trunk                                1551        12  XIOS           modeles 
    5656}}} 
    5757 
    … …  
    7979### Computing performances ### 
    8080 
    81 The basic configuration (default configuration) ran smoothly on Curie TGCC and Ada IDRIS machine and uses '''302 computing cores''' : 1 process for XIOS, 45 processes for NEMO, and 32 MPI processes and 8 OpenMP thread for LMDZ. This configuration allows you to run '''56 simulated years per day'''.  
    82 Test on Irène TGCC and Jean-Zay IDRIS still to be done. 
     81The basic configuration (default configuration) ran smoothly on Irene TGCC (and very soon on !JeanZay IDRIS) machine and uses '''302 computing cores''' : 1 process for XIOS, 45 processes for NEMO, and 32 MPI processes and 8 OpenMP threads for LMDZ. This configuration allows you to run '''80 simulated years per day''' on Irene TGCC. 
    8382 
    8483#### How to run more efficiently (using less resources) #### 
    8584 
    86 In order to use less computing resources, it is possible to run on 160 cores (38 simulated years per day) as follows : 1 process for XIOS, 31 processes for NEMO, and 32 MPI processes and 4 OpenMP thread for LMDZ. To do that, you have to : 
     85In order to use less computing resources, it is possible to run on 160 cores (56 simulated years per day) as follows : 1 process for XIOS, 31 processes for NEMO, and 32 MPI processes and 4 OpenMP thread for LMDZ. To do that, you have to : 
    8786 * Modify config.card as follows : 
    8887{{{ 
    … …  
    111110   jpnij       =  31       !  jpnij  number of local domains (set automatically if < 1) 
    112111}}}  
    113  * submit the job : ccc_msub (or llsubmit) Job_MYJOBNAME  
     112 * submit the job : ccc_msub (or sbatch) Job_MYJOBNAME  
    114113 
    115114#### How to run faster (using more resources) #### 
    116115 
    117 In order to run faster (using more computing resources), it is possible to run on 437 cores (66 simulated years per day) as follows : 1 process for XIOS, 60 processes for NEMO, and 47 MPI processes and 8 OpenMP thread for LMDZ. To do that, you have to : 
     116In order to run faster (using more computing resources), it is possible to run on 437 cores (95 simulated years per day) as follows : 1 process for XIOS, 60 processes for NEMO, and 47 MPI processes and 8 OpenMP thread for LMDZ. To do that, you have to : 
    118117 * Modify `config.card` as follows : 
    119118{{{ 
    … …  
    142141   jpnij       =  60       !  jpnij  number of local domains (set automatically if < 1) 
    143142}}}  
    144  * submit the job : ccc_msub (or llsubmit) Job_MYJOBNAME 
     143 * submit the job : ccc_msub (or sbatch) Job_MYJOBNAME 
    145144 
    146145#### Load balancing #### 
    … …  
    168167PackFrequency=10Y 
    169168}}} 
    170 Note that since clean_latestPackperiod.job works on the latest pack period, clean_latestPackperiod.job will remove files from latest 10Y pack period. clean_latestPackperiod.job can also be used several time in a row to delete several 10Y pack 
    171 periods. 
     169Note that since clean_latestPackperiod.job works on the latest pack period, clean_latestPackperiod.job will remove files from latest 10Y pack period. clean_latestPackperiod.job can also be used several time in a row to delete several 10Y pack periods. In order to optimize the use of inodes (beware of quotas !), we advice you to use 100Y as PackFrequency for very long simulations. 
    172170 
    173171#### Rebuild frequency #### 
    174172Since we run with XIOS (server mode) as output library, '''the rebuild step is not needed anymore'''. 
    175  
    176 ### Computing centres ### 
    177  
    178 #### IDRIS Ada features #### 
    179  
    180 The basic configuration (default configuration) runs on Ada (IDRIS). In order to use efficiently computing resources, you have to use Intel environment. To do that you have to : 
    181  * ask IDRIS assistance (mail to assist@idris.fr) to be authorized to use Ada full node and (# @ node = N) option.  
    182  * specify the environment you want to use when you do the `../../libIGCM/ins_job` command as follows : 
    183 {{{ 
    184 Hit Enter or give MPI Environment (default is IBM), possible MPI environments are IBM (MPI IBM) and Intel (MPI Intel) : 
    185 Intel 
    186 MPIEnvironment is Intel 
    187 }}} 
    188173 
    189174# Tuning and evaluation of the model #