wiki:Doc/Config/IPSLCM5A2

Version 1 (modified by aclsce, 8 years ago) (diff)

--

IPSL-CM5A2 configuration


Person in charge: Arnaud Caubel


1. IPSL-CM5A2 model

IPSL-CM5A2 is an the IPSL coupled climate model including atmosphere, land, ocean, sea ice and carbon cycle. The goal of this model is to reproduce IPSLCM5A-LR version, with reduced computing times to allow running long simulations (i.e thousands of years) within reasonnable time. Main caracteritics of this model are ORCA2-LIM2-PISCES x LMD 96x95x39, old LMDZ physics, ORCHIDEE with Choisnel hydrology (2 layers). This model uses recent versions of each components as well as technical developments (hybrid parallelisation MPI-OpenMP, XIOS 2.0 as input-output library, OASIS3-MCT parallel coupler) that allow to reach 55 simulated years per day on about 300 Curie computing cores. This model is available on Ada (IDRIS) and Curie (TGCC) supercomputers and benefits from last developments of libIGCM runnnin enviornment. bénéficie des derniers développements de l'environnement de production libIGCM.

IPSL-CM5A2 model includes :

  • model components :
    • LMDZ as atmospheric model ;
    • NEMO as ocean model including sea ice (LIM2) and marine biogeochemistry (PISCES) ;
    • ORCHIDEE as land model ;
  • tools :
    • OASIS3-MCT as parallel coupler ;
    • XIOS as I/O library ;
    • libIGCM as running environment (scripts) to run the model and to perform post processing ;

2. Resolutions and configurations

IPSL-CM5A2 model is available at following resolutions/configurations :

  • IPSL-CM5A2 : LMDZ(Old Physics) 96x95x39-ORCHIDEE(Choisnel) - NEMO-LIM2-PISCES ORCA2

The resolution of LMDZ is 96x95 (3.75° in longitude and 1.875° in latitude) with 39 vertical levels. The ocean configuration is ORCA2 : global ocean with a tripolar grid with one South Pole, one North Pole above Siberia and one North Pole above northern America. The resolution is 2°. In the tropical region, the latitudinal resolution decreases to 1/2°. There are 31 vertical levels.

IPSL-CM5A2 is composed of following components and tools :

#-H- IPSLCM5A2  IPSLCM5A2 coupled configuration
#-H- IPSLCM5A2  1st frozen IPSLCM5A2 version
#-H- IPSLCM5A2  NEMOGCM branch nemo_v3_6_STABLE revision 6665
#-H- IPSLCM5A2  XIOS2 trunk revision 858
#-H- IPSLCM5A2  IOIPSL/src svn tags/v2_2_2
#-H- IPSLCM5A2  LMDZ5 trunk rev 2595
#-H- IPSLCM5A2  ORCHIDEE version trunk rev 3525
#-H- IPSLCM5A2  OASIS3-MCT 2.0_branch rev 1129
#-H- IPSLCM5A2  IPSLCM5A2 svn
#-H- IPSLCM5A2  libIGCM trunk rev 1330
#-M- IPSLCM5A2  arnaud.caubel@lsce.ipsl.fr
#-C- IPSLCM5A2  IOIPSL/tags/v2_2_2/src                    HEAD         8  IOIPSL/src     modeles
#-C- IPSLCM5A2  trunk/ORCHIDEE                            3525        14  ORCHIDEE       modeles
#-C- IPSLCM5A2  branches/OASIS3-MCT_2.0_branch/oasis3-mct 1129        15  oasis3-mct     .
#-C- IPSLCM5A2  LMDZ5/branches/testing                    2595        11  LMDZ           modeles
#-C- IPSLCM5A2  CONFIG/UNIFORM/v6/IPSLCM5A2               HEAD         8  IPSLCM5A2        config
#-C- IPSLCM5A2  trunk/libIGCM                             1330        10  libIGCM        .
#-C- IPSLCM5A2  branches/2015/nemo_v3_6_STABLE/NEMOGCM    6665         7  .              modeles
#-C- IPSLCM5A2  XIOS/trunk                                 858        12  XIOS           modeles

2.0.1. How to use it

Here are the commands you need to know if you want to retrieve and compile the IPSL-CM5A2 model and if you want to setup and run a piControl experiment (pdControl is also available):

mkdir YOUR_DIRECTORY ; cd YOUR_DIRECTORY
svn_ano # svn co http://forge.ipsl.jussieu.fr/igcmg/svn/modipsl/trunk modipsl
cd modipsl/util
./model IPSLCMA2
cd ../config/IPSLCMA2
gmake # by default ORCA2xLMD9695-L39
cp EXPERIMENTS/IPSLCM5/EXP00/config.card .
vi config.card # modify JobName (at least) : MYJOBNAME, restarts
../../util/ins_job # Check and complete job's header
cd MYJOBNAME
vi Job_MYJOBNAME # modify PeriodNb, adjust the time, headers ...
llsubmit Job_MYJOBNAME # IDRIS
ccc_msub  Job_MYJOBNAME # TGCC

2.0.2. Restart files

IPSLCM6 configuration could restart from any IPSLCM5A, IPSLCM5_v5 and IPSLCM6 restart files. Default configuration starts from IPSLCM5A piControl2pm01 simulation (2349-12-31).

2.0.3. Output level

By default, only monthly outputs and low output levels are activated.

2.0.4. Lengths, frequencies

2.0.4.1. Period length

Default period length is 1Y, i.e in config.card :

PeriodLength=1Y

Note that clean_PeriodLenght.job will remove last period files, i.e last simulated year files.

2.0.4.2. Pack Frequency

Default pack frequency is 10Y, i.e in config.card :

PackFrequency=10Y

Note that since clean_latestPackperiod.job works on the latest pack period, clean_latestPackperiod.job will remove files from latest 10Y pack period. clean_latestPackperiod.job can also be used several time in a row to delete several 10Y pack periods.

2.0.4.3. Rebuild frequency

Since we run with XIOS (server mode) as output library, the rebuild step is not needed anymore.

2.0.5. Computing centres

2.0.5.1. TGCC Bull Curie thin nodes

Default configuration on 160 cores allows you to run 38 simulated years per day. Because of load-balancing (difference between ocean computing time and atmosphere computing time), not all configurations (in terms of number of process/threads) are efficient. If you want to run a configuration with less cores, ask Arnaud Caubel what would be the optimum configuration. The configuration is regularly used and evaluated on this machine: ​http://webservices.ipsl.jussieu.fr/trusting/

2.0.5.2. IDRIS IBM Ada

Configuration on 56 cores allows you to run 16 simulated years per day. This configuration is regularly used and evaluated on this machine: ​http://webservices.ipsl.jussieu.fr/trusting/

2.0.6. Evaluation

Person in charge: Jérôme Servonnat

2.0.6.1. Results comparison between TGCC Curie and IDRIS Ada supercomputers

Simulations with default configuration have been performed both on Curie and Ada :

Inter-monitoring comparison : http://esgf.extra.cea.fr/thredds/fileServer/work/p86caub/INTERMONITORING/intermonit_comp_ada_curie_rc0/index.html

2.0.6.2. Results comparison between IPSLCM5 and IPSLCM6 simulations

Here are simulations performed to validate IPSLCM6-VLR_rc0 configuration :

  • CTLCM6G (default configuration IPSLCM6-VLR_rc0) : IPSLCM6-VLR_rc0 model (CM6 water routing scheme, pmagic=-0.01, start from 2349-12-31 piControl2pm01)
    • Output and Analyse files : /ccc/store/cont003/dsm/p86caub/IGCM_OUT/IPSLCM6/PROD/piControl/CTLCM6G
  • CTLCM6F : IPSLCM6-VLR_rc0 model(CM5 water routing scheme, start from 2499-12-31 piControl2)
    • Output and Analyse files : /ccc/store/cont003/dsm/p86caub/IGCM_OUT/IPSLCM6/PROD/piControl/CTLCM6F
  • CTLCM6H : IPSLCM6-VLR_rc0 model (CM6 water routing scheme, pmagic=-0.01, without NEMO TKE IPSLCM5 parameters, start from 3199-12-31 CTLCM6G)
    • Output and Analyse files : /ccc/store/cont003/dsm/p86caub/IGCM_OUT/IPSLCM6/PROD/piControl/CTLCM6H

Warning : CTLCM6G, CTLCM6F, CTCCM6H have problems on atmospheric variable on level pressure (problem fixed in reference IPSLCM6-VLR_rc0 version).

These simulations have been compared with IPSLCM5 simulations results :

  • piControl2 : IPSLCM5A reference simulation
  • CTLCM5V5v5 : IPSLCM5_v5 configuration(aerosols v5)
  • piControl2pm01 : IPSLCM5A reference simulation with pmagic=-0.01.

Following validation aspects are available :

No image "Metrics_IPSLCM6.png" attached to Doc/Config/IPSLCM5A2

Root-Mean-Square Error calculated on the seasonal cycle over the globe (land + ocean) against two different references for each variable. This metric synthesizes the bias (difference in mean), the spatio-temporal correlation and standard-deviation ratio. The results are presented in % of the mean RMSE of piControl2 => a result of -10% indicates that the RMSE is 10% lower than the average RMSE of the reference simulation (here, five seasonal cycles of piControl2) ; the blue color shows the RMSE that are lower (in better agreement with the reference dataset) than the reference simulation. Inversely, the red color indicates a degradation compared with the reference simulation. For each simulation, the RMSE are shown for several seasonal cycles to illustrate the interannual/decadal variability of the results. For further illustration of the differences between IPSL-CM5A-LR and CM6A-VLR_rc0 with new water routing scheme and p_magic = -0.01, please refer to the following atlases:

The table shows that :

Conclusion of the metric table:

  • the evaluation metrics of the seasonal cycle of IPSLCM6A-VLR_rc0 with the water routing scheme of CM5A and the same p_magic are similar to the ones obtained for piControl2. This suggests that the model is the same.
  • the new water routing scheme and the tuned p_magic produce a climate that is in better agreement for IPSLCM6A-CLR_rc0 compared with IPSLCM5A-LR for tas and the SW; we note a degradation of the LW and the zonal winds (stronger biases, rather than a degradation of the spatial structure) ; with the new water routing scheme and p_magic = -0.01, we can say that IPSLCM6A-VLR_rc0 is not the same as CM5A-LR.

Attachments (6)