{{{
#!html
IPSLCM6 configurations
}}}
----
[[PageOutline(1-2,Table of contents,,numbered)]]
Person in charge: Arnaud Caubel
----
# IPSLCM6 model #
IPSLCM6 is '''the IPSL coupled climate model''' under development for the CMIP6 simulations including atmosphere, land, ocean, sea ice and carbon cycle. This configuration includes :
* model components :
* '''LMDZ''' as atmospheric model ;
* '''NEMO''' as ocean model including sea ice (LIM2/LIM3) and marine biogeochemistry (PISCES) ;
* '''ORCHIDEE''' as land model ;
* tools :
* '''OASIS3-MCT''' as parallel coupler ;
* '''XIOS''' as I/O library ;
* '''libIGCM''' as running environment (scripts) to run the model and to perform post processing ;
[[Image(IPSLCM6.png, 500px)]]
# Resolutions and configurations #
IPSLCM6 model will be available at different resolutions/configurations :
* '''IPSLCM6A-VLR_rc0''' : LMDZ (Old Physics) 96x95x39 - NEMO-LIM2-PISCES ORCA2
* IPSLCM6-LR (under development, not available) : LMDZ 144x144x79 - NEMO-LIM3-PISCES ORCA1xL75
## IPSLCM6A-VLR_rc0 ##
The resolution of LMDZ is 96x95 (3,75° in longitude and 1,875° in latitude) with 39 vertical levels. The ocean configuration is ORCA2 : global ocean with a tripolar grid with one South pole, one North pole above Siberia and one North pole above northern America. The resolution is 2°. In the tropical region, the latitudinal resolution decreases to 1/2°. There are 31 vertical levels.
'''IPSLCM6-VLR_rc0''' is composed of following components and tools :
{{{
#-H- IPSLCM6_rc0 IPSLCM6_rc0 coupled configuration
#-H- IPSLCM6_rc0 Working configuration started 17/04/2013
#-H- IPSLCM6_rc0 with 5 NEMO sub-domains
#-H- IPSLCM6_rc0 NEMOGCM trunk revision 4859
#-H- IPSLCM6_rc0 XIOS branch xios-1.0 revision 592
#-H- IPSLCM6_rc0 IOIPSL/src svn tags/v2_2_2
#-H- IPSLCM6_rc0 LMDZ5 LMDZ6_rc0 branch revision 2283
#-H- IPSLCM6_rc0 ORCHIDEE version trunk rev 2247
#-H- IPSLCM6_rc0 OASIS3-MCT 2.0_branch rev 1129
#-H- IPSLCM6_rc0 IPSLCM6 v6_rc0 svn
#-H- IPSLCM6_rc0 libIGCM trunk 1174
#-M- IPSLCM6_rc0 arnaud.caubel@lsce.ipsl.fr
#-C- IPSLCM6_rc0 IOIPSL/tags/v2_2_2/src HEAD 8 IOIPSL/src modeles
#-C- IPSLCM6_rc0 trunk/ORCHIDEE 2247 14 ORCHIDEE modeles
#-C- IPSLCM6_rc0 branches/OASIS3-MCT_2.0_branch/oasis3-mct 1129 15 oasis3-mct .
#-C- IPSLCM6_rc0 LMDZ5/branches/LMDZ6_rc0 2283 11 LMDZ modeles
#-C- IPSLCM6_rc0 CONFIG/UNIFORM/v6_rc0/IPSLCM6 HEAD 8 IPSLCM6 config
#-C- IPSLCM6_rc0 trunk/libIGCM 1174 10 libIGCM .
#-C- IPSLCM6_rc0 trunk/NEMOGCM 4859 7 . modeles
#-C- IPSLCM6_rc0 XIOS/branchs/xios-1.0 592 12 XIOS modeles
}}}
### How to use it ###
Here are the commands you need to know if you want to retrieve and compile the IPSLCM6 model and if you want to setup and run a piControl experiment (only piControl experiment is available):
{{{
#!sh
mkdir MONREPERTOIRE ; cd MONREPERTOIRE
svn_ano # svn co http://forge.ipsl.jussieu.fr/igcmg/svn/modipsl/trunk modipsl
cd modipsl/util
./model IPSLCM6_rc0
cd ../config/IPSLCM6
gmake # by default ORCA2xLMD9695-L39
cp EXPERIMENTS/IPSLCM5/EXP00/config.card .
vi config.card # modify JobName (at least) : MYJOBNAME, restarts
../../util/ins_job # Check and complete job's header
cd MYJOBNAME
vi Job_MYJOBNAME # modify PeriodNb, adjust the time, headers ...
llsubmit Job_MYJOBNAME # IDRIS
ccc_msub Job_MYJOBNAME # TGCC
}}}
#### Specific command on TGCC Bull Curie thin nodes ####
The basic configuration (default configuration) uses '''160 computing cores''' or 10 nodes: 1 process for XIOS, 31 processes for NEMO, and 32 MPI processes and 4 OpenMP thread for LMDZ.
You have to modifiy header of the Job script as follow :
{{{
#MSUB -n 160 # number of cores used by the Job (equal to the total number of process/threads : for example 32x4 + 31 + 1 = 160)
#MSUB -x # Sprecify the node is not shared
#MSUB -E '--cpu_bind=none'
}}}
#### Specific command on IDRIS IBM Ada ####
The basic configuration uses '''56 computing cores''' or 2 nodes: 1 for XIOS, 7 for NEMO, and 24 MPI and 2 OpenMP for LMDZ.
You have to modifiy headers of the Job script as follows :
{{{
# Nombre de processus MPI demandes (ici 24 + 7 + 1 = 32)
# @ total_tasks = 32
# Nombre de coeurs réellement utilisés (ici 24 x 2 + 7 + 1 = 56)
# @ environment = "BATCH_NUM_PROC_TOT=56"
# Nombre de taches OpenMP/pthreads par processus MPI
# @ parallel_threads = 2
}}}
and config.card as follows :
{{{
#========================================================================
#D-- Executable -
[Executable]
#D- For each component, Real name of executable, Name of executable for oasis
ATM= (gcm.e, lmdz.x, 24MPI, 2OMP)
SRF= ("" ,"" )
SBG= ("" ,"" )
OCE= (opa, opa.xx , 7MPI)
ICE= ("" ,"" )
MBG= ("" ,"" )
CPL= ("", "" )
IOS= (xios_server.exe, xios.x, 1MPI)
}}}
### Restart files ###
IPSLCM6 configuration could restart from any IPSLCM5A, IPSLCM5_v5 and IPSLCM6 restart files.
Default configuration starts from IPSLCM5A piControl2pm01 simulation (2349-12-31).
### Lenghts, frequencies ###
#### Period lenght ####
Default period lenght is 1Y, i.e in config.card :
{{{
PeriodLength=1Y
}}}
Note that clean_month.job will remove last period files, i.e last simulated year files.
#### Pack Frequency ####
Default pack frequency is 10Y, i.e in config.card :
{{{
PackFrequency=10Y
}}}
Note that since clean_year.job works on the latest pack period, clean_year.job will remove files from latest 10Y pack period. clean_year.job can also be used several time in a row to delete several 10Y pack
periods.
#### Rebuild frequency ####
Since we run with XIOS (server mode) as output library, '''the rebuild step is not needed anymore'''.
### Computing performances ###
#### TGCC Bull Curie thin nodes ####
Default configuration on '''160 cores''' allows you to run '''38 simulated years per day'''. Because of load-balancing (difference between ocean computing time and atmosphere computing time), not all configurations (in terms of number of process/threads) are efficient. If you want to run a configuration with less cores, please ask Arnaud Caubel what would be the optimum configuration.
#### IDRIS IBM Ada ####
Configuration on '''56 cores''' allows you to run '''16 simulated years per day'''.
### Evaluation ###
Person in charge: Jérôme Servonnat
#### Results comparaison between TGCC Curie and IDRIS Ada supercomputers ####
Simulations with default configuration have been performed both on Curie and Ada :
* CTLCM6G on Curie : http://dods.extra.cea.fr/work/p86caub/IPSLCM6/PROD/piControl/CTLCM6G/MONITORING
* CM6VLR1 on Ada : http://dodsp.idris.fr/rces061/IPSLCM6/PROD/piControl/CM6VLR1/MONITORING
#### Results comparaison between IPSLCM5 and IPSLCM6 simulations ####
Here are simulations performed to validate IPSLCM6-VLR_rc0 configuration :
* '''CTLCM6G (default configuration IPSLCM6-VLR_rc0)''' : IPSLCM6-VLR_rc0 model (CM6 routing scheme, pmagic=-0.01, start from 2349-12-31 piControl2pm01)
* Output and Analyse files : /ccc/store/cont003/dsm/p86caub/IGCM_OUT/IPSLCM6/PROD/piControl/CTLCM6G
* CTLCM6F : IPSLCM6-VLR_rc0 model(CM5 routing scheme, start from 2499-12-31 piControl2)
* Output and Analyse files : /ccc/store/cont003/dsm/p86caub/IGCM_OUT/IPSLCM6/PROD/piControl/CTLCM6F
* CTLCM6H : IPSLCM6-VLR_rc0 model (CM6 routing scheme, pmagic=-0.01, without NEMO TKE IPSLCM5 parameters, start from 3199-12-31 CTLCM6G)
* Output and Analyse files : /ccc/store/cont003/dsm/p86caub/IGCM_OUT/IPSLCM6/PROD/piControl/CTLCM6H
These simulations have been compared with IPSLCM5 simulations results :
* piControl2 : IPSLCM5A reference simulation
* CTLCM5V5v5 : IPSLCM5_v5 configuration(aerosols v5)
* piControl2pm01 : IPSLCM5A reference simulation with pmagic=-0,01.
[[Image(Metrics_IPSLCM6.png, 500px)]]
Metric table : Root-Mean-Square Error calculated on the seasonal cycle over the globe (land + ocean) against two different references for each variable. This metric synthesizes the bias (difference in mean), the spatio-temporal correlation and standard-deviation ratio. The results are presented in % of the mean RMSE of piControl2 => a result of -10% indicates that the RMSE is 10% lower than the average RMSE of the reference simulation (here, five seasonal cycles of piControl2) ; the blue color shows the RMSE that are lower (in better agreement with the reference dataset) than the reference simulation. Inversely, the red color indicates a degradation compared with the reference simulation. For each simulation, the RMSE are shown for several seasonal cycles to illustrate the interannual/decadal variability of the results.
The table shows that :
- CTLCM5V5v5 has similar results as piControl2 (less than 5%) ; this suggests that CM6A-VLR_rc0 (with new water routing scheme and same p_magic as CM5A-LR) simulates a climate that is very similar to IPSL-CM5A-LR
- Same for CTLCM6F
- CTLCM6G and CTLCM6H (IPSLCM6A-VLR_rc0 with new water routing scheme and p_magic = -0.01) and piControl2pm01 (p_magic = -0.01) show a reduction of the error on the 2m-temperature (tas) of around 15%, very likely associated with the adjustment of albedo (p_magic = -0.01)
- For those simulations, we also note a degradation of the LW up (rlut and rlutcs) between 5 and 10% (greater than the variability among the seasonal cycles of piControl2), probably linked with the p_magic (mainly concerns the tropics, not shown); in the same time, the SW gets significantly better (around 5%)
- For CTLCM6G and CTLCM6H, we also see a slight degradation of the zonal wind at 10m (uas), of the same order as the LW ; looking at the RMSE tables for the different seasons and regions, we can see that this degradation mainly concerns the tropics (-20/20°N) and the extra-tropical southern hemisphere
- For the other variables, the results do not show significant differences between piControl2 and IPSLCM6A-VLR_rc0 (with the new water routing scheme and p_magic = -0.01, simulations CTLCM6G and CTLCM6H)
Conclusion:
- the evalution metrics of the seasonal cycle of IPSLCM6A-VLR_rc0 with the water routing scheme of CM5A and the same p_magic are similar to the ones obtained for piControl2. This suggests that the model is the same.
- the new water routing scheme and the tuned p_magic produce a climate that is in better agreement for IPSLCM6A-CLR_rc0 compared with IPSLCM5A-LR for tas and the SW; we note a degradation of the LW and the zonal winds; with the new water routing scheme and p_magic = -0.01, we can say that IPSLCM6A-VLR_rc0 is not the same as CM5A-LR. Further assessment is needed to understand what's happening with the radiative variables.