Person in charge: Arnaud Caubel
IPSLCM6 is the IPSL coupled climate model under development for the CMIP6 simulations including atmosphere, land, ocean, sea ice and carbon cycle. This configuration includes :
IPSLCM6 model will be available at different resolutions/configurations :
The resolution of LMDZ is 96x95 (3,75° in longitude and 1,875° in latitude) with 39 vertical levels. The ocean configuration is ORCA2 : global ocean with a tripolar grid with one South pole, one North pole above Siberia and one North pole above northern America. The resolution is 2°. In the tropical region, the latitudinal resolution decreases to 1/2°. There are 31 vertical levels.
IPSLCM6-VLR_rc0 is composed of following components and tools :
#-H- IPSLCM6_rc0 IPSLCM6_rc0 coupled configuration #-H- IPSLCM6_rc0 Working configuration started 17/04/2013 #-H- IPSLCM6_rc0 with 5 NEMO sub-domains #-H- IPSLCM6_rc0 NEMOGCM trunk revision 4859 #-H- IPSLCM6_rc0 XIOS branch xios-1.0 revision 592 #-H- IPSLCM6_rc0 IOIPSL/src svn tags/v2_2_2 #-H- IPSLCM6_rc0 LMDZ5 LMDZ6_rc0 branch revision 2283 #-H- IPSLCM6_rc0 ORCHIDEE version trunk rev 2247 #-H- IPSLCM6_rc0 OASIS3-MCT 2.0_branch rev 1129 #-H- IPSLCM6_rc0 IPSLCM6 v6_rc0 svn #-H- IPSLCM6_rc0 libIGCM trunk 1174 #-M- IPSLCM6_rc0 arnaud.caubel@lsce.ipsl.fr #-C- IPSLCM6_rc0 IOIPSL/tags/v2_2_2/src HEAD 8 IOIPSL/src modeles #-C- IPSLCM6_rc0 trunk/ORCHIDEE 2247 14 ORCHIDEE modeles #-C- IPSLCM6_rc0 branches/OASIS3-MCT_2.0_branch/oasis3-mct 1129 15 oasis3-mct . #-C- IPSLCM6_rc0 LMDZ5/branches/LMDZ6_rc0 2283 11 LMDZ modeles #-C- IPSLCM6_rc0 CONFIG/UNIFORM/v6_rc0/IPSLCM6 HEAD 8 IPSLCM6 config #-C- IPSLCM6_rc0 trunk/libIGCM 1174 10 libIGCM . #-C- IPSLCM6_rc0 trunk/NEMOGCM 4859 7 . modeles #-C- IPSLCM6_rc0 XIOS/branchs/xios-1.0 592 12 XIOS modeles
Here are the commands you need to know if you want to retrieve and compile the IPSLCM6 model and if you want to setup and run a piControl experiment (only piControl experiment is available):
mkdir MONREPERTOIRE ; cd MONREPERTOIRE svn_ano # svn co http://forge.ipsl.jussieu.fr/igcmg/svn/modipsl/trunk modipsl cd modipsl/util ./model IPSLCM6_rc0 cd ../config/IPSLCM6 gmake # by default ORCA2xLMD9695-L39 cp EXPERIMENTS/IPSLCM5/EXP00/config.card . vi config.card # modify JobName (at least) : MYJOBNAME, restarts ../../util/ins_job # Check and complete job's header cd MYJOBNAME vi Job_MYJOBNAME # modify PeriodNb, adjust the time, headers ... llsubmit Job_MYJOBNAME # IDRIS ccc_msub Job_MYJOBNAME # TGCC
The basic configuration (default configuration) uses 160 computing cores or 10 nodes: 1 process for XIOS, 31 processes for NEMO, and 32 MPI processes and 4 OpenMP thread for LMDZ. You have to modifiy header of the Job script as follow :
#MSUB -n 160 # number of cores used by the Job (equal to the total number of process/threads : for example 32x4 + 31 + 1 = 160) #MSUB -x # Sprecify the node is not shared #MSUB -E '--cpu_bind=none'
The basic configuration uses 56 computing cores or 2 nodes: 1 for XIOS, 7 for NEMO, and 24 MPI and 2 OpenMP for LMDZ. You have to modifiy headers of the Job script as follows :
# Nombre de processus MPI demandes (ici 24 + 7 + 1 = 32) # @ total_tasks = 32 # Nombre de coeurs réellement utilisés (ici 24 x 2 + 7 + 1 = 56) # @ environment = "BATCH_NUM_PROC_TOT=56" # Nombre de taches OpenMP/pthreads par processus MPI # @ parallel_threads = 2
and config.card as follows :
#======================================================================== #D-- Executable - [Executable] #D- For each component, Real name of executable, Name of executable for oasis ATM= (gcm.e, lmdz.x, 24MPI, 2OMP) SRF= ("" ,"" ) SBG= ("" ,"" ) OCE= (opa, opa.xx , 7MPI) ICE= ("" ,"" ) MBG= ("" ,"" ) CPL= ("", "" ) IOS= (xios_server.exe, xios.x, 1MPI)
IPSLCM6 configuration could restart from any IPSLCM5A, IPSLCM5_v5 and IPSLCM6 restart files. Default configuration starts from IPSLCM5A piControl2pm01 simulation (2349-12-31).
Default period lenght is 1Y, i.e in config.card :
PeriodLength=1Y
Note that clean_month.job will remove last period files, i.e last simulated year files.
Default pack frequency is 10Y, i.e in config.card :
PackFrequency=10Y
Note that since clean_year.job works on the latest pack period, clean_year.job will remove files from latest 10Y pack period. clean_year.job can also be used several time in a row to delete several 10Y pack periods.
Since we run with XIOS (server mode) as output library, the rebuild step is not needed anymore.
Default configuration on 160 cores allows you to run 38 simulated years per day. Because of load-balancing (difference between ocean computing time and atmosphere computing time), not all configurations (in terms of number of process/threads) are efficient. If you want to run a configuration with less cores, please ask Arnaud Caubel what would be the optimum configuration.
Configuration on 56 cores allows you to run 16 simulated years per day.
Person in charge: Jérôme Servonnat
Simulations with default configuration have been performed both on Curie and Ada :
Here are simulations performed to validate IPSLCM6-VLR_rc0 configuration :
These simulations have been compared with IPSLCM5 simulations results :
Metric table : Root-Mean-Square Error calculated on the seasonal cycle over the globe (land + ocean) against two different references for each variable. This metric synthesizes the bias (difference in mean), the spatio-temporal correlation and standard-deviation ratio. The results are presented in % of the mean RMSE of piControl2 => a result of -10% indicates that the RMSE is 10% lower than the average RMSE of the reference simulation (here, five seasonal cycles of piControl2) ; the blue color shows the RMSE that are lower (in better agreement with the reference dataset) than the reference simulation. Inversely, the red color indicates a degradation compared with the reference simulation. For each simulation, the RMSE are shown for several seasonal cycles to illustrate the interannual/decadal variability of the results.
The table shows that :
Conclusion: