| 151 | | #### Results comparison between TGCC Curie and IDRIS Ada supercomputers #### |
| 152 | | |
| 153 | | Simulations with default configuration have been performed both on Curie and Ada : |
| 154 | | * CTLCM6G on Curie : http://esgf.extra.cea.fr/thredds/fileServer/work/p86caub/IPSLCM6/PROD/piControl/CTLCM6G/MONITORING/index.html |
| 155 | | * CM6VLR1 on Ada : https://prodn.idris.fr/thredds/fileServer/ipsl_public/rces061/IPSLCM6/PROD/piControl/CM6VLR1/MONITORING/index.html |
| 156 | | Inter-monitoring comparison : http://esgf.extra.cea.fr/thredds/fileServer/work/p86caub/INTERMONITORING/intermonit_comp_ada_curie_rc0/index.html |
| 157 | | |
| 158 | | #### Results comparison between IPSLCM5 and IPSLCM6 simulations #### |
| 159 | | |
| 160 | | Here are simulations performed to validate IPSLCM6-VLR_rc0 configuration : |
| 161 | | |
| 162 | | * '''CTLCM6G (default configuration IPSLCM6-VLR_rc0)''' : IPSLCM6-VLR_rc0 model (CM6 water routing scheme, pmagic=-0.01, start from 2349-12-31 piControl2pm01) |
| 163 | | * Output and Analyse files : /ccc/store/cont003/dsm/p86caub/IGCM_OUT/IPSLCM6/PROD/piControl/CTLCM6G |
| 164 | | * CTLCM6F : IPSLCM6-VLR_rc0 model(CM5 water routing scheme, start from 2499-12-31 piControl2) |
| 165 | | * Output and Analyse files : /ccc/store/cont003/dsm/p86caub/IGCM_OUT/IPSLCM6/PROD/piControl/CTLCM6F |
| 166 | | * CTLCM6H : IPSLCM6-VLR_rc0 model (CM6 water routing scheme, pmagic=-0.01, without NEMO TKE IPSLCM5 parameters, start from 3199-12-31 CTLCM6G) |
| 167 | | * Output and Analyse files : /ccc/store/cont003/dsm/p86caub/IGCM_OUT/IPSLCM6/PROD/piControl/CTLCM6H |
| 168 | | |
| 169 | | '''Warning''' : CTLCM6G, CTLCM6F, CTCCM6H have problems on atmospheric variable on level pressure (problem fixed in reference IPSLCM6-VLR_rc0 version). |
| 170 | | |
| 171 | | These simulations have been compared with IPSLCM5 simulations results : |
| 172 | | * piControl2 : IPSLCM5A reference simulation |
| 173 | | * CTLCM5V5v5 : IPSLCM5_v5 configuration(aerosols v5) |
| 174 | | * piControl2pm01 : IPSLCM5A reference simulation with pmagic=-0.01. |
| 175 | | |
| 176 | | Following validation aspects are available : |
| 177 | | * Inter-monitoring comparison : http://esgf.extra.cea.fr/thredds/fileServer/work/p86caub/INTERMONITORING/intermonit_valid_CM6A_VLR_rc0/index.html |
| 178 | | * Metric table |
| 179 | | |
| 180 | | [[Image(Metrics_IPSLCM6.png, 500px)]] |
| 181 | | |
| 182 | | Root-Mean-Square Error calculated on the seasonal cycle over the globe (land + ocean) against two different references for each variable. This metric synthesizes the bias (difference in mean), the spatio-temporal correlation and standard-deviation ratio. The results are presented in % of the mean RMSE of piControl2 => a result of -10% indicates that the RMSE is 10% lower than the average RMSE of the reference simulation (here, five seasonal cycles of piControl2) ; the blue color shows the RMSE that are lower (in better agreement with the reference dataset) than the reference simulation. Inversely, the red color indicates a degradation compared with the reference simulation. For each simulation, the RMSE are shown for several seasonal cycles to illustrate the interannual/decadal variability of the results. |
| 183 | | For further illustration of the differences between IPSL-CM5A-LR and CM6A-VLR_rc0 with new water routing scheme and p_magic = -0.01, please refer to the following atlases: |
| 184 | | - IPSL-CM5A-LR: http://esgf.extra.cea.fr/thredds/fileServer/work/p86caub/IPSLCM5A/DEVT/piControl/CTLCM5V5v5/ATLAS/SE_2500_2539/ATM/ATM.html |
| 185 | | - IPSL-CM6A-VLR_rc0: http://esgf.extra.cea.fr/thredds/fileServer/work/p86caub/IPSLCM6/PROD/piControl/CTLCM6G/ATLAS/SE_3250_3299/ATM/ATM.html |
| 186 | | |
| 187 | | The table shows that : |
| 188 | | - CTLCM5V5v5 has similar results as piControl2 (less than 5%) ; this suggests that CM6A-VLR_rc0 (with same water routing scheme and same p_magic as CM5A-LR) simulates a climate that is very similar to IPSL-CM5A-LR |
| 189 | | - Same for CTLCM6F |
| 190 | | - CTLCM6G and CTLCM6H (IPSLCM6A-VLR_rc0 with new water routing scheme and p_magic = -0.01) and piControl2pm01 (p_magic = -0.01) show a reduction of the error on the 2m-temperature (tas) of around 15%, very likely associated with the adjustment of albedo (p_magic = -0.01) |
| 191 | | - For those simulations, we also note a degradation of the LW up (rlut and rlutcs) between 5 and 10% (greater than the variability among the seasonal cycles of piControl2); this is confirmed by the bias maps of CTLCM6G (http://esgf.extra.cea.fr/thredds/fileServer/work/p86caub/IPSLCM6/PROD/piControl/CTLCM6G/ATLAS/SE_3250_3299/ATM/lw_116852/lw.pdf) compared with CTLCM5V5v5 (http://esgf.extra.cea.fr/thredds/fileServer/work/p86caub/IPSLCM5A/DEVT/piControl/CTLCM5V5v5/ATLAS/SE_2500_2539/ATM/lw_26556/lw.pdf) ; this change mainly concerns the tropics; in the same time, the metric table shows that the SW gets significantly better (around 5%) |
| 192 | | - For CTLCM6G and CTLCM6H, we also see a slight degradation of the zonal wind at 10m (uas), of the same order as the LW ; looking at the RMSE tables for the different seasons and regions, we can see that this degradation mainly concerns the tropics (-20/20°N) and the extra-tropical southern hemisphere. On the bias maps (compare http://esgf.extra.cea.fr/thredds/fileServer/work/p86caub/IPSLCM5A/DEVT/piControl/CTLCM5V5v5/ATLAS/SE_2500_2539/ATM/vitu_44109/vitu.gif with http://esgf.extra.cea.fr/thredds/fileServer/work/p86caub/IPSLCM6/PROD/piControl/CTLCM6G/ATLAS/SE_3250_3299/ATM/vitu_60643/vitu.gif) we see that the zonal wind biases are the same but slightly reinforced in CTLCM6G. |
| 193 | | - For the other variables, the results do not show significant differences between piControl2 and IPSLCM6A-VLR_rc0 (with the new water routing scheme and p_magic = -0.01, simulations CTLCM6G and CTLCM6H) |
| 194 | | |
| 195 | | '''Conclusion of the metric table''': |
| 196 | | - the evaluation metrics of the seasonal cycle of IPSLCM6A-VLR_rc0 with the water routing scheme of CM5A and the same p_magic are similar to the ones obtained for piControl2. This suggests that the model is the same. |
| 197 | | - the new water routing scheme and the tuned p_magic produce a climate that is in better agreement for IPSLCM6A-CLR_rc0 compared with IPSLCM5A-LR for tas and the SW; we note a degradation of the LW and the zonal winds (stronger biases, rather than a degradation of the spatial structure) ; with the new water routing scheme and p_magic = -0.01, we can say that IPSLCM6A-VLR_rc0 is not the same as CM5A-LR. |
