Changes between Version 8 and Version 9 of 2021WP/VLD-05_Coward_SETTE_inputs

Timestamp:

2021-03-16T11:23:36+01:00 (3 years ago)

Author:

acc

Comment:

--

2021WP/VLD-05_Coward_SETTE_inputs

@@ -27 +27 @@
 '''Stage 2''': Reduce data volumes by selecting only sufficient forcing data for twice the period of each standard test. Run SETTE with reduced set and confirm unchanged results. Create recommended 'r4.2_RC' set. See details [#Stage2details here]
 
-'''Stage3''': Reduce data volumes further by limiting number of significant digits in all fields other than domain and coordinate variables. Confirm SETTE tests are still successful (results WILL be different). Create optional 'r4.2_RC_LITE' set.
+'''Stage3''': Reduce data volumes further by limiting number of significant digits in all fields other than domain and coordinate variables. Confirm SETTE tests are still successful (results WILL be different). Create optional 'r4.2_RC_LITE' set. See details [#Stage3details here]
 
 '''Stage 4''': Find a hosting and distribution option
@@ -683 +683 @@
 With this secondary manipulation the overall volumes reduces from 4.5 GB to 3.7GB and there is no change in SETTE results when compared with results using the r4.2_RC_FULL set
 
+=== Stage 3 details
+
+Stage 3 is a repeat of the stage 2 process with addition of reduced precision operations on most variables. This makes use of the {{{--ppc default=n}}} option on the ncks command where {{{n}}} controls the stored precision. The effect and benefit of this to compression are illustrated by this example from [http://nco.sourceforge.net/nco.html#Precision_002dPreserving-Compression the ncks documention]:
+
+{{{
+Reducing the preserved precision of NSD-rounding produces increasingly long strings of identical-bits amenable to compression:
+
+S Exponent  Fraction (Significand)   Decimal    Notes
+0 100000001 0010010000111111011011 # 3.14159265 Exact
+0 100000001 0010010000111111011011 # 3.14159265 NSD = 8
+0 100000001 0010010000111111011010 # 3.14159262 NSD = 7
+0 100000001 0010010000111111011000 # 3.14159203 NSD = 6
+0 100000001 0010010000111111000000 # 3.14158630 NSD = 5
+0 100000001 0010010000111100000000 # 3.14154053 NSD = 4
+0 100000001 0010010000000000000000 # 3.14062500 NSD = 3
+0 100000001 0010010000000000000000 # 3.14062500 NSD = 2
+0 100000001 0010000000000000000000 # 3.12500000 NSD = 1
+}}}
+
+which shows the effect of varying {{{n}}} (aka Number of Significant Digits (NSD)) on the stored value of pi. In the binary representation, a smaller value for NSD means longer strings of repeated 1's or 0's and therefore greater compression.
+
+Coordinate and grid metric values have not been altered at this stage but all other fields have been stored with a NSD of either 3 or 4 depending on the likely range of the contents. For example, initial temperature and salinity fields need no more than 3 significant digits to retain a meaningful variation whilst freshwater fluxes are kept with NSD=4. NSD=4 is used whenever content is mixed or the range uncertain. The full list of commands used to generate the r4.2_RC_LITE set is given below. This repeats the stage 2 process with additional {{{--ppc default=n}}} arguments. The second pass made at stage 2 to mix preserved precision for ORCA2_OFF_PISCES and WED025 fields was found to make only a marginal additional reduction and so was not applied to the final set.
+
+The resulting overall volume is reduced to 2.5GB by this process and the resulting fields still provide a rigourous test of code restartability and reproducibility (confirmed). The results do, however, differ from those produced using either the r4.2_RC_FULL or r4.2_RC sets. This is to be expected.
+
+{{{
+#!/bin/bash
+mkdir r4.2_RC_LITE
+cd r4.2_RC_LITE
+cp -pr ../r4.2_RC_FULL/AGRIF_DEMO_v4.2_RC_FULL   AGRIF_DEMO_v4.2_RC_LITE
+cp -pr ../r4.2_RC_FULL/AMM12_v4.2_RC_FULL        AMM12_v4.2_RC_LITE
+cp -pr ../r4.2_RC_FULL/ICE_AGRIF_v4.2_RC_FULL    ICE_AGRIF_v4.2_RC_LITE
+cp -pr ../r4.2_RC_FULL/ISOMIP+_v4.2_RC_FULL      ISOMIP+_v4.2_RC_LITE
+cp -pr ../r4.2_RC_FULL/ORCA2_ICE_v4.2_RC_FULL    ORCA2_ICE_v4.2_RC_LITE
+cp -pr ../r4.2_RC_FULL/ORCA2_OFF_v4.2_RC_FULL    ORCA2_OFF_v4.2_RC_LITE
+cp -pr ../r4.2_RC_FULL/SAS_v4.2_RC_FULL          SAS_v4.2_RC_LITE
+cp -pr ../r4.2_RC_FULL/WED025_v4.2_RC_FULL       WED025_v4.2_RC_LITE
+########## remove redundant files #########
+for f in AMM12_v4.2_RC_LITE/bdydta/bdydta AMM12_v4.2_RC_LITE/fluxes/fluxes ORCA2_ICE_v4.2_RC_LITE/weights_core2_orca2_bilin.nc.old ORCA2_ICE_v4.2_RC_LITE/weights_core2_orca2_bicub.nc.old WED025_v4.2_RC_LITE/bathy_meter_WED025.nc WED025_v4.2_RC_LITE/coordinates_WED025.nc
+do
+ if [ -e $f ] ; then rm $f ; fi
+done
+########## AGRIFcmds ##########
+#if [ 1 == 0 ] ; then
+cd AGRIF_DEMO_v4.2_RC_LITE
+ncks --no_abc --cnk_plc='xpl' --cnk_dmn t,1 --cnk_dmn x,60 --cnk_dmn y,50 --cnk_dmn z,4 ORCA_R2_zps_domcfg_agrif.nc new_ORCA_R2_zps_domcfg_agrif.nc
+mv new_ORCA_R2_zps_domcfg_agrif.nc ORCA_R2_zps_domcfg_agrif.nc
+#
+for f in 1_chlorophyll.nc 1_geothermal_heating.nc 1_runoff_core_monthly.nc 1_sss_data.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --ppc default=4 --cnk_plc='xpl' --cnk_dmn time_counter,1 --cnk_dmn x,48 --cnk_dmn y,50 $f new_$f
+done
+#
+for f in 1_data_1m_potential_temperature_nomask.nc 1_data_1m_salinity_nomask.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --ppc default=3 --cnk_plc='xpl' --cnk_dmn time_counter,1 --cnk_dmn x,48 --cnk_dmn y,50 --cnk_dmn z,4 $f new_$f
+done
+#
+for f in 1_eddy_viscosity_3D.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --ppc default=4 --cnk_plc='xpl' --cnk_dmn t,1 --cnk_dmn x,48 --cnk_dmn y,50 --cnk_dmn z,4 $f new_$f
+done
+for f in 1_ORCA_R2_zps_domcfg_agrif.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --cnk_plc='xpl' --cnk_dmn t,1 --cnk_dmn x,48 --cnk_dmn y,50 --cnk_dmn z,4 $f new_$f
+done
+#
+for f in 1_resto.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --ppc default=4 --cnk_plc='xpl' --cnk_dmn x,48 --cnk_dmn y,50 --cnk_dmn z,4 $f new_$f
+done
+#
+for f in 1_weights_core_orca2_bicubic_noc.nc 1_weights_core_orca2_bilinear_noc.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --cnk_plc='xpl' --cnk_dmn lon,48 --cnk_dmn lat,50  $f new_$f
+done
+#
+for f in 2_chlorophyll.nc 2_geothermal_heating.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --ppc default=4 --cnk_plc='xpl' --cnk_dmn time_counter,1 --cnk_dmn x,66 --cnk_dmn y,70 $f new_$f
+done
+#
+for f in 2_data_1m_potential_temperature_nomask.nc 2_data_1m_salinity_nomask.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --ppc default=3 --cnk_plc='xpl' --cnk_dmn time_counter,1 --cnk_dmn x,66 --cnk_dmn y,70 --cnk_dmn z,4 $f new_$f
+done
+#
+for f in 2_ORCA_R05_zps_domcfg_agrif.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --cnk_plc='xpl' --cnk_dmn t,1 --cnk_dmn x,66 --cnk_dmn y,70 --cnk_dmn z,4 $f new_$f
+done
+#
+for f in 2_weights_core2_nordic1_bicub.nc 2_weights_core2_nordic1_bilin.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --cnk_plc='xpl' --cnk_dmn lon,66 --cnk_dmn lat,70 $f new_$f
+done
+#
+
+for f in 3_chlorophyll.nc 3_geothermal_heating.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --ppc default=4 --cnk_plc='xpl' --cnk_dmn time_counter,1 --cnk_dmn x,67 --cnk_dmn y,64 $f new_$f
+done
+#
+for f in 3_data_1m_potential_temperature_nomask.nc 3_data_1m_salinity_nomask.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --ppc default=3 --cnk_plc='xpl' --cnk_dmn time_counter,1 --cnk_dmn x,67 --cnk_dmn y,64 --cnk_dmn z,4 $f new_$f
+done
+#
+for f in 3_ORCA_R017_zps_domcfg_agrif.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --cnk_plc='xpl' --cnk_dmn t,1 --cnk_dmn x,67 --cnk_dmn y,64 --cnk_dmn z,4 $f new_$f
+done
+#
+for f in 3_weights_core2_nordic2_bicub.nc 3_weights_core2_nordic2_bilin.nc
+do
+ ncks --no_abc --4 --dfl_lvl 3  --ppc default=4 --cnk_plc='xpl'  --cnk_dmn lon,67 --cnk_dmn lat,64 $f new_$f
+done
+#
+for f in new*; do ff=${f/new_}; mv $f $ff; done
+cd ../
+#fi
+########## AMMcmds ##########
+cd AMM12_v4.2_RC_LITE
+ncks --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,32 --cnk_dmn y,32 --cnk_dmn z,6 --cnk_dmn t,1 --4 --dfl_lvl 3 amm12_restart_oce.nc new_amm12_restart_oce.nc
+mv new_amm12_restart_oce.nc amm12_restart_oce.nc
+#
+ncks --4 --no_abc --cnk_dmn=x,32 --cnk_dmn=y,32 --cnk_dmn=z,6 --cnk_dmn=t,1 --dfl_lvl 3 --cnk_plc='xpl' AMM_R12_sco_domcfg.nc new_AMM_R12_sco_domcfg.nc
+mv new_AMM_R12_sco_domcfg.nc AMM_R12_sco_domcfg.nc
+#
+ncks --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,32 --cnk_dmn y,32 --cnk_dmn time_counter,1 --4 --dfl_lvl 3 amm12_rivers.nc new_amm12_rivers.nc
+mv new_amm12_rivers.nc amm12_rivers.nc
+#
+cd fluxes/
+mkdir new
+for f in *.nc; do ncks --no_abc --ppc default=4 --cnk_plc='xpl' --cnk_dmn x,32 --cnk_dmn y,32 --cnk_dmn t,1 --4 --dfl_lvl 3 $f new/$f; done
+cd new
+mv amm* ../
+cd ../
+rmdir new
+cd ../
+#
+cd bdydta
+mkdir new
+for f in amm12_bdyT_tra*; do ncks --no_abc --ppc default=3 --cnk_plc='xpl' --cnk_dmn x,64 --cnk_dmn y,1 --cnk_dmn=deptht,51 --cnk_dmn time_counter,1 --4 --dfl_lvl 3 $f new/$f; done
+cd new
+mv amm* ../
+cd ../
+rmdir new
+cd ../
+#
+cd ../
+########## ICEcmds ##########
+cd ICE_AGRIF_v4.2_RC_LITE
+ncks --no_abc --cnk_plc='xpl' --cnk_dmn time_counter,1 --cnk_dmn x,49 --cnk_dmn y,49 initice.nc new_initice.nc
+mv new_initice.nc initice.nc
+cd ../
+########## ISOcmds ##########
+cd ISOMIP+_v4.2_RC_LITE
+ncks --no_abc --cnk_dmn x,52 --cnk_dmn y,42 --cnk_dmn nav_lev,1 --cnk_dmn time_counter,1  domain_cfg.nc new_domain_cfg.nc
+ncks --no_abc --cnk_dmn x,52 --cnk_dmn y,21 --cnk_dmn t,1 isomip+_NEMO_242_geom_ocean3.nc new_isomip+_NEMO_242_geom_ocean3.nc
+ncks --no_abc --cnk_dmn x,52 --cnk_dmn y,21 --cnk_dmn t,1 isomip+_NEMO_242_geom_ocean4.nc new_isomip+_NEMO_242_geom_ocean4.nc
+ncks --no_abc --cnk_dmn x,52 --cnk_dmn y,21 --cnk_dmn z,10 nemo_base_COLD.nc new_nemo_base_COLD.nc
+ncks --no_abc --cnk_dmn x,52 --cnk_dmn y,21 --cnk_dmn z,10 nemo_base_WARM.nc new_nemo_base_WARM.nc
+ncks --no_abc --cnk_dmn x,52 --cnk_dmn y,21 --cnk_dmn z,10 resto.nc new_resto.nc
+mv new_domain_cfg.nc domain_cfg.nc
+mv new_isomip+_NEMO_242_geom_ocean3.nc isomip+_NEMO_242_geom_ocean3.nc
+mv new_isomip+_NEMO_242_geom_ocean4.nc isomip+_NEMO_242_geom_ocean4.nc
+mv new_nemo_base_COLD.nc nemo_base_COLD.nc
+mv new_nemo_base_WARM.nc nemo_base_WARM.nc
+mv new_resto.nc resto.nc
+cd ../
+########## ORCA2_ICEcmds ##########
+cd ORCA2_ICE_v4.2_RC_LITE
+ncks --no_abc --cnk_plc='xpl' --cnk_dmn lon,30 --cnk_dmn lat,30 weights_core2_orca2_bicub.nc new_weights_core2_orca2_bicub.nc
+ncks --no_abc --cnk_plc='xpl' --cnk_dmn lon,30 --cnk_dmn lat,30 weights_core2_orca2_bilin.nc new_weights_core2_orca2_bilin.nc
+mv new_weights_core2_orca2_bilin.nc weights_core2_orca2_bilin.nc
+mv new_weights_core2_orca2_bicub.nc weights_core2_orca2_bicub.nc
+#
+# ncar_precip.15JUNE2009_fill.nc ncar_rad.15JUNE2009_fill.nc slp.15JUNE2009_fill.nc
+#     LAT LON TIME
+# q_10.15JUNE2009_fill.nc t_10.15JUNE2009_fill.nc u_10.15JUNE2009_fill.nc v_10.15JUNE2009_fill.nc
+#     lat lon time
+#
+ncks --4 --dfl_lvl 1 --no_abc -v T_10_MOD -d time,0,719 --ppc default=3 --cnk_plc='xpl' --cnk_dmn lon,32 --cnk_dmn lat,32 --cnk_dmn time,1  t_10.15JUNE2009_fill.nc new_t_10.15JUNE2009_fill.nc
+#
+ncks --4 --dfl_lvl 1 --no_abc -v U_10_MOD -d time,0,719 --ppc default=4 --cnk_plc='xpl' --cnk_dmn lon,32 --cnk_dmn lat,32 --cnk_dmn time,1  u_10.15JUNE2009_fill.nc new_u_10.15JUNE2009_fill.nc
+#
+ncks --4 --dfl_lvl 1 --no_abc -v V_10_MOD -d time,0,719 --ppc default=4 --cnk_plc='xpl' --cnk_dmn lon,32 --cnk_dmn lat,32 --cnk_dmn time,1  v_10.15JUNE2009_fill.nc new_v_10.15JUNE2009_fill.nc
+#
+ncks --4 --dfl_lvl 1 --no_abc -v Q_10_MOD -d time,0,719 --ppc default=4 --cnk_plc='xpl' --cnk_dmn lon,32 --cnk_dmn lat,32 --cnk_dmn time,1  q_10.15JUNE2009_fill.nc new_q_10.15JUNE2009_fill.nc
+#
+ncks --4 --dfl_lvl 1 --no_abc -v LWDN_MOD,SWDN_MOD -d time,0,179 --ppc default=4 --cnk_plc='xpl' --cnk_dmn LON,32 --cnk_dmn LAT,32 --cnk_dmn time,1  ncar_rad.15JUNE2009_fill.nc new_ncar_rad.15JUNE2009_fill.nc
+#
+ncks --4 --dfl_lvl 1 --no_abc -v PRC_MOD1,SNOW --ppc default=4 --cnk_plc='xpl' --cnk_dmn LON,32 --cnk_dmn LAT,32 --cnk_dmn time,1  ncar_precip.15JUNE2009_fill.nc new_ncar_precip.15JUNE2009_fill.nc
+#
+ncks --4 --dfl_lvl 1 --no_abc -v SLP -d TIME,0,719 --ppc default=4 --cnk_plc='xpl' --cnk_dmn LON,32 --cnk_dmn LAT,32 --cnk_dmn TIME,1  slp.15JUNE2009_fill.nc new_slp.15JUNE2009_fill.nc
+#
+for f in new*; do ff=${f/new_}; mv $f $ff; done
+#
+ncks --4 --no_abc --cnk_plc='xpl' -d time_counter,0,719 --ppc default=3 --cnk_dmn x,30 --cnk_dmn y,30 --cnk_dmn time_counter,1  sdw_ecwaves_orca2.nc new_sdw_ecwaves_orca2.nc
+mv new_sdw_ecwaves_orca2.nc sdw_ecwaves_orca2.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=3 --cnk_dmn z,4 --cnk_dmn x,30 --cnk_dmn y,30 --cnk_dmn time_counter,1  data_1m_potential_temperature_nomask.nc new_data_1m_potential_temperature_nomask.nc
+mv new_data_1m_potential_temperature_nomask.nc data_1m_potential_temperature_nomask.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=3 --cnk_dmn z,4 --cnk_dmn x,30 --cnk_dmn y,30 --cnk_dmn time_counter,1  data_1m_salinity_nomask.nc new_data_1m_salinity_nomask.nc
+mv new_data_1m_salinity_nomask.nc data_1m_salinity_nomask.nc
+#
+ncks --no_abc --cnk_plc='xpl' --cnk_dmn t,1 --cnk_dmn x,60 --cnk_dmn y,50 --cnk_dmn z,4 ORCA_R2_zps_domcfg.nc new_ORCA_R2_zps_domcfg.nc
+mv new_ORCA_R2_zps_domcfg.nc ORCA_R2_zps_domcfg.nc
+#
+ncks --no_abc --cnk_plc='xpl' --ppc default=3 --cnk_dmn time_counter,1 --cnk_dmn x,60 --cnk_dmn y,50 int_wave_mix.nc new_int_wave_mix.nc
+mv new_int_wave_mix.nc int_wave_mix.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=3 --cnk_dmn z,4 --cnk_dmn x,30 --cnk_dmn y,30 --cnk_dmn time_counter,1  sali_ref_clim_monthly.nc new_sali_ref_clim_monthly.nc
+mv new_sali_ref_clim_monthly.nc sali_ref_clim_monthly.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30 --cnk_dmn time_counter,1  runoff_core_monthly.nc new_runoff_core_monthly.nc
+mv new_runoff_core_monthly.nc runoff_core_monthly.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=3 --cnk_dmn x,30 --cnk_dmn y,30 --cnk_dmn time_counter,1  sst_data.nc new_sst_data.nc
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=3 --cnk_dmn x,30 --cnk_dmn y,30 --cnk_dmn time_counter,1  sss_data.nc new_sss_data.nc
+mv new_sst_data.nc sst_data.nc
+mv new_sss_data.nc sss_data.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn X1,30 --cnk_dmn Y1,30 --cnk_dmn time_counter,1  subbasins.nc new_subbasins.nc
+mv new_subbasins.nc subbasins.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30  slaReferenceLevel.nc new_slaReferenceLevel.nc
+mv new_slaReferenceLevel.nc slaReferenceLevel.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30  --cnk_dmn z,4 resto.nc new_resto.nc
+mv new_resto.nc resto.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --cnk_dmn d01,30 --cnk_dmn d02,30  mask_itf.nc new_mask_itf.nc
+mv new_mask_itf.nc mask_itf.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30  --cnk_dmn z,4 --cnk_dmn t,1 eddy_viscosity_2D.nc new_eddy_viscosity_2D.nc
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30  --cnk_dmn z,4 --cnk_dmn t,1 eddy_viscosity_3D.nc new_eddy_viscosity_3D.nc
+mv new_eddy_viscosity_2D.nc eddy_viscosity_2D.nc
+mv new_eddy_viscosity_3D.nc eddy_viscosity_3D.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30  --cnk_dmn t,1 geothermal_heating.nc new_geothermal_heating.nc
+mv new_geothermal_heating.nc geothermal_heating.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30  --cnk_dmn time_counter,1 K1rowdrg.nc new_K1rowdrg.nc
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30  --cnk_dmn time_counter,1 M2rowdrg.nc new_M2rowdrg.nc
+mv new_K1rowdrg.nc K1rowdrg.nc
+mv new_M2rowdrg.nc M2rowdrg.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30  --cnk_dmn time_counter,1 calving.nc new_calving.nc
+mv new_calving.nc calving.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30  --cnk_dmn time_counter,1 chlorophyll.nc new_chlorophyll.nc
+mv new_chlorophyll.nc chlorophyll.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=3 --cnk_dmn x,30 --cnk_dmn y,30  --cnk_dmn time_counter,1 --cnk_dmn z,4 assim_background_increments.nc new_assim_background_increments.nc
+mv new_assim_background_increments.nc assim_background_increments.nc
+#
+ncks --4 --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn x,30 --cnk_dmn y,30 ahmcoef.nc new_ahmcoef.nc
+mv new_ahmcoef.nc ahmcoef.nc
+#
+cd ../
+########## ORCA2_OFFcmds ##########
+cd ORCA2_OFF_v4.2_RC_LITE
+ncks --no_abc --cnk_plc='xpl' --cnk_dmn t,1 --cnk_dmn x,60 --cnk_dmn y,50 --cnk_dmn z,4 ORCA_R2_zps_domcfg.nc new_ORCA_R2_zps_domcfg.nc
+mv new_ORCA_R2_zps_domcfg.nc ORCA_R2_zps_domcfg.nc
+#
+# can't shorten these since record 73 is needed to start
+ncks --no_abc  --cnk_plc='xpl' --ppc default=3 --cnk_dmn time_counter,1 --cnk_dmn x,60 --cnk_dmn y,50 --cnk_dmn deptht,4 dyna_grid_T.nc new_dyna_grid_T.nc
+#
+ncks --no_abc  --cnk_plc='xpl' --ppc default=3 --cnk_dmn time_counter,1 --cnk_dmn x,60 --cnk_dmn y,50 --cnk_dmn depthu,4 dyna_grid_U.nc new_dyna_grid_U.nc
+#
+ncks --no_abc  --cnk_plc='xpl' --ppc default=3 --cnk_dmn time_counter,1 --cnk_dmn x,60 --cnk_dmn y,50 --cnk_dmn depthv,4 dyna_grid_V.nc new_dyna_grid_V.nc
+#
+ncks --no_abc  --cnk_plc='xpl' --ppc default=3 --cnk_dmn time_counter,1 --cnk_dmn x,60 --cnk_dmn y,50 --cnk_dmn depthw,4 dyna_grid_W.nc new_dyna_grid_W.nc
+#
+mv new_dyna_grid_T.nc dyna_grid_T.nc
+mv new_dyna_grid_U.nc dyna_grid_U.nc
+mv new_dyna_grid_V.nc dyna_grid_V.nc
+mv new_dyna_grid_W.nc dyna_grid_W.nc
+#
+cd ../
+########## SAScmds ##########
+cd SAS_v4.2_RC_LITE
+ncks --no_abc --cnk_plc='xpl' --ppc default=3 --cnk_dmn time_counter,1 --cnk_dmn x,60 --cnk_dmn y,50 --cnk_dmn deptht,4 sas_grid_T.nc new_sas_grid_T.nc
+ncks --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn time_counter,1 --cnk_dmn x,60 --cnk_dmn y,50 --cnk_dmn depthu,4 sas_grid_U.nc new_sas_grid_U.nc
+ncks --no_abc --cnk_plc='xpl' --ppc default=4 --cnk_dmn time_counter,1 --cnk_dmn x,60 --cnk_dmn y,50 --cnk_dmn depthv,4 sas_grid_V.nc new_sas_grid_V.nc
+mv new_sas_grid_T.nc sas_grid_T.nc
+mv new_sas_grid_U.nc sas_grid_U.nc
+mv new_sas_grid_V.nc sas_grid_V.nc
+cd ../
+########## WEDcmds ##########
+cd WED025_v4.2_RC_LITE
+# u10 v10 t10 precip rsds q10 slp rlds snow
+# WED025 starts in middle of January; need 20 days from then = 35 days = 280 records @ 3hourly
+for v in u10 v10 precip rsds q10 rlds snow
+do
+ ncks -O -d time,0,279 --ppc default=4 --cnk_dmn longitude,64 --cnk_dmn latitude,64 ${v}_JRA_y2000.nc 20d_${v}_JRA_y2000.nc
+done
+for v in t10 slp
+do
+ ncks -O -d time,0,279 --ppc default=3 --cnk_dmn longitude,64 --cnk_dmn latitude,64 ${v}_JRA_y2000.nc 20d_${v}_JRA_y2000.nc
+done
+#
+for v in u10 v10 t10 precip rsds q10 slp rlds snow
+do
+ mv 20d_${v}_JRA_y2000.nc ${v}_JRA_y2000.nc
+done
+#
+ncks --ppc default=3 --cnk_dmn xbT,50 WED025_bdyT_tra_y1999.nc new_WED025_bdyT_tra_y1999.nc
+ncks --ppc default=3 --cnk_dmn xbT,50 WED025_bdyT_tra_y2000.nc new_WED025_bdyT_tra_y2000.nc
+ncks --ppc default=4 --cnk_dmn xbU,50 WED025_bdyU_u3d_y1999.nc new_WED025_bdyU_u3d_y1999.nc
+ncks --ppc default=4 --cnk_dmn xbU,50 WED025_bdyU_u3d_y2000.nc new_WED025_bdyU_u3d_y2000.nc
+ncks --ppc default=4 --cnk_dmn xbV,44 WED025_bdyV_u3d_y1999.nc new_WED025_bdyV_u3d_y1999.nc
+ncks --ppc default=4 --cnk_dmn xbV,44 WED025_bdyV_u3d_y2000.nc new_WED025_bdyV_u3d_y2000.nc
+mv new_WED025_bdyT_tra_y1999.nc WED025_bdyT_tra_y1999.nc
+mv new_WED025_bdyT_tra_y2000.nc WED025_bdyT_tra_y2000.nc
+mv new_WED025_bdyU_u3d_y1999.nc WED025_bdyU_u3d_y1999.nc
+mv new_WED025_bdyU_u3d_y2000.nc WED025_bdyU_u3d_y2000.nc
+mv new_WED025_bdyV_u3d_y1999.nc WED025_bdyV_u3d_y1999.nc
+mv new_WED025_bdyV_u3d_y2000.nc WED025_bdyV_u3d_y2000.nc
+ncks --cnk_dmn time_counter,1 WED025_bdyT_tra_y1999.nc new_WED025_bdyT_tra_y1999.nc
+ncks --cnk_dmn time_counter,1 WED025_bdyT_tra_y2000.nc new_WED025_bdyT_tra_y2000.nc
+ncks --cnk_dmn time_counter,1 WED025_bdyU_u3d_y1999.nc new_WED025_bdyU_u3d_y1999.nc
+ncks --cnk_dmn time_counter,1 WED025_bdyU_u3d_y2000.nc new_WED025_bdyU_u3d_y2000.nc
+ncks --cnk_dmn time_counter,1 WED025_bdyV_u3d_y1999.nc new_WED025_bdyV_u3d_y1999.nc
+ncks --cnk_dmn time_counter,1 WED025_bdyV_u3d_y2000.nc new_WED025_bdyV_u3d_y2000.nc
+mv new_WED025_bdyT_tra_y1999.nc WED025_bdyT_tra_y1999.nc
+mv new_WED025_bdyT_tra_y2000.nc WED025_bdyT_tra_y2000.nc
+mv new_WED025_bdyU_u3d_y1999.nc WED025_bdyU_u3d_y1999.nc
+mv new_WED025_bdyU_u3d_y2000.nc WED025_bdyU_u3d_y2000.nc
+mv new_WED025_bdyV_u3d_y1999.nc WED025_bdyV_u3d_y1999.nc
+mv new_WED025_bdyV_u3d_y2000.nc WED025_bdyV_u3d_y2000.nc
+#
+ncks --no_abc --cnk_dmn x,64 --cnk_dmn y,64 domain_cfg.nc new_domain_cfg.nc
+mv new_domain_cfg.nc domain_cfg.nc
+#
+ncks --no_abc --cnk_dmn lon,64 --cnk_dmn lat,64 weights_bilin_JRA.nc new_weights_bilin_JRA.nc
+ncks --no_abc --cnk_dmn lon,64 --cnk_dmn lat,64 weights_bicubic_JRA.nc new_weights_bicubic_JRA.nc
+mv new_weights_bilin_JRA.nc weights_bilin_JRA.nc
+mv new_weights_bicubic_JRA.nc weights_bicubic_JRA.nc
+#
+ncks --no_abc --cnk_dmn x,64 --cnk_dmn y,64 --cnk_dmn time_counter,1 WED025_icb_y1999.nc new_WED025_icb_y1999.nc
+ncks --no_abc --cnk_dmn x,64 --cnk_dmn y,64 --cnk_dmn time_counter,1 WED025_icb_y2000.nc new_WED025_icb_y2000.nc
+mv new_WED025_icb_y1999.nc WED025_icb_y1999.nc
+mv new_WED025_icb_y2000.nc WED025_icb_y2000.nc
+#
+ncks --no_abc --ppc default=4 --cnk_dmn x,64 --cnk_dmn y,64 --cnk_dmn time_counter,1 --cnk_dmn z,15 WED025_init_JRA_200001.nc new_WED025_init_JRA_200001.nc
+mv new_WED025_init_JRA_200001.nc WED025_init_JRA_200001.nc
+#
+ncks --no_abc --ppc default=4 --cnk_dmn x,64 --cnk_dmn y,64 --cnk_dmn time_counter,1 chlorophyll_WED025.nc new_chlorophyll_WED025.nc
+mv new_chlorophyll_WED025.nc chlorophyll_WED025.nc
+#
+ncks --no_abc --ppc default=4 --cnk_dmn x,64 --cnk_dmn y,64 --cnk_dmn time_counter,1 isfmlt_par.nc new_isfmlt_par.nc
+mv new_isfmlt_par.nc isfmlt_par.nc
+#
+ncks --no_abc --cnk_dmn xbt,50 --cnk_dmn xbu,50 --cnk_dmn xbv,44 coordinates_bdy_WED025.nc new_coordinates_bdy_WED025.nc
+mv new_coordinates_bdy_WED025.nc coordinates_bdy_WED025.nc
+#
+cd ../
+#
+}}}
 
 === Documentation updates