Changes between Version 9 and Version 10 of 2021WP/VLD-05_Coward_SETTE_inputs
- Timestamp:
- 2021-03-16T11:38:33+01:00 (3 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
2021WP/VLD-05_Coward_SETTE_inputs
v9 v10 23 23 Collection and rationalisation of SETTE inputs. The set of input files for the full suite of SETTE tests has evolved rapidly to keep pace with changes to the code (such as the removal of haloes from external files). The current set needs to be cleaned of unused data and chunked and compressed with setting consistent with exascale ambitions. A definitive set then needs to be hosted in a publically available location with a fixed DOI. A lighter version (for example, reduced time-levels in forcing data) may also be appropriate for future containerisation or cloud-deployment of testing services. 24 24 25 '''Stage 1''': Collect all input file sets for SETTE 4.2_RC (current trunk). Confirm successful SETTE results and store reference set of SETTE results. Remove redundant files and variables from contents. Make sure sensible chunking and compression choices have been made in all cases. Produce clean 'r4.2_RC_FULL' set. See details [#Stage1details here]26 27 '''Stage 2''': Reduce data volumes by selecting only sufficient forcing data for twice the period of each standard test. Run SETTE with reduced set and confirm unchanged results. Create recommended 'r4.2_RC' set. See details [#Stage2details here]28 29 '''Stage3''': Reduce data volumes further by limiting number of significant digits in all fields other than domain and coordinate variables. Confirm SETTE tests are still successful (results WILL be different). Create optional 'r4.2_RC_LITE' set. See details [#Stage3details here]30 31 '''Stage 4''': Find a hosting and distribution option 32 33 '''Stage 5''': Document and archive scripts so that the process can be repeated if(when) changes are made to the FULL set. 25 '''Stage 1''': Collect all input file sets for SETTE 4.2_RC (current trunk). Confirm successful SETTE results and store reference set of SETTE results. Remove redundant files and variables from contents. Make sure sensible chunking and compression choices have been made in all cases. Produce clean 'r4.2_RC_FULL' set. '''Done:''' See details [#Stage1details here] 26 27 '''Stage 2''': Reduce data volumes by selecting only sufficient forcing data for twice the period of each standard test. Run SETTE with reduced set and confirm unchanged results. Create recommended 'r4.2_RC' set. '''Done:''' See details [#Stage2details here] 28 29 '''Stage3''': Reduce data volumes further by limiting number of significant digits in all fields other than domain and coordinate variables. Confirm SETTE tests are still successful (results WILL be different). Create optional 'r4.2_RC_LITE' set. '''Done:''' See details [#Stage3details here] 30 31 '''Stage 4''': Find a hosting and distribution option. '''Done:''' the three sets of SETTE input fields described in this page can be downloaded from: [https://gws-access.jasmin.ac.uk/public/nemo/sette_inputs/ Sette inputs]. This site isn't suitable for a long-term doi reference but will remain active for the foreseeable future. Zenadoo copies will be made when tag releases of the trunk are made. Uploads by other members of the system team are not possible but I will update with any corrections or additions that others make available by other means (e.g. [https://wetransfer.com WeTransfer]) 32 33 '''Stage 5''': Document and archive scripts so that the process can be repeated if(when) changes are made to the FULL set. '''Done:''' See implementation details below. 34 34 35 35 ''...''