source: trunk/libIGCM

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author
(edit) @1455   6 years sdipsl
  • Changes due to unaccessibility of p86ipsl. Things moved to the igcmg shared space.
(edit) @1454   6 years sdipsl

Dont let the scheduler try to rerun our job when strange things happen inside TGCC
(edit) @1453   6 years mafoipsl

Small change in clean_latestPackperiod to set run.card (and not run.card.verbose).
(edit) @1452   6 years sdipsl
(edit) @1451   6 years mafoipsl

In AA_monitoring increase cpu time for curie to allow monitoring of simulations > 140 years.
(edit) @1450   6 years jgipsl

Correct error in SE_Checker : the date end was calculated wrong. It was always corresponding to the next coming period and therefor an error message was always done.

(edit) @1449   6 years sdipsl
  • syntax errors ...
(edit) @1448   6 years jgipsl

Change in headers at irene : temporary remove option -m and use a workaround given by the TGCC. This change is done to avoid problems with resubmitting from job when submitting the main job from workdir.

(edit) @1447   6 years sdipsl
  • Fix the Adhoc exception for CMIP6
(edit) @1446   6 years sdipsl
  • Adhoc exception for CMIP6 : exclude XIOS from the restart overrule mechanism.
(edit) @1445   6 years sdipsl
(edit) @1444   6 years sdipsl
  • only devcmip6 where using CMIP6 storage. dekcmip6 and alike were running/writing on regular FS. Fixed.
(edit) @1443   6 years sdipsl
  • r1442 was not sufficient to fine tune cfsites output.
(edit) @1442   6 years sdipsl
  • Modify cfSites output as per the CFMIP-3 protocol. For CFMIP-3 cfSites the sampling interval should be the integer multiple of the model time step that is nearest to 30 min and divides into 60 min with no remainder: e.g. 30 min for a 30, 15 or 10 min time step or 20 min for a 20 min time step.
(edit) @1441   6 years jgipsl

Correction for irene. Now save the text output of post-processing jobs.
(edit) @1440   6 years jgipsl

Added more possibilities at irene
(edit) @1439   6 years sdipsl
  • the slower create_ts (from 2D or 3D) will submit the monitoring.
(edit) @1438   6 years jgipsl

Add source of .env_atlas_irene for postprocessing.
(edit) @1437   6 years jgipsl

For Irene:

  • ins_job now ask for project id. gch0316 for the grand challenge is the default.
  • headers for more post-processing jobs
(edit) @1436   6 years sdipsl
  • cosmetics
(edit) @1435   6 years sdipsl
  • Need to fine tune dr2xml_LMDZ.xml before using it. Find below the current state of play of the required fine tuning.

Reading dr2xml_def_xml= dr2xml_LMDZ.xml
context {'id': 'LMDZ'}

field {'operation': 'average', 'field_ref': 'CMIP6_albisccp', 'id': 'CMIP6_albisccp_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_cfadDbze94', 'id': 'CMIP6_cfadDbze94_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_cfadDbze94', 'id': 'CMIP6_cfadDbze94_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_cfadLidarsr532', 'id': 'CMIP6_cfadLidarsr532_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_cfadLidarsr532', 'id': 'CMIP6_cfadLidarsr532_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_clcalipso2', 'id': 'CMIP6_clcalipso2_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_clcalipso', 'id': 'CMIP6_clcalipso_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_clcalipso', 'id': 'CMIP6_clcalipso_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_clcalipsoice', 'id': 'CMIP6_clcalipsoice_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_clcalipsoliq', 'id': 'CMIP6_clcalipsoliq_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'grid_ref': 'grid_glo_Scalp220', 'freq_offset': '0ts', 'detect_missing_value': 'true', 'freq_op': '3h', 'operation': 'instant', 'id': 'CMIP6_clhcalipso_Scalp220'}
field {'operation': 'average', 'field_ref': 'CMIP6_clhcalipso_Scalp220', 'id': 'CMIP6_clhcalipso_Scalp220_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_clhcalipso_Scalp220', 'id': 'CMIP6_clhcalipso_Scalp220_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_climodis', 'id': 'CMIP6_climodis_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_clisccp', 'id': 'CMIP6_clisccp_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_clisccp', 'id': 'CMIP6_clisccp_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'grid_ref': 'grid_glo_Scalp840', 'freq_offset': '0ts', 'detect_missing_value': 'true', 'freq_op': '3h', 'operation': 'instant', 'id': 'CMIP6_cllcalipso_Scalp840'}
field {'operation': 'average', 'field_ref': 'CMIP6_cllcalipso_Scalp840', 'id': 'CMIP6_cllcalipso_Scalp840_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_cllcalipso_Scalp840', 'id': 'CMIP6_cllcalipso_Scalp840_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'grid_ref': 'grid_glo_Scalp560', 'freq_offset': '0ts', 'detect_missing_value': 'true', 'freq_op': '3h', 'operation': 'instant', 'id': 'CMIP6_clmcalipso_Scalp560'}
field {'operation': 'average', 'field_ref': 'CMIP6_clmcalipso_Scalp560', 'id': 'CMIP6_clmcalipso_Scalp560_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_clmcalipso_Scalp560', 'id': 'CMIP6_clmcalipso_Scalp560_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_clmisr', 'id': 'CMIP6_clmisr_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_clmisr', 'id': 'CMIP6_clmisr_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_cltcalipso', 'id': 'CMIP6_cltcalipso_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_cltcalipso', 'id': 'CMIP6_cltcalipso_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_cltisccp', 'id': 'CMIP6_cltisccp_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_cltmodis', 'id': 'CMIP6_cltmodis_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_clwmodis', 'id': 'CMIP6_clwmodis_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_jpdftaureicemodis', 'id': 'CMIP6_jpdftaureicemodis_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_jpdftaureicemodis', 'id': 'CMIP6_jpdftaureicemodis_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_jpdftaureliqmodis', 'id': 'CMIP6_jpdftaureliqmodis_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_jpdftaureliqmodis', 'id': 'CMIP6_jpdftaureliqmodis_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_parasolRefl', 'id': 'CMIP6_parasolRefl_average', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'instant', 'field_ref': 'CMIP6_parasolRefl', 'id': 'CMIP6_parasolRefl_instant', 'freq_offset': '0ts', 'freq_op': '3h'}
field {'operation': 'average', 'field_ref': 'CMIP6_pctisccp', 'id': 'CMIP6_pctisccp_average', 'freq_offset': '0ts', 'freq_op': '3h'}

Writing dr2xml_def_xml= modified.dr2xml_LMDZ.xml
(dataRequest)sdipsl@ciclad-ng:~/DataRequest?.CMIP6/test.output/DR2XML_DUMMY_FULL.HEAVY> ~/libIGCM/libIGCM_post/xios_parser.py -vvv modifyDR2XML --file dr2xml_nemo.xml

Reading dr2xml_def_xml= dr2xml_nemo.xml
context {'id': 'nemo'}

field {'grid_ref': 'grid_T_2D_Scaltypesi', 'freq_offset': '0ts', 'detect_missing_value': 'true', 'freq_op': '2ts', 'operation': 'instant', 'id': 'CMIP6_siconc_Scaltypesi'}

Writing dr2xml_def_xml= modified.dr2xml_nemo.xml
(edit) @1434   6 years sdipsl
  • add a function to handle very specific exception that affect LIM3 and dr2xml generated files.
(edit) @1433   6 years jgipsl

Added headers for irene on some post-treatment jobs. Source ~p86ipsl/.env_irene to load all modules. For the moment no separation has been done between netfcdf and intel as done on curie but might be needed later.
(edit) @1432   6 years jgipsl

Added first version of sys_irene copied from sys_curie.
Tested as far without post-treatement only with SpaceName?=TEST. As far, only tested with LMDZOR and ORCHIDEE offline without post-processing, only at scratchdir.
c
ccc_mprun mode is default at irene.
(edit) @1431   6 years sdipsl
  • CMIP6 files go in CCCWORKDIR and alike.
(edit) @1430   6 years aclsce
  • Fixed small bug in the use of NOD parameter.
(edit) @1429   6 years jgipsl

Set extension of files to rebuild to _????.nc This is done to allow the case when a another file exists with the same name followed by an extension. For example sechiba_history.nc and sechiba_history_4dim.nc: When rebuilding sechiba_history.nc, previous command using _[0-9]*.nc also included the file sechiba_history_4dim which made errors.

Note this modification is not compatible with extension _00.nc, _01.nc, etc..
(edit) @1428   6 years mafoipsl

Add a test to check compiler version and IPSLCM6.1.
(edit) @1427   6 years mafoipsl

On curie, reintroduce the parameter -U in job's header.
Set -U medium as default. Use -U high for highest priority
and -U low for lowest priority.
(edit) @1426   6 years aclsce
  • Added the use of NOD parameter in config.card. This functionality is only available on Curie and for XIOS component (in order to assign XIOS servers on different nodes).

Example :
IOS= (xios_server.exe, xios.x, 4MPI, 2NOD)
means 4 XIOS servers use 2 computing nodes (i.e 2 XIOS servers per node).
(edit) @1425   6 years sdipsl
  • Do not edit pathname for element that have attribute mode=read. Translation : dont change path of input data...
(edit) @1424   6 years sdipsl
  • I know it is ugly. A better solution is on its way.
(edit) @1423   6 years jgipsl

Added -w to be allow variables with same base for example co2_ppm and co2_ppm_per.
(edit) @1422   6 years jgipsl

Corrected bug. fi was missing since changset [1420].
(edit) @1421   6 years sdipsl
  • change default behaviour for config_Post_ParserXIOS. FALSE by default. If field_def and file_def are not coherent libIGCM wont do anything by default to prevent this except printing messages.
(edit) @1420   6 years sdipsl
  • optimize the way we drive where dr2xml_${compname}.xml write files
(edit) @1419   6 years sdipsl

write where we can export on thredds or ciclad
(edit) @1418   6 years sdipsl
  • correction to the supervisor adress. Old server will be deprecated.
(edit) @1417   6 years sdipsl

6.0.14 as well must be compiled with intel 2017
(edit) @1416   7 years aclsce
  • Modified to run CMIP6 configurations : use of dr2xml_$comp.xml files.
(edit) @1415   7 years sdipsl

IPSLCM6.0.13 must be compiled with intel 2017
(edit) @1414   7 years mafoipsl

On ada for AA_monitoring, specify larger memory for _SEP _MAR ICE variables.
(edit) @1413   7 years sdipsl
  • being able to manage dr2xml_${compname}.xml files for IPSLCM6.0.13 and CMIP6
(edit) @1412   7 years sdipsl
  • syntax error
(edit) @1411   7 years sdipsl
  • Bypass cases where compiler version cant be identified. Usefull at IDRIS. Will need a fix shortly.
(edit) @1410   7 years sdipsl
  • #326 fix the issue when SPACENAME = TEST
  • use a safer ksh syntax for testing equality
(edit) @1409   7 years sdipsl
  • #337 and #338 source the appropriate .env_intel depending on compiler used. Dont use .atlas something anymore.
  • #337 and #338 on Curie only for the moment.
  • #336 load the appropriate nco on Ada
Note: See TracRevisionLog for help on using the revision log.