Changes between Version 8 and Version 9 of Doc/Running
- Timestamp:
- 10/23/14 17:32:15 (9 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Doc/Running
v8 v9 24 24 [[NoteBox(warn, Before starting a simulation it is very important to double check that it was properly setup. We strongly encourage you to perform a short test before starting a long simulation., 600px)]] 25 25 26 The job you just submitted is the first element of a chain of jobs, depending on the kind of jobs you submitted. These jobs include the production job itself and post processing jobs like: rebuild, pack, create_ts, create_se, monitoring and atlaswhich are started at given frequencies.26 The job you just submitted is the first element of a chain of jobs, depending on the kind of jobs you submitted. These jobs include the production job itself and post processing jobs like: ''rebuild'', ''pack'', ''create_ts'', ''create_se'', ''monitoring'' and ''atlas'' which are started at given frequencies. 27 27 28 28 [[NoteBox(note, Post processing jobs will be automatically started at the end of the simulation., 600px)]] … … 192 192 ---- 193 193 # Simplified diagram of the jobs executed by the IPSL models and tools # 194 The job automatically runs post processing jobs during the simulation and at different frequencies. There are two kinds of post processing: required post processing such as rebuild and pack, and optional post processing such as !TimeSeries and seasonal means.194 The job automatically runs post processing jobs during the simulation and at different frequencies. There are two kinds of post processing: required post processing such as ''rebuild'' and ''pack'', and optional post processing such as ''!TimeSeries' and ''!SEasonal means''. 195 195 [[BR]] 196 196 Here is a diagram describing the job sequence. … … 227 227 228 228 ## Rebuild ## 229 * rebuildis a tool which allows you to combine several files created by a parallel program (sub domains) to a single file.230 * rebuildis available with IOIPSL. See http://forge.ipsl.jussieu.fr/igcmg/browser/IOIPSL/trunk/tools (it can therefore be distributed via modipsl)231 * rebuildis installed on the IDRIS and TGCC front-end machines. It is automatically called at the !RebuildFrequency frequency and it is usually the very first step of post processing.232 * You can not skip rebuilds. Specifying NONE for !RebuildFrequency will start the file combining on the computing machine instead of doing it on the post processing machine. This is strongly discouraged.229 * `rebuild` is a tool which allows you to combine several files created by a parallel program (sub domains) to a single file. 230 * `rebuild` is available with IOIPSL. See http://forge.ipsl.jussieu.fr/igcmg/browser/IOIPSL/trunk/tools (it can therefore be distributed via modipsl) 231 * `rebuild` is installed on the IDRIS and TGCC front-end machines. It is automatically called at the !RebuildFrequency frequency and it is usually the very first step of post processing. 232 * You can not skip ''rebuilds''. Specifying NONE for !RebuildFrequency will start the file combining on the computing machine instead of doing it on the post processing machine. This is strongly discouraged. 233 233 * !RebuildFrequency=1Y indicates the frequency of running REBUILD. The files to be combined by Rebuild are stored on a buffer space $SCRATCHDIR/IGCM_OUT/../!JobName/REBUILD/ at TGCC and $WORKDIR/IGCM_OUT/.../!JobName/REBUILD at IDRIS (in old libIGCM version, before libigcm_v2.0, it was $SCRATCHDIR/REBUILD/ at TGCC and $WORKDIR/REBUILD at IDRIS) Note: if !JobType=DEV the parameter is forced to have the !PeriodLength value. 234 * !RebuildFromArchive=NONE is the option to be used on all machines. The REBUILD job first looks for the files to be assembled on the buffer space. Then it assembles them ( rebuild), applies requested Patchs and stores them in the usual COMP/Output/MO or COMP/Output/DA directories for monthly or daily files of the COMP component (OCE, ICE, ATM, SRF, ...). Note: REBUILD does the ordering of other post processing jobs ran by the create_ts.job and create_se.job jobs.235 [[NoteBox(warn,Note: if !JobType=DEV\, the !RebuildFrequency parameter is forced to be the !PeriodLength value and one rebuild jobper simulated period is started. Discouraged for long simulations., 600px)]]234 * !RebuildFromArchive=NONE is the option to be used on all machines. The REBUILD job first looks for the files to be assembled on the buffer space. Then it assembles them (''rebuild''), applies requested Patchs and stores them in the usual COMP/Output/MO or COMP/Output/DA directories for monthly or daily files of the COMP component (OCE, ICE, ATM, SRF, ...). Note: REBUILD does the ordering of other post processing jobs ran by the create_ts.job and create_se.job jobs. 235 [[NoteBox(warn,Note: if !JobType=DEV\, the !RebuildFrequency parameter is forced to be the !PeriodLength value and one ''rebuild job'' per simulated period is started. Discouraged for long simulations., 600px)]] 236 236 237 237 ## Concatenation of "PACK" outputs ## … … 330 330 * In the '''Step 1''' tab, specify URLs which give access to the MONITORING directory 331 331 * http://dods.extra.cea.fr/cgi-bin/nph-dods/work/YourLogin/TagName/SpaceName/ExperimentName for dods under cccwork at TGCC 332 * http://dods.extra.cea.fr/cgi-bin/nph-dods/data/YourLogin/TagName/SpaceName/ExperimentName for dods under dmnfs at TGCC (read-only since April 2012) 333 * http://dods.idris.fr/cgi-bin/nph-dods/YourLogin/TagName/SpaceName/ExperimentName for dods at IDRIS 332 * http://dods.idris.fr/cgi-bin/nph-dods/YourLogin/TagName/SpaceName/ExperimentName for dods at IDRIS (Ergon files) 333 * http://dods.idris.fr/cgi-bin/nph-dods/gaya/YourLogin/TagName/SpaceName/ExperimentName for dods at IDRIS (Gaya files, until december 2014) 334 * http://esgf.extra.cea.fr/thredds/dodsC/DODSWORK/YourLogin/TagName/SpaceName/ExperimentName for the new server at TGCC (october 2014) 334 335 335 336 ## Seasonal means ## … … 361 362 362 363 [[NoteBox(note, The scripts to transfer data on dods are run at the end of the monitoring job or at the end of each atlas job., 600px)]] 363