Changes between Version 8 and Version 9 of Doc/Running


Ignore:
Timestamp:
10/23/14 17:32:15 (9 years ago)
Author:
mafoipsl
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Doc/Running

    v8 v9  
    2424[[NoteBox(warn, Before starting a simulation it is very important to double check that it was properly setup. We strongly encourage you to perform a short test before starting a long simulation., 600px)]] 
    2525 
    26 The job you just submitted is the first element of a chain of jobs, depending on the kind of jobs you submitted. These jobs include the production job itself and post processing jobs like: rebuild, pack, create_ts, create_se, monitoring and atlas which are started at given frequencies. 
     26The job you just submitted is the first element of a chain of jobs, depending on the kind of jobs you submitted. These jobs include the production job itself and post processing jobs like: ''rebuild'', ''pack'', ''create_ts'', ''create_se'', ''monitoring'' and ''atlas'' which are started at given frequencies. 
    2727 
    2828[[NoteBox(note, Post processing jobs will be automatically started at the end of the simulation., 600px)]] 
     
    192192---- 
    193193# Simplified diagram of the jobs executed by the IPSL models and tools # 
    194 The job automatically runs post processing jobs during the simulation and at different frequencies. There are two kinds of post processing: required post processing such as rebuild and pack, and optional post processing such as !TimeSeries and seasonal means.  
     194The job automatically runs post processing jobs during the simulation and at different frequencies. There are two kinds of post processing: required post processing such as ''rebuild'' and ''pack'', and optional post processing such as ''!TimeSeries' and ''!SEasonal means''.  
    195195[[BR]] 
    196196Here is a diagram describing the job sequence.  
     
    227227 
    228228## Rebuild ##  
    229  * rebuild is a tool which allows you to combine several files created by a parallel program (sub domains) to a single file.  
    230  * rebuild is available with IOIPSL. See http://forge.ipsl.jussieu.fr/igcmg/browser/IOIPSL/trunk/tools (it can therefore be distributed via modipsl)  
    231  * rebuild is installed on the IDRIS and TGCC front-end machines. It is automatically called at the !RebuildFrequency frequency and it is usually the very first step of post processing. 
    232  * You can not skip rebuilds. Specifying NONE for !RebuildFrequency will start the file combining on the computing machine instead of doing it on the post processing machine. This is strongly discouraged. 
     229 * `rebuild` is a tool which allows you to combine several files created by a parallel program (sub domains) to a single file.  
     230 * `rebuild` is available with IOIPSL. See http://forge.ipsl.jussieu.fr/igcmg/browser/IOIPSL/trunk/tools (it can therefore be distributed via modipsl)  
     231 * `rebuild` is installed on the IDRIS and TGCC front-end machines. It is automatically called at the !RebuildFrequency frequency and it is usually the very first step of post processing. 
     232 * You can not skip ''rebuilds''. Specifying NONE for !RebuildFrequency will start the file combining on the computing machine instead of doing it on the post processing machine. This is strongly discouraged. 
    233233 * !RebuildFrequency=1Y indicates the frequency of running REBUILD. The files to be combined by Rebuild are stored on a buffer space $SCRATCHDIR/IGCM_OUT/../!JobName/REBUILD/ at TGCC and $WORKDIR/IGCM_OUT/.../!JobName/REBUILD at IDRIS (in old libIGCM version, before libigcm_v2.0, it was $SCRATCHDIR/REBUILD/ at TGCC and $WORKDIR/REBUILD at IDRIS)  Note: if !JobType=DEV the parameter is forced to have the !PeriodLength value. 
    234  * !RebuildFromArchive=NONE is the option to be used on all machines. The REBUILD job first looks for the files to be assembled on the buffer space. Then it assembles them (rebuild), applies requested Patchs and stores them in the usual COMP/Output/MO or COMP/Output/DA directories for monthly or daily files of the COMP component (OCE, ICE, ATM, SRF, ...). Note: REBUILD does the ordering of other post processing jobs ran by the create_ts.job and create_se.job jobs. 
    235 [[NoteBox(warn,Note: if !JobType=DEV\, the !RebuildFrequency parameter is forced to be the !PeriodLength value and one rebuild job per simulated period is started. Discouraged for long simulations., 600px)]] 
     234 * !RebuildFromArchive=NONE is the option to be used on all machines. The REBUILD job first looks for the files to be assembled on the buffer space. Then it assembles them (''rebuild''), applies requested Patchs and stores them in the usual COMP/Output/MO or COMP/Output/DA directories for monthly or daily files of the COMP component (OCE, ICE, ATM, SRF, ...). Note: REBUILD does the ordering of other post processing jobs ran by the create_ts.job and create_se.job jobs. 
     235[[NoteBox(warn,Note: if !JobType=DEV\, the !RebuildFrequency parameter is forced to be the !PeriodLength value and one ''rebuild job'' per simulated period is started. Discouraged for long simulations., 600px)]] 
    236236  
    237237## Concatenation of "PACK" outputs ## 
     
    330330 * In the '''Step 1''' tab, specify URLs which give access to the MONITORING directory  
    331331    * http://dods.extra.cea.fr/cgi-bin/nph-dods/work/YourLogin/TagName/SpaceName/ExperimentName for dods under cccwork at TGCC 
    332     * http://dods.extra.cea.fr/cgi-bin/nph-dods/data/YourLogin/TagName/SpaceName/ExperimentName for dods under dmnfs at TGCC (read-only since April 2012) 
    333     * http://dods.idris.fr/cgi-bin/nph-dods/YourLogin/TagName/SpaceName/ExperimentName for dods at IDRIS  
     332    * http://dods.idris.fr/cgi-bin/nph-dods/YourLogin/TagName/SpaceName/ExperimentName for dods at IDRIS (Ergon files) 
     333    * http://dods.idris.fr/cgi-bin/nph-dods/gaya/YourLogin/TagName/SpaceName/ExperimentName for dods at IDRIS (Gaya files, until december 2014) 
     334    * http://esgf.extra.cea.fr/thredds/dodsC/DODSWORK/YourLogin/TagName/SpaceName/ExperimentName for the new server at TGCC (october 2014) 
    334335 
    335336## Seasonal means ## 
     
    361362 
    362363[[NoteBox(note, The scripts to transfer data on dods are run at the end of the monitoring job or at the end of each atlas job., 600px)]] 
    363