source: trunk/libIGCM/AA_monitoring @ 640

Last change on this file since 640 was 640, checked in by mafoipsl, 12 years ago

Add norerun option on SX front-end. Transfer specific files ie config.card COMP ... with IGCM_sys_Get_Master and modify IGCM_sys_Get_Master to allow file transfer. tested on ulam and SX front-end.
  • Property licence set to
    The following licence information concerns ONLY the libIGCM tools
    ==================================================================

    Copyright © Centre National de la Recherche Scientifique CNRS
    Commissariat à l'Énergie Atomique CEA

    libIGCM : Library for Portable Models Computation of IGCM Group.

    IGCM Group is the french IPSL Global Climate Model Group.

    This library is a set of shell scripts and functions whose purpose is
    the management of the initialization, the launch, the transfer of
    output files, the post-processing and the monitoring of datas produce
    by any numerical program on any plateforme.

    This software is governed by the CeCILL license under French law and
    abiding by the rules of distribution of free software. You can use,
    modify and/ or redistribute the software under the terms of the CeCILL
    license as circulated by CEA, CNRS and INRIA at the following URL
    "http://www.cecill.info".

    As a counterpart to the access to the source code and rights to copy,
    modify and redistribute granted by the license, users are provided only
    with a limited warranty and the software's author, the holder of the
    economic rights, and the successive licensors have only limited
    liability.

    In this respect, the user's attention is drawn to the risks associated
    with loading, using, modifying and/or developing or reproducing the
    software by the user in light of its specific status of free software,
    that may mean that it is complicated to manipulate, and that also
    therefore means that it is reserved for developers and experienced
    professionals having in-depth computer knowledge. Users are therefore
    encouraged to load and test the software's suitability as regards their
    requirements in conditions enabling the security of their systems and/or
    data to be ensured and, more generally, to use and operate it in the
    same conditions as regards security.

    The fact that you are presently reading this means that you have had
    knowledge of the CeCILL license and that you accept its terms.
  • Property svn:keywords set to Revision Author Date
File size: 13.4 KB
Line 
1#-Q- cesium #!/bin/ksh
2#-Q- cesium ######################
3#-Q- cesium ## CESIUM   CEA ##
4#-Q- cesium ######################
5#-Q- cesium #MSUB -r MONITORING     # Nom du job               
6#-Q- cesium #MSUB -N 1              # Reservation du noeud
7#-Q- cesium #MSUB -n 1              # Reservation du processus
8#-Q- cesium #MSUB -T 86400          # Limite de temps elapsed du job
9#-Q- cesium #MSUB -E "-j o"
10#-Q- cesium #MSUB -E "-S /bin/ksh"
11#-Q- curie ######################
12#-Q- curie ## CURIE   TGCC/CEA ##
13#-Q- curie ######################
14#-Q- curie #MSUB -r MONITORING     # Nom du job               
15#-Q- curie #MSUB -eo
16#-Q- curie #MSUB -n 1              # Reservation du processus
17#-Q- curie #MSUB -T 86400          # Limite de temps elapsed du job
18#-Q- platine #!/usr/bin/ksh
19#-Q- platine ##################
20#-Q- platine ## PLATINE   CEA ##
21#-Q- platine ##################
22#-Q- platine #BSUB -J MONITORING             # Nom du job
23#-Q- platine #BSUB -N                        # message a la fin du job
24#-Q- platine #BSUB -n 1                      # reservation des processeurs pour le job
25#-Q- platine #BSUB -W 1:00                   # Limite temps
26#-Q- platine #BSUB -q post              # Passage en queue post
27#-Q- platine #BSUB -L /bin/ksh
28#-Q- sx8brodie #!/bin/ksh
29#-Q- sx8brodie #######################
30#-Q- sx8brodie ## SX8BRODIE   IDRIS ##
31#-Q- sx8brodie #######################
32#-Q- sx8brodie # Temps Elapsed max. d'une requete hh:mm:ss
33#-Q- sx8brodie # @ wall_clock_limit = 1:00:00
34#-Q- sx8brodie # Nom du travail LoadLeveler
35#-Q- sx8brodie # @ job_name   = MONITORING
36#-Q- sx8brodie # Fichier de sortie standard du travail       
37#-Q- sx8brodie # @ output     = $(job_name).$(jobid)
38#-Q- sx8brodie # Fichier de sortie d'erreur du travail
39#-Q- sx8brodie # @ error      =  $(job_name).$(jobid)
40#-Q- sx8brodie # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
41#-Q- sx8brodie # @ notification = error
42#-Q- sx8brodie # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ;  $libIGCM_SX ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $MASTER
43#-Q- sx8brodie # @ queue
44#-Q- aix6 #!/bin/ksh
45#-Q- aix6 #######################
46#-Q- aix6 ##   VARGAS   IDRIS  ##
47#-Q- aix6 #######################
48#-Q- aix6 # Temps Elapsed max. d'une requete hh:mm:ss
49#-Q- aix6 # @ wall_clock_limit = 1:00:00
50#-Q- aix6 # Nom du travail LoadLeveler
51#-Q- aix6 # @ job_name   = MONITORING
52#-Q- aix6 # Fichier de sortie standard du travail       
53#-Q- aix6 # @ output     = $(job_name).$(jobid)
54#-Q- aix6 # Fichier de sortie d'erreur du travail
55#-Q- aix6 # @ error      =  $(job_name).$(jobid)
56#-Q- aix6 # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
57#-Q- aix6 # @ notification = error
58#-Q- aix6 # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $libIGCM_SX ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $MASTER
59#-Q- aix6 # @ queue
60#-Q- ulam #!/bin/ksh
61#-Q- ulam #######################
62#-Q- ulam ##   ULAM   IDRIS  ##
63#-Q- ulam #######################
64#-Q- ulam # Temps Elapsed max. d'une requete hh:mm:ss
65#-Q- ulam # @ wall_clock_limit = 1:00:00
66#-Q- ulam # Nom du travail LoadLeveler
67#-Q- ulam # @ job_name   = MONITORING
68#-Q- ulam # Fichier de sortie standard du travail       
69#-Q- ulam # @ output     = $(job_name).$(jobid)
70#-Q- ulam # Fichier de sortie d'erreur du travail
71#-Q- ulam # @ error      =  $(job_name).$(jobid)
72#-Q- ulam # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
73#-Q- ulam # @ notification = error
74#-Q- ulam # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $libIGCM_SX ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $MASTER
75#-Q- ulam # @ queue
76#-Q- sx8mercure #!/bin/ksh
77#-Q- sx8mercure ######################
78#-Q- sx8mercure ## SX8MERCURE   CEA ##
79#-Q- sx8mercure ######################
80#-Q- sx8mercure #PBS -N  MONITORING          # Nom du job
81#-Q- sx8mercure #PBS -j o                    # regroupement des stdout et stderr
82#-Q- sx8mercure #PBS -S /usr/bin/ksh         # shell de soumission
83#-Q- sx8mercure #PBS -l memsz_job=1gb        # Limite memoire a 1 Go
84#-Q- sx8mercure #PBS -l cputim_job=1:00:00   # Limite temps a 2 heures
85#-Q- sx8mercure #PBS -q scalaire
86#-Q- sx8mercure #PBS -r n
87#-Q- sx9mercure #!/bin/ksh
88#-Q- sx9mercure ######################
89#-Q- sx9mercure ## SX9MERCURE  CCRT ##
90#-Q- sx9mercure ######################
91#-Q- sx9mercure #PBS -N  MONITORING          # Nom du job
92#-Q- sx9mercure #PBS -j o                    # regroupement des stdout et stderr
93#-Q- sx9mercure #PBS -S /usr/bin/ksh         # shell de soumission
94#-Q- sx9mercure #PBS -l memsz_job=1gb        # Limite memoire a 1 Go
95#-Q- sx9mercure #PBS -l elapstim_req=1:00:00   # Limite temps a 2 heures
96#-Q- sx9mercure #PBS -q scalaire
97#-Q- sx9mercure #PBS -r n
98#-Q- titane #!/bin/ksh
99#-Q- titane ######################
100#-Q- titane ## TITANE   CEA ##
101#-Q- titane ######################
102#-Q- titane #MSUB -r MONITORING     # Nom du job               
103#-Q- titane #MSUB -eo
104#-Q- titane #MSUB -n 1              # Reservation du processus
105#-Q- titane #MSUB -T 86400          # Limite de temps elapsed du job
106#-Q- titane #MSUB -q mono
107#-Q- lxiv8 ######################
108#-Q- lxiv8 ## OBELIX      LSCE ##
109#-Q- lxiv8 ######################
110#-Q- lxiv8 #PBS -N MONITORING
111#-Q- lxiv8 #PBS -m a
112#-Q- lxiv8 #PBS -j oe
113#-Q- lxiv8 #PBS -q medium
114#-Q- lxiv8 #PBS -o MONITORING.$$
115#-Q- lxiv8 #PBS -S /bin/ksh
116#-Q- default #!/bin/ksh
117#-Q- default ##################
118#-Q- default ## DEFAULT HOST ##
119#-Q- default ##################
120
121#**************************************************************
122# Author: Sebastien Denvil
123# Contact: Sebastien.Denvil__at__ipsl.jussieu.fr
124# $Revision::                                          $ Revision of last commit
125# $Author::                                            $ Author of last commit
126# $Date::                                              $ Date of last commit
127# IPSL (2006)
128#  This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
129#
130#**************************************************************
131
132#set -eu
133#set -vx
134
135date
136
137#-Q- sx8brodie export OMP_NUM_THREADS=1
138#-Q- aix6 export OMP_NUM_THREADS=1
139#-Q- ulam export OMP_NUM_THREADS=1
140
141########################################################################
142
143#D- Flag to determine if this job in a standalone mode
144#D- Default : value from AA_job if any
145StandAlone=${StandAlone:=true}
146
147#D- Path to libIGCM
148#D- Default : value from AA_job if any
149# WARNING For StandAlone use : To run this script on some machine (ulam and cesium)
150# WARNING you must check MirrorlibIGCM variable in sys library.
151# WARNING If this variable is true, you must use libIGCM_POST path instead
152# WARNING of your running libIGCM directory.
153libIGCM=${libIGCM:=::modipsl::/libIGCM}
154
155#D- Increased verbosity (1, 2, 3)
156#D- Default : value from AA_job if any
157Verbosity=${Verbosity:=3}
158
159#D- Low level debug : to bypass lib test checks and stack construction
160#D- Default : value from AA_job if any
161DEBUG_debug=${DEBUG_debug:=false}
162
163#D- TEMPORARY Flag to determine atmospheric resolution
164#D- Default : value from atmospheric driver if any
165RESOL_ATM=${RESOL_ATM:=ALL}
166
167#D- Flag to determine surface resolution
168#D- Default : value from surface driver if any
169RESOL_SRF=${RESOL_SRF:=ALL}
170
171#D- Flag to determine surface resolution
172#D- Default : value from surface driver if any
173RESOL_SBG=${RESOL_SBG:=ALL}
174
175#D- TEMPORARY Flag to determine ocean resolution
176#D- Default : value from ocean driver if any
177RESOL_OCE=${RESOL_OCE:=ORCA2}
178
179#D- TEMPORARY Flag to determine ice resolution
180#D- Default : value from ice driver if any
181RESOL_ICE=${RESOL_ICE:=ORCA2}
182
183#D- TEMPORARY Flag to determine marine biogeochemistry resolution
184#D- Default : value from ice driver if any
185RESOL_MBG=${RESOL_MBG:=ORCA2}
186
187######################################################################
188
189. ${libIGCM}/libIGCM_debug/libIGCM_debug.ksh
190      ( ${DEBUG_debug} ) && IGCM_debug_Check
191. ${libIGCM}/libIGCM_card/libIGCM_card.ksh
192     ( ${DEBUG_debug} ) && IGCM_card_Check
193. ${libIGCM}/libIGCM_date/libIGCM_date.ksh
194     ( ${DEBUG_debug} ) && IGCM_date_Check
195#-------
196. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh
197
198######################################################################
199
200#set -vx
201
202#===========================================
203RUN_DIR=${RUN_DIR_PATH}
204IGCM_sys_MkdirWork ${RUN_DIR}
205IGCM_sys_Cd ${RUN_DIR}
206
207# ------------------------------------------------------------------
208# Test if all was right before proceeding further
209# ------------------------------------------------------------------
210IGCM_debug_Verif_Exit_Post
211
212if [ ${StandAlone} = true ] ; then
213    CARD_DIR=${SUBMIT_DIR}
214else
215    CARD_DIR=${RUN_DIR}/$( basename ${SUBMIT_DIR} )
216    IGCM_sys_Get_Master ${SUBMIT_DIR}/config.card ${RUN_DIR_PATH}
217    IGCM_sys_Get_Master ${SUBMIT_DIR}/run.card    ${RUN_DIR_PATH}
218    IGCM_sys_Get_Master ${SUBMIT_DIR}/COMP        ${RUN_DIR_PATH}
219    IGCM_sys_Get_Master ${SUBMIT_DIR}/POST        ${RUN_DIR_PATH}
220fi
221
222#
223# First of all
224#
225IGCM_card_DefineArrayFromSection       ${CARD_DIR}/config.card UserChoices
226typeset option
227for option in ${config_UserChoices[*]} ; do
228    IGCM_card_DefineVariableFromOption ${CARD_DIR}/config.card UserChoices ${option}
229done
230IGCM_card_DefineArrayFromSection       ${CARD_DIR}/config.card ListOfComponents
231
232#==================================
233#R_SAVE : Job output directory
234#R_BUFR : Job output buffered directory
235if ( [ ! X${config_UserChoices_SpaceName} = X ] && [ ! X${config_UserChoices_ExperimentName} = X ] ) ; then
236    FreeName=$( echo ${config_UserChoices_JobName} | sed 's/.*_//' )
237    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
238    R_FIGR=${R_FIG}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
239    R_BUFR=${R_BUF}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
240    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
241else
242    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
243    R_FIGR=${R_FIG}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
244    R_BUFR=${R_BUF}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
245    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_JobName}
246fi
247
248IGCM_sys_MkdirArchive ${R_FIGR}
249#
250IGCM_sys_TestDirArchive ${R_FIGR}/MONITORING
251if [ $? = 0 ] ; then
252    IGCM_debug_Print 1 "Get MONITORING directory from archive"
253    IGCM_sys_Get_Dir ${R_FIGR}/MONITORING ${RUN_DIR}
254else
255    IGCM_debug_Print 1 "MONITORING first pass. Nothing has been done before"
256fi
257# --------------------------------------------
258# Insert your commands between III...III lines
259# and precise produced directories to save
260# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
261
262for comp in ${config_ListOfComponents[*]} ; do
263    IGCM_debug_Print 1 "################## Component: ${comp} ######################"
264    liste_file_monitoring=""
265    IGCM_card_DefineArrayFromOption ${CARD_DIR}/config.card ListOfComponents ${comp}
266    eval compname=\${config_ListOfComponents_${comp}[0]}                > /dev/null 2>&1
267
268    PATH_monitoring_file=""
269    eval monitoring_file=monitoring01_${compname}_\${RESOL_${comp}}.cfg > /dev/null 2>&1
270    if [[ -d ${CARD_DIR}/POST && -f ${CARD_DIR}/POST/monitoring01_${compname}.cfg ]] ; then
271        PATH_monitoring_file=${CARD_DIR}/POST/monitoring01_${compname}.cfg
272    elif [ -f ${FER_ATLAS}/${monitoring_file} ] ; then
273        PATH_monitoring_file=${FER_ATLAS}/${monitoring_file}
274    else
275        IGCM_debug_Print 1 "No monitoring file found for this component. Was expecting ${monitoring_file}"
276        IGCM_debug_Print 1 "Step to next component"
277        continue
278    fi
279    #
280    if [ X${PATH_monitoring_file} != X"" ] ; then
281        IGCM_debug_Print 1 "Monitoring file used : ${PATH_monitoring_file}"
282        IGCM_debug_Print 1 "Determine which files we need."
283        . monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO
284        liste_file_monitoring=$( . monitoring01 -q -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO )
285    fi
286    #
287    if [ ! "X${liste_file_monitoring}" = X ] ; then
288        IGCM_sys_Get /l liste_file_monitoring ${RUN_DIR}
289        IGCM_debug_Print 1 "monitoring01 -c ${CARD_DIR} -p ${comp} --time -t \"${config_UserChoices_JobName} monitoring\" -o ${RUN_DIR}/MONITORING ${PATH_monitoring_file} ."
290        IGCM_debug_Print 1 "monitoring01 starts ................................................."
291        monitoring01 -c ${CARD_DIR} -p ${comp} --time -t "${config_UserChoices_JobName} monitoring" -o ${RUN_DIR}/MONITORING ${PATH_monitoring_file} .
292    else
293        IGCM_debug_Print 1 "No time series detected by this command :"
294        IGCM_debug_Print 1 "monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO"
295        . monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO
296    fi
297    #
298done
299
300# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
301
302# Save files
303IGCM_sys_Put_Dir MONITORING ${R_FIGR}
304
305# Dods copy
306IGCM_sys_Put_Dods MONITORING
307
308# Clean RUN_DIR_PATH (necessary for cesium and titane only)
309IGCM_sys_RmRunDir -Rf ${RUN_DIR_PATH}
Note: See TracBrowser for help on using the repository browser.