source: branches/libIGCM_MPI_OpenMP/AA_monitoring @ 570

Last change on this file since 570 was 563, checked in by mafoipsl, 12 years ago

curie : first try for curie machine.
  • Property licence set to
    The following licence information concerns ONLY the libIGCM tools
    ==================================================================

    Copyright © Centre National de la Recherche Scientifique CNRS
    Commissariat à l'Énergie Atomique CEA

    libIGCM : Library for Portable Models Computation of IGCM Group.

    IGCM Group is the french IPSL Global Climate Model Group.

    This library is a set of shell scripts and functions whose purpose is
    the management of the initialization, the launch, the transfer of
    output files, the post-processing and the monitoring of datas produce
    by any numerical program on any plateforme.

    This software is governed by the CeCILL license under French law and
    abiding by the rules of distribution of free software. You can use,
    modify and/ or redistribute the software under the terms of the CeCILL
    license as circulated by CEA, CNRS and INRIA at the following URL
    "http://www.cecill.info".

    As a counterpart to the access to the source code and rights to copy,
    modify and redistribute granted by the license, users are provided only
    with a limited warranty and the software's author, the holder of the
    economic rights, and the successive licensors have only limited
    liability.

    In this respect, the user's attention is drawn to the risks associated
    with loading, using, modifying and/or developing or reproducing the
    software by the user in light of its specific status of free software,
    that may mean that it is complicated to manipulate, and that also
    therefore means that it is reserved for developers and experienced
    professionals having in-depth computer knowledge. Users are therefore
    encouraged to load and test the software's suitability as regards their
    requirements in conditions enabling the security of their systems and/or
    data to be ensured and, more generally, to use and operate it in the
    same conditions as regards security.

    The fact that you are presently reading this means that you have had
    knowledge of the CeCILL license and that you accept its terms.
  • Property svn:keywords set to Revision Author Date
File size: 12.8 KB
Line 
1#-Q- cesium #!/bin/ksh
2#-Q- cesium ######################
3#-Q- cesium ## CESIUM   CEA ##
4#-Q- cesium ######################
5#-Q- cesium #MSUB -r MONITORING     # Nom du job               
6#-Q- cesium #MSUB -N 1              # Reservation du noeud
7#-Q- cesium #MSUB -n 1              # Reservation du processus
8#-Q- cesium #MSUB -T 86400          # Limite de temps elapsed du job
9#-Q- cesium #MSUB -E "-j o"
10#-Q- cesium #MSUB -E "-S /bin/ksh"
11#-Q- curie ######################
12#-Q- curie ## CURIE   TGCC/CEA ##
13#-Q- curie ######################
14#-Q- curie #MSUB -r TS             # Nom du job               
15#-Q- curie #MSUB -eo
16#-Q- curie #MSUB -n 1              # Reservation du processus
17#-Q- curie #MSUB -T 86400          # Limite de temps elapsed du job
18#-Q- platine #!/usr/bin/ksh
19#-Q- platine ##################
20#-Q- platine ## PLATINE   CEA ##
21#-Q- platine ##################
22#-Q- platine #BSUB -J MONITORING             # Nom du job
23#-Q- platine #BSUB -N                        # message a la fin du job
24#-Q- platine #BSUB -n 1                      # reservation des processeurs pour le job
25#-Q- platine #BSUB -W 1:00                   # Limite temps
26#-Q- platine #BSUB -q post              # Passage en queue post
27#-Q- platine #BSUB -L /bin/ksh
28#-Q- sx8brodie #!/bin/ksh
29#-Q- sx8brodie #######################
30#-Q- sx8brodie ## SX8BRODIE   IDRIS ##
31#-Q- sx8brodie #######################
32#-Q- sx8brodie # Temps Elapsed max. d'une requete hh:mm:ss
33#-Q- sx8brodie # @ wall_clock_limit = 1:00:00
34#-Q- sx8brodie # Nom du travail LoadLeveler
35#-Q- sx8brodie # @ job_name   = MONITORING
36#-Q- sx8brodie # Fichier de sortie standard du travail       
37#-Q- sx8brodie # @ output     = $(job_name).$(jobid)
38#-Q- sx8brodie # Fichier de sortie d'erreur du travail
39#-Q- sx8brodie # @ error      =  $(job_name).$(jobid)
40#-Q- sx8brodie # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
41#-Q- sx8brodie # @ notification = error
42#-Q- sx8brodie # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ;  $libIGCM_SX ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $MASTER
43#-Q- sx8brodie # @ queue
44#-Q- aix6 #!/bin/ksh
45#-Q- aix6 #######################
46#-Q- aix6 ##   VARGAS   IDRIS  ##
47#-Q- aix6 #######################
48#-Q- aix6 # Temps Elapsed max. d'une requete hh:mm:ss
49#-Q- aix6 # @ wall_clock_limit = 1:00:00
50#-Q- aix6 # Nom du travail LoadLeveler
51#-Q- aix6 # @ job_name   = MONITORING
52#-Q- aix6 # Fichier de sortie standard du travail       
53#-Q- aix6 # @ output     = $(job_name).$(jobid)
54#-Q- aix6 # Fichier de sortie d'erreur du travail
55#-Q- aix6 # @ error      =  $(job_name).$(jobid)
56#-Q- aix6 # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
57#-Q- aix6 # @ notification = error
58#-Q- aix6 # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $libIGCM_SX ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $MASTER
59#-Q- aix6 # @ queue
60#-Q- ulam #!/bin/ksh
61#-Q- ulam #######################
62#-Q- ulam ##   ULAM   IDRIS  ##
63#-Q- ulam #######################
64#-Q- ulam # Temps Elapsed max. d'une requete hh:mm:ss
65#-Q- ulam # @ wall_clock_limit = 1:00:00
66#-Q- ulam # Nom du travail LoadLeveler
67#-Q- ulam # @ job_name   = MONITORING
68#-Q- ulam # Fichier de sortie standard du travail       
69#-Q- ulam # @ output     = $(job_name).$(jobid)
70#-Q- ulam # Fichier de sortie d'erreur du travail
71#-Q- ulam # @ error      =  $(job_name).$(jobid)
72#-Q- ulam # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
73#-Q- ulam # @ notification = error
74#-Q- ulam # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $libIGCM_SX ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $MASTER
75#-Q- ulam # @ queue
76#-Q- sx8mercure #!/bin/ksh
77#-Q- sx8mercure ######################
78#-Q- sx8mercure ## SX8MERCURE   CEA ##
79#-Q- sx8mercure ######################
80#-Q- sx8mercure #PBS -N  MONITORING          # Nom du job
81#-Q- sx8mercure #PBS -j o                    # regroupement des stdout et stderr
82#-Q- sx8mercure #PBS -S /usr/bin/ksh         # shell de soumission
83#-Q- sx8mercure #PBS -l memsz_job=1gb        # Limite memoire a 1 Go
84#-Q- sx8mercure #PBS -l cputim_job=1:00:00   # Limite temps a 2 heures
85#-Q- sx8mercure #PBS -q scalaire
86#-Q- sx9mercure #!/bin/ksh
87#-Q- sx9mercure #########################
88#-Q- sx9mercure ## CESIUM FOR SX9  CEA ##
89#-Q- sx9mercure #########################
90#-Q- sx9mercure #MSUB -r MONITORING     # Nom du job               
91#-Q- sx9mercure #MSUB -N 1              # Reservation du noeud
92#-Q- sx9mercure #MSUB -n 1              # Reservation du processus
93#-Q- sx9mercure #MSUB -T 86400          # Limite de temps elapsed du job
94#-Q- sx9mercure #MSUB -E "-j o"
95#-Q- sx9mercure #MSUB -E "-S /bin/ksh"
96#-Q- titane #!/bin/ksh
97#-Q- titane ######################
98#-Q- titane ## TITANE   CEA ##
99#-Q- titane ######################
100#-Q- titane #MSUB -r MONITORING     # Nom du job               
101#-Q- titane #MSUB -N 1              # Reservation du noeud
102#-Q- titane #MSUB -n 1              # Reservation du processus
103#-Q- titane #MSUB -T 86400          # Limite de temps elapsed du job
104#-Q- titane #MSUB -E "-j o"
105#-Q- titane #MSUB -E "-S /bin/ksh"
106#-Q- titane ##MSUB -e nco.out        # Sortie standard
107#-Q- titane ##MSUB -o nco.out        # Sortie standard
108#-Q- lxiv8 ######################
109#-Q- lxiv8 ## OBELIX      LSCE ##
110#-Q- lxiv8 ######################
111#-Q- lxiv8 #PBS -N MONITORING
112#-Q- lxiv8 #PBS -m a
113#-Q- lxiv8 #PBS -j oe
114#-Q- lxiv8 #PBS -q medium
115#-Q- lxiv8 #PBS -o MONITORING.$$
116#-Q- lxiv8 #PBS -S /bin/ksh
117#-Q- default #!/bin/ksh
118#-Q- default ##################
119#-Q- default ## DEFAULT HOST ##
120#-Q- default ##################
121
122#**************************************************************
123# Author: Sebastien Denvil
124# Contact: Sebastien.Denvil__at__ipsl.jussieu.fr
125# $Revision::                                          $ Revision of last commit
126# $Author::                                            $ Author of last commit
127# $Date::                                              $ Date of last commit
128# IPSL (2006)
129#  This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
130#
131#**************************************************************
132
133#set -eu
134#set -vx
135
136date
137
138#-Q- sx8brodie export OMP_NUM_THREADS=1
139#-Q- aix6 export OMP_NUM_THREADS=1
140#-Q- ulam export OMP_NUM_THREADS=1
141
142########################################################################
143
144#D- Flag to determine if this job in a standalone mode
145#D- Default : value from AA_job if any
146StandAlone=${StandAlone:=true}
147
148#D- Low level debug : to bypass lib test checks and stack construction
149#D- Default : value from AA_job if any
150libIGCM=${libIGCM:=::modipsl::/libIGCM}
151# WARNING for StandAlone used : To run this script on some machine,
152# you must check MirrorlibIGCM variable in sys library.
153# If this variable is true, you must use libIGCM_POST path instead
154# of your running libIGCM directory.
155
156#D- Increased verbosity (1, 2, 3)
157#D- Default : value from AA_job if any
158Verbosity=${Verbosity:=3}
159
160#D- Low level debug : to bypass lib test checks and stack construction
161#D- Default : value from AA_job if any
162DEBUG_debug=${DEBUG_debug:=false}
163
164#D- TEMPORARY Flag to determine atmospheric resolution
165#D- Default : value from atmospheric driver if any
166RESOL_ATM=${RESOL_ATM:=ALL}
167
168#D- Flag to determine surface resolution
169#D- Default : value from surface driver if any
170RESOL_SRF=${RESOL_SRF:=ALL}
171
172#D- Flag to determine surface resolution
173#D- Default : value from surface driver if any
174RESOL_SBG=${RESOL_SBG:=ALL}
175
176#D- TEMPORARY Flag to determine ocean resolution
177#D- Default : value from ocean driver if any
178RESOL_OCE=${RESOL_OCE:=ORCA2}
179
180#D- TEMPORARY Flag to determine ice resolution
181#D- Default : value from ice driver if any
182RESOL_ICE=${RESOL_ICE:=ORCA2}
183
184#D- TEMPORARY Flag to determine marine biogeochemistry resolution
185#D- Default : value from ice driver if any
186RESOL_MBG=${RESOL_MBG:=ORCA2}
187
188######################################################################
189
190. ${libIGCM}/libIGCM_debug/libIGCM_debug.ksh
191      ( ${DEBUG_debug} ) && IGCM_debug_Check
192. ${libIGCM}/libIGCM_card/libIGCM_card.ksh
193     ( ${DEBUG_debug} ) && IGCM_card_Check
194. ${libIGCM}/libIGCM_date/libIGCM_date.ksh
195     ( ${DEBUG_debug} ) && IGCM_date_Check
196#-------
197. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh
198
199######################################################################
200
201#set -vx
202
203#===========================================
204RUN_DIR=${RUN_DIR_PATH}
205IGCM_sys_MkdirWork ${RUN_DIR}
206IGCM_sys_Cd ${RUN_DIR}
207
208# ------------------------------------------------------------------
209# Test if all was right before proceeding further
210# ------------------------------------------------------------------
211IGCM_debug_Verif_Exit_Post
212
213if [ ${StandAlone} = true ] ; then
214    CARD_DIR=${SUBMIT_DIR}
215else
216    CARD_DIR=${RUN_DIR}/$( basename ${SUBMIT_DIR} )
217    IGCM_sys_Get_Master ${SUBMIT_DIR} ${RUN_DIR}
218fi
219
220#
221# First of all
222#
223IGCM_card_DefineArrayFromSection       ${CARD_DIR}/config.card UserChoices
224typeset option
225for option in ${config_UserChoices[*]} ; do
226    IGCM_card_DefineVariableFromOption ${CARD_DIR}/config.card UserChoices ${option}
227done
228IGCM_card_DefineArrayFromSection       ${CARD_DIR}/config.card ListOfComponents
229
230#==================================
231#R_SAVE : Job output directory
232if ( [ ! X${config_UserChoices_SpaceName} = X ] && [ ! X${config_UserChoices_ExperimentName} = X ] ) ; then
233    FreeName=$( echo ${config_UserChoices_JobName} | sed 's/.*_//' )
234    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
235    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
236else
237    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
238    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_JobName}
239fi
240#
241IGCM_sys_TestDirArchive ${R_SAVE}/MONITORING
242if [ $? = 0 ] ; then
243    IGCM_debug_Print 1 "Get MONITORING directory from archive"
244    IGCM_sys_Get_Dir ${R_SAVE}/MONITORING ${RUN_DIR}
245else
246    IGCM_debug_Print 1 "MONITORING first pass. Nothing has been done before"
247fi
248# --------------------------------------------
249# Insert your commands between III...III lines
250# and precise produced directories to save
251# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
252
253for comp in ${config_ListOfComponents[*]} ; do
254    IGCM_debug_Print 1 "################## Component: ${comp} ######################"
255    liste_file_monitoring=""
256    IGCM_card_DefineArrayFromOption ${CARD_DIR}/config.card ListOfComponents ${comp}
257    eval compname=\${config_ListOfComponents_${comp}[0]}                > /dev/null 2>&1
258
259    PATH_monitoring_file=""
260    eval monitoring_file=monitoring01_${compname}_\${RESOL_${comp}}.cfg > /dev/null 2>&1
261    if [[ -d ${CARD_DIR}/POST && -f ${CARD_DIR}/POST/monitoring01_${compname}.cfg ]] ; then
262        PATH_monitoring_file=${CARD_DIR}/POST/monitoring01_${compname}.cfg
263    elif [ -f ${FER_ATLAS}/${monitoring_file} ] ; then
264        PATH_monitoring_file=${FER_ATLAS}/${monitoring_file}
265    else
266        IGCM_debug_Print 1 "No monitoring file found for this component. Was expecting ${monitoring_file}"
267        IGCM_debug_Print 1 "Step to next component"
268        continue
269    fi
270    #
271    if [ X${PATH_monitoring_file} != X"" ] ; then
272        IGCM_debug_Print 1 "Monitoring file used : ${PATH_monitoring_file}"
273        IGCM_debug_Print 1 "Determine which files we need."
274        . monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO
275        liste_file_monitoring=$( . monitoring01 -q -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO )
276    fi
277    #
278    if [ ! "X${liste_file_monitoring}" = X ] ; then
279        IGCM_sys_Get /l liste_file_monitoring ${RUN_DIR}
280        IGCM_debug_Print 1 "monitoring01 -c ${CARD_DIR} -p ${comp} --time -t \"${config_UserChoices_JobName} monitoring\" -o ${RUN_DIR}/MONITORING ${PATH_monitoring_file} ."
281        IGCM_debug_Print 1 "monitoring01 starts ................................................."
282        monitoring01 -c ${CARD_DIR} -p ${comp} --time -t "${config_UserChoices_JobName} monitoring" -o ${RUN_DIR}/MONITORING ${PATH_monitoring_file} .
283    else
284        IGCM_debug_Print 1 "No time series detected by this command :"
285        IGCM_debug_Print 1 "monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO"
286        . monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO
287    fi
288    #
289done
290
291# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
292
293# Save files
294IGCM_sys_Put_Dir MONITORING ${R_SAVE}
295
296# Dods copy
297IGCM_sys_Put_Dods MONITORING
298
299# Clean RUN_DIR_PATH (necessary for cesium)
300IGCM_sys_RmRunDir -Rf ${RUN_DIR_PATH}
Note: See TracBrowser for help on using the repository browser.