source: tags/libIGCM_v2.0/AA_monitoring @ 1170

Last change on this file since 1170 was 848, checked in by sdipsl, 11 years ago
  • Use sequential post-processing class
  • Property licence set to
    The following licence information concerns ONLY the libIGCM tools
    ==================================================================

    Copyright © Centre National de la Recherche Scientifique CNRS
    Commissariat à l'Énergie Atomique CEA

    libIGCM : Library for Portable Models Computation of IGCM Group.

    IGCM Group is the french IPSL Global Climate Model Group.

    This library is a set of shell scripts and functions whose purpose is
    the management of the initialization, the launch, the transfer of
    output files, the post-processing and the monitoring of datas produce
    by any numerical program on any plateforme.

    This software is governed by the CeCILL license under French law and
    abiding by the rules of distribution of free software. You can use,
    modify and/ or redistribute the software under the terms of the CeCILL
    license as circulated by CEA, CNRS and INRIA at the following URL
    "http://www.cecill.info".

    As a counterpart to the access to the source code and rights to copy,
    modify and redistribute granted by the license, users are provided only
    with a limited warranty and the software's author, the holder of the
    economic rights, and the successive licensors have only limited
    liability.

    In this respect, the user's attention is drawn to the risks associated
    with loading, using, modifying and/or developing or reproducing the
    software by the user in light of its specific status of free software,
    that may mean that it is complicated to manipulate, and that also
    therefore means that it is reserved for developers and experienced
    professionals having in-depth computer knowledge. Users are therefore
    encouraged to load and test the software's suitability as regards their
    requirements in conditions enabling the security of their systems and/or
    data to be ensured and, more generally, to use and operate it in the
    same conditions as regards security.

    The fact that you are presently reading this means that you have had
    knowledge of the CeCILL license and that you accept its terms.
  • Property svn:keywords set to Revision Author Date
File size: 9.4 KB
Line 
1#-Q- curie ######################
2#-Q- curie ## CURIE   TGCC/CEA ##
3#-Q- curie ######################
4#-Q- curie #MSUB -r MONITORING     # Nom du job
5#-Q- curie #MSUB -eo
6#-Q- curie #MSUB -n 1              # Reservation du processus
7#-Q- curie #MSUB -T 86400          # Limite de temps elapsed du job
8#-Q- curie #MSUB -q xlarge
9#-Q- curie #MSUB -Q normal
10#-Q- curie #MSUB -A ::default_project::
11#-Q- curie set +x
12#-Q- ada #!/bin/ksh
13#-Q- ada #######################
14#-Q- ada ##   ADA   IDRIS  ##
15#-Q- ada #######################
16#-Q- ada # @ job_type = serial
17#-Q- ada # @ requirements = (Feature == "prepost")
18#-Q- ada # Temps Elapsed max. d'une requete hh:mm:ss
19#-Q- ada # @ wall_clock_limit = 1:00:00
20#-Q- ada # Nom du travail LoadLeveler
21#-Q- ada # @ job_name   = MONITORING
22#-Q- ada # Fichier de sortie standard du travail
23#-Q- ada # @ output     = $(job_name).$(jobid)
24#-Q- ada # Fichier de sortie d'erreur du travail
25#-Q- ada # @ error      =  $(job_name).$(jobid)
26#-Q- ada # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
27#-Q- ada # @ notification = error
28#-Q- ada # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $libIGCM_SX ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $MASTER
29#-Q- ada # @ queue
30#-Q- sx9mercure #!/bin/ksh
31#-Q- sx9mercure ######################
32#-Q- sx9mercure ## SX9MERCURE  CCRT ##
33#-Q- sx9mercure ######################
34#-Q- sx9mercure #PBS -N  MONITORING          # Nom du job
35#-Q- sx9mercure #PBS -j o                    # regroupement des stdout et stderr
36#-Q- sx9mercure #PBS -S /usr/bin/ksh         # shell de soumission
37#-Q- sx9mercure #PBS -l memsz_job=1gb        # Limite memoire a 1 Go
38#-Q- sx9mercure #PBS -l elapstim_req=1:00:00   # Limite temps a 2 heures
39#-Q- sx9mercure #PBS -q scalaire
40#-Q- sx9mercure #PBS -r n
41#-Q- titane #!/bin/ksh
42#-Q- titane ######################
43#-Q- titane ## TITANE   CEA ##
44#-Q- titane ######################
45#-Q- titane #MSUB -r MONITORING     # Nom du job
46#-Q- titane #MSUB -eo
47#-Q- titane #MSUB -n 1              # Reservation du processus
48#-Q- titane #MSUB -T 86400          # Limite de temps elapsed du job
49#-Q- titane #MSUB -q mono
50#-Q- titane #MSUB -E '-rn'
51#-Q- lxiv8 ######################
52#-Q- lxiv8 ## OBELIX      LSCE ##
53#-Q- lxiv8 ######################
54#-Q- lxiv8 #PBS -N MONITORING
55#-Q- lxiv8 #PBS -m a
56#-Q- lxiv8 #PBS -j oe
57#-Q- lxiv8 #PBS -q medium
58#-Q- lxiv8 #PBS -o MONITORING.$$
59#-Q- lxiv8 #PBS -S /bin/ksh
60#-Q- default #!/bin/ksh
61#-Q- default ##################
62#-Q- default ## DEFAULT HOST ##
63#-Q- default ##################
64
65#**************************************************************
66# Author: Sebastien Denvil
67# Contact: Sebastien.Denvil__at__ipsl.jussieu.fr
68# $Revision::                                          $ Revision of last commit
69# $Author::                                            $ Author of last commit
70# $Date::                                              $ Date of last commit
71# IPSL (2006)
72#  This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
73#
74#**************************************************************
75
76#set -eu
77#set -vx
78
79date
80
81#-Q- ada export OMP_NUM_THREADS=1
82
83#D- Task type (computing or post-processing)
84TaskType=post-processing
85
86########################################################################
87
88#D- Flag to determine if this job in a standalone mode
89#D- Default : value from AA_job if any
90StandAlone=${StandAlone:=true}
91
92#D- Path to libIGCM
93#D- Default : value from AA_job if any
94# WARNING For StandAlone use : To run this script on some machine (ada and cesium)
95# WARNING you must check MirrorlibIGCM variable in sys library.
96# WARNING If this variable is true, you must use libIGCM_POST path instead
97# WARNING of your running libIGCM directory.
98libIGCM=${libIGCM:=::modipsl::/libIGCM}
99
100#D- Increased verbosity (1, 2, 3)
101#D- Default : value from AA_job if any
102Verbosity=${Verbosity:=3}
103
104#D- Low level debug : to bypass lib test checks and stack construction
105#D- Default : value from AA_job if any
106DEBUG_debug=${DEBUG_debug:=false}
107
108#D- TEMPORARY Flag to determine atmospheric resolution
109#D- Default : value from atmospheric driver if any
110RESOL_ATM=${RESOL_ATM:=ALL}
111
112#D- Flag to determine surface resolution
113#D- Default : value from surface driver if any
114RESOL_SRF=${RESOL_SRF:=ALL}
115
116#D- Flag to determine surface resolution
117#D- Default : value from surface driver if any
118RESOL_SBG=${RESOL_SBG:=ALL}
119
120#D- TEMPORARY Flag to determine ocean resolution
121#D- Default : value from ocean driver if any
122RESOL_OCE=${RESOL_OCE:=ORCA2}
123
124#D- TEMPORARY Flag to determine ice resolution
125#D- Default : value from ice driver if any
126RESOL_ICE=${RESOL_ICE:=ORCA2}
127
128#D- TEMPORARY Flag to determine marine biogeochemistry resolution
129#D- Default : value from ice driver if any
130RESOL_MBG=${RESOL_MBG:=ORCA2}
131
132######################################################################
133
134. ${libIGCM}/libIGCM_debug/libIGCM_debug.ksh
135. ${libIGCM}/libIGCM_card/libIGCM_card.ksh
136. ${libIGCM}/libIGCM_date/libIGCM_date.ksh
137#-------
138. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh
139. ${libIGCM}/libIGCM_config/libIGCM_config.ksh
140#-------
141( ${DEBUG_debug} ) && IGCM_debug_Check
142( ${DEBUG_debug} ) && IGCM_card_Check
143( ${DEBUG_debug} ) && IGCM_date_Check
144
145######################################################################
146
147#set -vx
148
149#===========================================
150RUN_DIR=${RUN_DIR_PATH}
151IGCM_sys_MkdirWork ${RUN_DIR}
152IGCM_sys_Cd ${RUN_DIR}
153
154# ------------------------------------------------------------------
155# Test if all was right before proceeding further
156# ------------------------------------------------------------------
157IGCM_debug_Verif_Exit_Post
158
159if [ ${StandAlone} = true ] ; then
160  CARD_DIR=${SUBMIT_DIR}
161else
162  CARD_DIR=${RUN_DIR}
163  IGCM_sys_Get_Master ${SUBMIT_DIR}/config.card ${RUN_DIR_PATH}
164  IGCM_sys_Get_Master ${SUBMIT_DIR}/run.card    ${RUN_DIR_PATH}
165  IGCM_sys_Get_Master ${SUBMIT_DIR}/COMP        ${RUN_DIR_PATH}
166  IGCM_sys_Get_Master ${SUBMIT_DIR}/POST        ${RUN_DIR_PATH}
167fi
168
169#==================================
170# First of all
171#
172# Read libIGCM compatibility version in config.card
173# Read UserChoices section
174# Read Ensemble section
175# Read Post section
176# Define all netcdf output directories
177#==================================
178IGCM_config_CommonConfiguration ${CARD_DIR}/config.card
179
180#==================================
181# Read ListOfComponents section:
182IGCM_card_DefineArrayFromSection ${CARD_DIR}/config.card ListOfComponents
183
184# Create R_FIGR that has been defined by IGCM_config_CommonConfiguration
185IGCM_sys_MkdirArchive ${R_FIGR}
186#
187IGCM_sys_TestDirArchive ${R_FIGR}/MONITORING
188if [ $? = 0 ] ; then
189  IGCM_debug_Print 1 "Get MONITORING directory from archive"
190  IGCM_sys_Get_Dir ${R_FIGR}/MONITORING ${RUN_DIR}
191else
192  IGCM_debug_Print 1 "MONITORING first pass. Nothing has been done before"
193fi
194# --------------------------------------------
195# Insert your commands between III...III lines
196# and precise produced directories to save
197# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
198
199for comp in ${config_ListOfComponents[*]} ; do
200  IGCM_debug_Print 1 "################## Component: ${comp} ######################"
201  liste_file_monitoring=""
202  IGCM_card_DefineArrayFromOption ${CARD_DIR}/config.card ListOfComponents ${comp}
203  eval compname=\${config_ListOfComponents_${comp}[0]}                > /dev/null 2>&1
204
205  PATH_monitoring_file=""
206  eval monitoring_file=monitoring01_${compname}_\${RESOL_${comp}}.cfg > /dev/null 2>&1
207  if [[ -d ${CARD_DIR}/POST && -f ${CARD_DIR}/POST/monitoring01_${compname}.cfg ]] ; then
208    PATH_monitoring_file=${CARD_DIR}/POST/monitoring01_${compname}.cfg
209  elif [ -f ${FER_ATLAS}/${monitoring_file} ] ; then
210    PATH_monitoring_file=${FER_ATLAS}/${monitoring_file}
211  else
212    IGCM_debug_Print 1 "No monitoring file found for this component. Was expecting ${monitoring_file}"
213    IGCM_debug_Print 1 "Step to next component"
214    continue
215  fi
216  #
217  if [ X${PATH_monitoring_file} != X"" ] ; then
218    IGCM_debug_Print 1 "Monitoring file used : ${PATH_monitoring_file}"
219    IGCM_debug_Print 1 "Determine which files we need."
220    . monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive_NoError ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO
221    liste_file_monitoring=$( . monitoring01 -q -l2 --listcommand 'IGCM_sys_RshArchive_NoError ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO )
222  fi
223  #
224  if [ ! "X${liste_file_monitoring}" = X ] ; then
225    IGCM_sys_Get /l liste_file_monitoring ${RUN_DIR}
226    IGCM_debug_Print 1 "monitoring01 -c ${CARD_DIR} -p ${comp} --time -t \"${config_UserChoices_JobName} monitoring\" -o ${RUN_DIR}/MONITORING ${PATH_monitoring_file} ."
227    IGCM_debug_Print 1 "monitoring01 starts ................................................."
228    monitoring01 -c ${CARD_DIR} -p ${comp} --time -t "${config_UserChoices_JobName} monitoring" -o ${RUN_DIR}/MONITORING ${PATH_monitoring_file} .
229  else
230    IGCM_debug_Print 1 "No time series detected by this command :"
231    IGCM_debug_Print 1 "monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive_NoError ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO"
232    . monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive_NoError ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO
233  fi
234  #
235done
236
237# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
238
239# Save files
240IGCM_sys_Put_Dir MONITORING ${R_FIGR}
241
242# Dods copy
243IGCM_sys_Put_Dods MONITORING
244
245# Clean RUN_DIR_PATH (necessary for cesium and titane only)
246IGCM_sys_RmRunDir -Rf ${RUN_DIR_PATH}
Note: See TracBrowser for help on using the repository browser.