source: tags/libIGCM_v2.3/AA_monitoring @ 1018

Last change on this file since 1018 was 982, checked in by mafoipsl, 10 years ago

For monitoring set time limit to 4 hours. Required for long simulations.

  • Property licence set to
    The following licence information concerns ONLY the libIGCM tools
    ==================================================================

    Copyright © Centre National de la Recherche Scientifique CNRS
    Commissariat à l'Énergie Atomique CEA

    libIGCM : Library for Portable Models Computation of IGCM Group.

    IGCM Group is the french IPSL Global Climate Model Group.

    This library is a set of shell scripts and functions whose purpose is
    the management of the initialization, the launch, the transfer of
    output files, the post-processing and the monitoring of datas produce
    by any numerical program on any plateforme.

    This software is governed by the CeCILL license under French law and
    abiding by the rules of distribution of free software. You can use,
    modify and/ or redistribute the software under the terms of the CeCILL
    license as circulated by CEA, CNRS and INRIA at the following URL
    "http://www.cecill.info".

    As a counterpart to the access to the source code and rights to copy,
    modify and redistribute granted by the license, users are provided only
    with a limited warranty and the software's author, the holder of the
    economic rights, and the successive licensors have only limited
    liability.

    In this respect, the user's attention is drawn to the risks associated
    with loading, using, modifying and/or developing or reproducing the
    software by the user in light of its specific status of free software,
    that may mean that it is complicated to manipulate, and that also
    therefore means that it is reserved for developers and experienced
    professionals having in-depth computer knowledge. Users are therefore
    encouraged to load and test the software's suitability as regards their
    requirements in conditions enabling the security of their systems and/or
    data to be ensured and, more generally, to use and operate it in the
    same conditions as regards security.

    The fact that you are presently reading this means that you have had
    knowledge of the CeCILL license and that you accept its terms.
  • Property svn:keywords set to Revision Author Date
File size: 8.9 KB
Line 
1#-Q- curie ######################
2#-Q- curie ## CURIE   TGCC/CEA ##
3#-Q- curie ######################
4#-Q- curie #MSUB -r MONITORING     # Nom du job
5#-Q- curie #MSUB -eo
6#-Q- curie #MSUB -n 1              # Reservation du processus
7#-Q- curie #MSUB -T 14400          # Limite de temps elapsed du job
8#-Q- curie #MSUB -q xlarge
9#-Q- curie #MSUB -Q normal
10#-Q- curie #MSUB -A ::default_project::
11#-Q- curie set +x
12#-Q- ada #!/bin/ksh
13#-Q- ada #######################
14#-Q- ada ## ADA         IDRIS ##
15#-Q- ada #######################
16#-Q- ada # @ job_type = serial
17#-Q- ada # @ requirements = (Feature == "prepost")
18#-Q- ada # Temps Elapsed max. d'une requete hh:mm:ss
19#-Q- ada # @ wall_clock_limit = 4:00:00
20#-Q- ada # Nom du travail LoadLeveler
21#-Q- ada # @ job_name   = MONITORING
22#-Q- ada # Fichier de sortie standard du travail
23#-Q- ada # @ output     = $(job_name).$(jobid)
24#-Q- ada # Fichier de sortie d'erreur du travail
25#-Q- ada # @ error      =  $(job_name).$(jobid)
26#-Q- ada # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
27#-Q- ada # @ notification = error
28#-Q- ada # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $libIGCM_SX ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $MASTER
29#-Q- ada # @ queue
30#-Q- lxiv8 ######################
31#-Q- lxiv8 ## OBELIX      LSCE ##
32#-Q- lxiv8 ######################
33#-Q- lxiv8 #PBS -N MONITORING
34#-Q- lxiv8 #PBS -m a
35#-Q- lxiv8 #PBS -j oe
36#-Q- lxiv8 #PBS -q medium
37#-Q- lxiv8 #PBS -o MONITORING.$$
38#-Q- lxiv8 #PBS -S /bin/ksh
39#-Q- default #!/bin/ksh
40#-Q- default ##################
41#-Q- default ## DEFAULT HOST ##
42#-Q- default ##################
43
44#**************************************************************
45# Author: Sebastien Denvil
46# Contact: Sebastien.Denvil__at__ipsl.jussieu.fr
47# $Revision::                                          $ Revision of last commit
48# $Author::                                            $ Author of last commit
49# $Date::                                              $ Date of last commit
50# IPSL (2006)
51#  This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
52#
53#**************************************************************
54
55#set -eu
56#set -vx
57
58date
59
60#-Q- ada export OMP_NUM_THREADS=1
61
62#D- Task type (computing or post-processing)
63TaskType=post-processing
64
65########################################################################
66
67#D- Flag to determine if this job in a standalone mode
68#D- Default : value from AA_job if any
69StandAlone=${StandAlone:=true}
70
71#D- Path to libIGCM
72#D- Default : value from AA_job if any
73# WARNING For StandAlone use : To run this script on some machine (ada and cesium)
74# WARNING you must check MirrorlibIGCM variable in sys library.
75# WARNING If this variable is true, you must use libIGCM_POST path instead
76# WARNING of your running libIGCM directory.
77libIGCM=${libIGCM:=::modipsl::/libIGCM}
78
79#D- Increased verbosity (1, 2, 3)
80#D- Default : value from AA_job if any
81Verbosity=${Verbosity:=3}
82
83#D- Low level debug : to bypass lib test checks and stack construction
84#D- Default : value from AA_job if any
85DEBUG_debug=${DEBUG_debug:=false}
86
87#D- TEMPORARY Flag to determine atmospheric resolution
88#D- Default : value from atmospheric driver if any
89RESOL_ATM=${RESOL_ATM:=ALL}
90
91#D- Flag to determine surface resolution
92#D- Default : value from surface driver if any
93RESOL_SRF=${RESOL_SRF:=ALL}
94
95#D- Flag to determine surface resolution
96#D- Default : value from surface driver if any
97RESOL_SBG=${RESOL_SBG:=ALL}
98
99#D- TEMPORARY Flag to determine ocean resolution
100#D- Default : value from ocean driver if any
101RESOL_OCE=${RESOL_OCE:=ORCA2}
102
103#D- TEMPORARY Flag to determine ice resolution
104#D- Default : value from ice driver if any
105RESOL_ICE=${RESOL_ICE:=ORCA2}
106
107#D- TEMPORARY Flag to determine marine biogeochemistry resolution
108#D- Default : value from ice driver if any
109RESOL_MBG=${RESOL_MBG:=ORCA2}
110
111######################################################################
112
113. ${libIGCM}/libIGCM_debug/libIGCM_debug.ksh
114. ${libIGCM}/libIGCM_card/libIGCM_card.ksh
115. ${libIGCM}/libIGCM_date/libIGCM_date.ksh
116#-------
117. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh
118. ${libIGCM}/libIGCM_config/libIGCM_config.ksh
119#-------
120( ${DEBUG_debug} ) && IGCM_debug_Check
121( ${DEBUG_debug} ) && IGCM_card_Check
122( ${DEBUG_debug} ) && IGCM_date_Check
123
124######################################################################
125
126#set -vx
127
128#===========================================
129RUN_DIR=${RUN_DIR_PATH}
130IGCM_sys_MkdirWork ${RUN_DIR}
131IGCM_sys_Cd ${RUN_DIR}
132
133# ------------------------------------------------------------------
134# Test if all was right before proceeding further
135# ------------------------------------------------------------------
136IGCM_debug_Verif_Exit_Post
137
138if [ ${StandAlone} = true ] ; then
139  CARD_DIR=${SUBMIT_DIR}
140else
141  CARD_DIR=${RUN_DIR}
142  IGCM_sys_Get_Master ${SUBMIT_DIR}/config.card ${RUN_DIR_PATH}
143  IGCM_sys_Get_Master ${SUBMIT_DIR}/run.card    ${RUN_DIR_PATH}
144  IGCM_sys_Get_Master ${SUBMIT_DIR}/COMP        ${RUN_DIR_PATH}
145  IGCM_sys_Get_Master ${SUBMIT_DIR}/POST        ${RUN_DIR_PATH}
146fi
147
148#==================================
149# First of all
150#
151# Read libIGCM compatibility version in config.card
152# Read UserChoices section
153# Read Ensemble section
154# Read Post section
155# Define all netcdf output directories
156#==================================
157IGCM_config_CommonConfiguration ${CARD_DIR}/config.card
158
159#==================================
160# Read ListOfComponents section:
161IGCM_card_DefineArrayFromSection ${CARD_DIR}/config.card ListOfComponents
162
163# Create R_FIGR that has been defined by IGCM_config_CommonConfiguration
164IGCM_sys_MkdirArchive ${R_FIGR}
165#
166IGCM_sys_TestDirArchive ${R_FIGR}/MONITORING
167if [ $? = 0 ] ; then
168  IGCM_debug_Print 1 "Get MONITORING directory from archive"
169  IGCM_sys_Get_Dir ${R_FIGR}/MONITORING ${RUN_DIR}
170else
171  IGCM_debug_Print 1 "MONITORING first pass. Nothing has been done before"
172fi
173# --------------------------------------------
174# Insert your commands between III...III lines
175# and precise produced directories to save
176# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
177
178for comp in ${config_ListOfComponents[*]} ; do
179  IGCM_debug_Print 1 "################## Component: ${comp} ######################"
180  liste_file_monitoring=""
181  IGCM_card_DefineArrayFromOption ${CARD_DIR}/config.card ListOfComponents ${comp}
182  eval compname=\${config_ListOfComponents_${comp}[0]}                > /dev/null 2>&1
183
184  PATH_monitoring_file=""
185  eval monitoring_file=monitoring01_${compname}_\${RESOL_${comp}}.cfg > /dev/null 2>&1
186  if [[ -d ${CARD_DIR}/POST && -f ${CARD_DIR}/POST/monitoring01_${compname}.cfg ]] ; then
187    PATH_monitoring_file=${CARD_DIR}/POST/monitoring01_${compname}.cfg
188  elif [ -f ${FER_ATLAS}/${monitoring_file} ] ; then
189    PATH_monitoring_file=${FER_ATLAS}/${monitoring_file}
190  else
191    IGCM_debug_Print 1 "No monitoring file found for this component. Was expecting ${monitoring_file}"
192    IGCM_debug_Print 1 "Step to next component"
193    continue
194  fi
195  #
196  if [ X${PATH_monitoring_file} != X"" ] ; then
197    IGCM_debug_Print 1 "Monitoring file used : ${PATH_monitoring_file}"
198    IGCM_debug_Print 1 "Determine which frequency of time series to be used."
199
200    FreqTS=$( grep FreqTS ${PATH_monitoring_file} | grep -v \# | awk -F "=" '{print $2}' )
201    if [ X${FreqTS} = X ] ; then
202      # Default frequency is MO
203      FreqTS=MO
204    fi
205
206    IGCM_debug_Print 1 "Times series frequency to be used is ${FreqTS}"
207    IGCM_debug_Print 1 "Determine which files we need."
208    . monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive_NoError ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_${FreqTS}
209    liste_file_monitoring=$( . monitoring01 -q -l2 --listcommand 'IGCM_sys_RshArchive_NoError ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_${FreqTS} )
210  fi
211  #
212  if [ ! "X${liste_file_monitoring}" = X ] ; then
213    IGCM_sys_Get /l liste_file_monitoring ${RUN_DIR}
214    IGCM_debug_Print 1 "monitoring01 -c ${CARD_DIR} -p ${comp} --time -t \"${config_UserChoices_JobName} monitoring\" -o ${RUN_DIR}/MONITORING ${PATH_monitoring_file} ."
215    IGCM_debug_Print 1 "monitoring01 starts ................................................."
216    monitoring01 -c ${CARD_DIR} -p ${comp} --time -t "${config_UserChoices_JobName} monitoring" -o ${RUN_DIR}/MONITORING ${PATH_monitoring_file} .
217  else
218    IGCM_debug_Print 1 "No time series detected by this command :"
219    IGCM_debug_Print 1 "monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive_NoError ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_${FreqTS}"
220    . monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive_NoError ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_${FreqTS}
221  fi
222  #
223done
224
225# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
226
227# Save files
228IGCM_sys_Put_Dir MONITORING ${R_FIGR}
229
230# Dods copy
231if [ X${config_Post_DodsCopy} = XTRUE ]  ; then
232  IGCM_sys_Put_Dods MONITORING
233fi
234
235# Clean RUN_DIR_PATH (necessary for cesium and titane only)
236IGCM_sys_RmRunDir -Rf ${RUN_DIR_PATH}
Note: See TracBrowser for help on using the repository browser.