source: trunk/libIGCM/AA_atlas_ORCA_LIM @ 1497

Last change on this file since 1497 was 1468, checked in by mafoipsl, 6 years ago

On curie : set output files for all jobs.

On irene :

  • set output files for all jobs like curie
  • add the possibility to use xlarge nodes (for free) for post-processing or skylake nodes
  • add a question to set project used for post-processing and delete -A option in libIGCM_sys_irene
  • display only available projects for computing or post-processing on irene
  • Property licence set to
    The following licence information concerns ONLY the libIGCM tools
    ==================================================================

    Copyright © Centre National de la Recherche Scientifique CNRS
    Commissariat à l'Énergie Atomique CEA

    libIGCM : Library for Portable Models Computation of IGCM Group.

    IGCM Group is the french IPSL Global Climate Model Group.

    This library is a set of shell scripts and functions whose purpose is
    the management of the initialization, the launch, the transfer of
    output files, the post-processing and the monitoring of datas produce
    by any numerical program on any plateforme.

    This software is governed by the CeCILL license under French law and
    abiding by the rules of distribution of free software. You can use,
    modify and/ or redistribute the software under the terms of the CeCILL
    license as circulated by CEA, CNRS and INRIA at the following URL
    "http://www.cecill.info".

    As a counterpart to the access to the source code and rights to copy,
    modify and redistribute granted by the license, users are provided only
    with a limited warranty and the software's author, the holder of the
    economic rights, and the successive licensors have only limited
    liability.

    In this respect, the user's attention is drawn to the risks associated
    with loading, using, modifying and/or developing or reproducing the
    software by the user in light of its specific status of free software,
    that may mean that it is complicated to manipulate, and that also
    therefore means that it is reserved for developers and experienced
    professionals having in-depth computer knowledge. Users are therefore
    encouraged to load and test the software's suitability as regards their
    requirements in conditions enabling the security of their systems and/or
    data to be ensured and, more generally, to use and operate it in the
    same conditions as regards security.

    The fact that you are presently reading this means that you have had
    knowledge of the CeCILL license and that you accept its terms.
  • Property svn:keywords set to Revision Author Date
File size: 10.8 KB
RevLine 
[622]1#-Q- curie ######################
2#-Q- curie ## CURIE   TGCC/CEA ##
3#-Q- curie ######################
[785]4#-Q- curie #MSUB -r ATL_OPA        # Nom du job
[1468]5#-Q- curie #MSUB -o ATL_OPA.out_%I
6#-Q- curie #MSUB -e ATL_OPA.out_%I
[622]7#-Q- curie #MSUB -n 1              # Reservation du processus
[880]8#-Q- curie #MSUB -T 7200          # Limite de temps elapsed du job
[1154]9#-Q- curie #MSUB -q ::default_node::
[1274]10#-Q- curie #MSUB -c ::default_core::
[704]11#-Q- curie #MSUB -Q normal
[837]12#-Q- curie #MSUB -A ::default_project::
[681]13#-Q- curie set +x
[1437]14#-Q- irene ######################
15#-Q- irene ## IRENE   TGCC/CEA ##
16#-Q- irene ######################
17#-Q- irene #MSUB -r ATL_OPA      # Job name
[1468]18#-Q- irene #MSUB -o ATL_OPA.out_%I
19#-Q- irene #MSUB -e ATL_OPA.out_%I
[1437]20#-Q- irene #MSUB -n 1
21#-Q- irene #MSUB -T 7200         # Maximum elapsed time
[1468]22#-Q- irene #MSUB -q ::default_node::
23#-Q- irene #MSUB -c ::default_core::
[1437]24#-Q- irene #MSUB -Q normal
[1468]25#-Q- irene #MSUB -A ::default_post_project::
[1460]26#-Q- irene #MSUB -m store,work,scratch
[1437]27#-Q- irene set +x
[770]28#-Q- ada #!/bin/ksh
29#-Q- ada #######################
[929]30#-Q- ada ## ADA         IDRIS ##
[770]31#-Q- ada #######################
[1409]32#-Q- ada # @ job_type = mpich
[848]33#-Q- ada # @ requirements = (Feature == "prepost")
[770]34#-Q- ada # Temps Elapsed max. d'une requete hh:mm:ss
35#-Q- ada # @ wall_clock_limit = 2:00:00
36#-Q- ada # Nom du travail LoadLeveler
37#-Q- ada # @ job_name   = ATL_OPA
[785]38#-Q- ada # Fichier de sortie standard du travail
[770]39#-Q- ada # @ output     = $(job_name).$(jobid)
40#-Q- ada # Fichier de sortie d'erreur du travail
41#-Q- ada # @ error      =  $(job_name).$(jobid)
42#-Q- ada # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
43#-Q- ada # @ notification = error
[1290]44#-Q- ada # @ environment  = $POST_DIR ; $Script_Post_Output ; $SUBMIT_DIR ; $libIGCM ; $DEBUG_debug ; $BigBrother ; $postProcessingStopLevel ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $RESOL_SBG ; $YEARS ; $DIR_OUT ; $MASTER ; $libIGCM_SX ; wall_clock_limit=$(wall_clock_limit)
[770]45#-Q- ada # @ queue
[929]46#-Q- lxiv8 ######################
47#-Q- lxiv8 ## OBELIX      LSCE ##
48#-Q- lxiv8 ######################
49#-Q- lxiv8 #PBS -N ATL_OPA
50#-Q- lxiv8 #PBS -m a
51#-Q- lxiv8 #PBS -j oe
52#-Q- lxiv8 #PBS -q test
53#-Q- lxiv8 #PBS -o ATL_OPA.$$
54#-Q- lxiv8 #PBS -S /bin/ksh
[1184]55#-Q- ifort_CICLAD ######################
56#-Q- ifort_CICLAD ##   CICLAD    IPSL ##
57#-Q- ifort_CICLAD ######################
58#-Q- ifort_CICLAD #PBS -N ATL_OPA
59#-Q- ifort_CICLAD #PBS -m a
60#-Q- ifort_CICLAD #PBS -j oe
61#-Q- ifort_CICLAD #PBS -q std
62#-Q- ifort_CICLAD #PBS -S /bin/ksh
[2]63#-Q- default #!/bin/ksh
64#-Q- default ##################
65#-Q- default ## DEFAULT HOST ##
66#-Q- default ##################
67
[373]68#**************************************************************
69# Author: Sebastien Denvil
70# Contact: Sebastien.Denvil__at__ipsl.jussieu.fr
71# $Revision::                                          $ Revision of last commit
72# $Author::                                            $ Author of last commit
73# $Date::                                              $ Date of last commit
[2]74# IPSL (2006)
75#  This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
[373]76#
77#**************************************************************
[2]78
[108]79#set -eu
[906]80#set -vx
[2]81
82date
83
[770]84#-Q- ada export OMP_NUM_THREADS=1
[2]85
[1356]86#D- Task type DO NOT CHANGE (computing, post-processing or checking)
[712]87TaskType=post-processing
88
[2]89########################################################################
90
[108]91. ${libIGCM}/libIGCM_debug/libIGCM_debug.ksh
92. ${libIGCM}/libIGCM_card/libIGCM_card.ksh
93. ${libIGCM}/libIGCM_date/libIGCM_date.ksh
94#-------
95. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh
[731]96. ${libIGCM}/libIGCM_config/libIGCM_config.ksh
[832]97#-------
[1192]98IGCM_sys_MkdirWork ${RUN_DIR_PATH}
99IGCM_sys_Cd ${RUN_DIR_PATH}
100#-------
[832]101( ${DEBUG_debug} ) && IGCM_debug_Check
102( ${DEBUG_debug} ) && IGCM_card_Check
103( ${DEBUG_debug} ) && IGCM_date_Check
[2]104
105########################################################################
106
[906]107#set -vx
[2]108
[436]109# ------------------------------------------------------------------
110# Test if all was right before proceeding further
111# ------------------------------------------------------------------
[1206]112IGCM_debug_Verif_Exit
[436]113
[263]114if [ ${StandAlone} = true ] ; then
115    CARD_DIR=${SUBMIT_DIR}
116else
[647]117    CARD_DIR=${RUN_DIR_PATH}
[640]118    IGCM_sys_Get_Master ${SUBMIT_DIR}/config.card ${RUN_DIR_PATH}
119    IGCM_sys_Get_Master ${SUBMIT_DIR}/run.card    ${RUN_DIR_PATH}
120    IGCM_sys_Get_Master ${SUBMIT_DIR}/COMP        ${RUN_DIR_PATH}
121    IGCM_sys_Get_Master ${SUBMIT_DIR}/POST        ${RUN_DIR_PATH}
122
[263]123fi
[727]124
125#==================================
[263]126# First of all
127#
[727]128# Read libIGCM compatibility version in config.card
129# Read UserChoices section
130# Read Ensemble section
131# Read Post section
132# Define all netcdf output directories
133#==================================
134IGCM_config_CommonConfiguration ${CARD_DIR}/config.card
[658]135
[1198]136# ------------------------------------------------------------------
137# Activate BigBrother so as to supervise this job
138# ------------------------------------------------------------------
139IGCM_debug_BigBro_Initialize
[263]140
[1198]141#==================================
142# Then set up several directories
143#==================================
[2]144R_ATLAS=ATLAS/SE_${YEARS}
145R_OUT_OCE=${R_SAVE}/OCE
146R_OUT_ICE=${R_SAVE}/ICE
[370]147DIR_OUT=${DIR_OUT:=SE}
[34]148RUN_DIR=${RUN_DIR_PATH}/ATLAS_ORCALIM_${YEARS}
[1198]149IGCM_sys_MkdirArchive ${R_FIGR}
[34]150IGCM_sys_MkdirWork ${RUN_DIR}
151IGCM_sys_Cd ${RUN_DIR}
[2]152
153# --------------------------------------------
154# Insert your commands between III...III lines
155# and precise produced directories to save
156# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
157
[370]158IGCM_sys_Get ${R_OUT_OCE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_T.nc  ${RUN_DIR}
159IGCM_sys_Get ${R_OUT_OCE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_U.nc  ${RUN_DIR}
160IGCM_sys_Get ${R_OUT_OCE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_V.nc  ${RUN_DIR}
161IGCM_sys_Get ${R_OUT_OCE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_W.nc  ${RUN_DIR}
162IGCM_sys_Get ${R_OUT_ICE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_icemod.nc  ${RUN_DIR}
[2]163
164
[1279]165# Which atlas configuration source are we using?
166ls ${CARD_DIR}/POST/atlas_p_${RESOL_OCE}_diag1_[abc].cfg 2>/dev/null 1>&2
167[ ${?} -ne 0 ] && PATH_ATLAS=${FER_ATLAS} || PATH_ATLAS=${CARD_DIR}/POST
168IGCM_sys_atlas -o ${RUN_DIR}/${R_ATLAS}/OCE_T -l ${PATH_ATLAS}/atlas_p_${RESOL_OCE}_diag1_[abc].cfg     ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_T.nc
169
170
171ls ${CARD_DIR}/POST/atlas_p_${RESOL_OCE}_diag0_U.cfg 2>/dev/null 1>&2
172[ ${?} -ne 0 ] && PATH_ATLAS=${FER_ATLAS} || PATH_ATLAS=${CARD_DIR}/POST
173IGCM_sys_atlas -o ${RUN_DIR}/${R_ATLAS}/OCE_U -l ${PATH_ATLAS}/atlas_p_${RESOL_OCE}_diag0_U.cfg         ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_U.nc
174
175ls ${CARD_DIR}/POST/atlas_p_${RESOL_OCE}_diag0_V.cfg 2>/dev/null 1>&2
176[ ${?} -ne 0 ] && PATH_ATLAS=${FER_ATLAS} || PATH_ATLAS=${CARD_DIR}/POST
177IGCM_sys_atlas -o ${RUN_DIR}/${R_ATLAS}/OCE_V -l ${PATH_ATLAS}/atlas_p_${RESOL_OCE}_diag0_V.cfg         ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_V.nc
178
179ls ${CARD_DIR}/POST/atlas_p_${RESOL_OCE}_diag0_W.cfg 2>/dev/null 1>&2
180[ ${?} -ne 0 ] && PATH_ATLAS=${FER_ATLAS} || PATH_ATLAS=${CARD_DIR}/POST
181#IGCM_sys_atlas -o ${RUN_DIR}/${R_ATLAS}/OCE_W -l ${PATH_ATLAS}/atlas_p_${RESOL_OCE}_diag0_W.cfg         ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_W.nc
182
183ls ${CARD_DIR}/POST/atlas_p_${RESOL_OCE}_diag0_[defg].cfg 2>/dev/null 1>&2
184[ ${?} -ne 0 ] && PATH_ATLAS=${FER_ATLAS} || PATH_ATLAS=${CARD_DIR}/POST
185IGCM_sys_atlas -o ${RUN_DIR}/${R_ATLAS}/OCE   -l ${PATH_ATLAS}/atlas_p_${RESOL_OCE}_diag0_[defg].cfg     ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_T.nc
186
187ls ${CARD_DIR}/POST/atlas_p_${RESOL_OCE}LIM_diag0_[abc].cfg 2>/dev/null 1>&2
188[ ${?} -ne 0 ] && PATH_ATLAS=${FER_ATLAS} || PATH_ATLAS=${CARD_DIR}/POST
189IGCM_sys_atlas -o ${RUN_DIR}/${R_ATLAS}/ICE   -l ${PATH_ATLAS}/atlas_p_${RESOL_OCE}LIM_diag0_[abc].cfg  ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_icemod.nc
190
[2]191# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
192
193# Put ferret journal files together
[785]194for file in $( ls ${R_ATLAS}/OCE_T/*/*jnl ) ; do
[906]195  echo -e "\n\n################################" ;
196  echo -e "$file\n" ; cat $file ;
[2]197done  > ${R_ATLAS}/OCE_T/allferretscript.txt
198
[906]199for file in $( ls ${R_ATLAS}/OCE_U/*/*jnl ) ; do
200  echo -e "\n\n################################" ;
201  echo -e "$file\n" ; cat $file ;
[2]202done  > ${R_ATLAS}/OCE_U/allferretscript.txt
203
[906]204for file in $( ls ${R_ATLAS}/OCE_V/*/*jnl ) ; do
205  echo -e "\n\n################################" ;
206  echo -e "$file\n" ; cat $file ;
[2]207done  > ${R_ATLAS}/OCE_V/allferretscript.txt
208
[906]209for file in $( ls ${R_ATLAS}/OCE/*/*jnl ) ; do
210  echo -e "\n\n################################" ;
211  echo -e "$file\n" ; cat $file ;
[2]212done  > ${R_ATLAS}/OCE/allferretscript.txt
213
[906]214for file in $( ls ${R_ATLAS}/ICE/*/*jnl ) ; do
215  echo -e "\n\n################################" ;
216  echo -e "$file\n" ; cat $file ;
[2]217done  > ${R_ATLAS}/ICE/allferretscript.txt
218
[74]219# WHILE WAITING FOR A MORE GENERIC SOLUTION
[367]220if ( [ ${config_UserChoices_TagName} = "IPSLCM5" ] || [ ${config_UserChoices_TagName} = "IPSLCM5A" ] || [ ${config_UserChoices_TagName} = "IPSLCM5A-MR" ] || [ ${config_UserChoices_TagName} = "ORCA2_LIM2" ] || [ ${config_UserChoices_TagName} = "ORCA2_LIM2_PISCES" ] ) ; then
[785]221  IGCM_sys_Get ${R_OUT_OCE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_diaptr.nc  ${RUN_DIR} ;
222  atlas -o ${RUN_DIR}/${R_ATLAS}/ZNL   -d -l ${FER_ATLAS}/atlas_l_${RESOL_OCE}_znl.cfg         ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_diaptr.nc ;
223  for file in $( ls ${R_ATLAS}/ZNL/*/*jnl ) ; do
224    echo -e "\n\n################################" ;
225    echo -e "$file\n" ; cat $file ;
226  done > ${R_ATLAS}/ZNL/allferretscript.txt
[74]227fi
228
[2]229# Clear some files
230find . \( -name "*.stdout" -o -name "*.jnl" \) -print -exec rm -f {} \;
231
232# Save files
[587]233IGCM_sys_Put_Dir ATLAS ${R_FIGR}
[2]234IGCM_sys_Rm -Rf ATLAS
[906]235IGCM_sys_Rm ${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_[TUVW].nc
[785]236IGCM_sys_Rm ${config_UserChoices_JobName}_SE_${YEARS}_1M_icemod.nc
[74]237# WHILE WAITING FOR A MORE GENERIC SOLUTION
[367]238if ( [ ${config_UserChoices_TagName} = "IPSLCM5" ] || [ ${config_UserChoices_TagName} = "IPSLCM5A" ] || [ ${config_UserChoices_TagName} = "IPSLCM5A-MR" ] || [ ${config_UserChoices_TagName} = "ORCA2_LIM2" ] || [ ${config_UserChoices_TagName} = "ORCA2_LIM2_PISCES" ] ) ; then
[906]239  IGCM_sys_Rm ${config_UserChoices_JobName}_SE_${YEARS}_1M_diaptr.nc ;
[74]240fi
[2]241
242# DODS copy
[903]243if [ X${config_Post_DodsCopy} = XTRUE ]  ; then
244  IGCM_sys_TestDirArchive ${R_FIGR}/${R_ATLAS}
245  [ $? = 0 ] && IGCM_sys_Put_Dods ${R_ATLAS}
246fi
[203]247
[590]248# Clean RUN_DIR_PATH (necessary for cesium and titane only)
[203]249IGCM_sys_RmRunDir -Rf ${RUN_DIR_PATH}
[1198]250
251# ------------------------------------------------------------------
252# Finalize BigBrother to inform that the jobs end
253# ------------------------------------------------------------------
254IGCM_debug_BigBro_Finalize
Note: See TracBrowser for help on using the repository browser.