Context Navigation

source: trunk/libIGCM/AA_create_se @ 238

Last change on this file since 238 was 238, checked in by sdipsl, 14 years ago
Protect rebuild.ksh creation in case of DRYRUNaaaa Bugfix regarding backward compatibility : IGCM_card_DefineArrayFromOption ${card} ${flag_post} Seasonal will produce an array, take that into account whentesting his value
Property licence set to The following licence information concerns ONLY the libIGCM tools ================================================================== Copyright © Centre National de la Recherche Scientifique CNRS Commissariat à l'Énergie Atomique CEA libIGCM : Library for Portable Models Computation of IGCM Group. IGCM Group is the french IPSL Global Climate Model Group. This library is a set of shell scripts and functions whose purpose is the management of the initialization, the launch, the transfer of output files, the post-processing and the monitoring of datas produce by any numerical program on any plateforme. This software is governed by the CeCILL license under French law and abiding by the rules of distribution of free software. You can use, modify and/ or redistribute the software under the terms of the CeCILL license as circulated by CEA, CNRS and INRIA at the following URL "http://www.cecill.info". As a counterpart to the access to the source code and rights to copy, modify and redistribute granted by the license, users are provided only with a limited warranty and the software's author, the holder of the economic rights, and the successive licensors have only limited liability. In this respect, the user's attention is drawn to the risks associated with loading, using, modifying and/or developing or reproducing the software by the user in light of its specific status of free software, that may mean that it is complicated to manipulate, and that also therefore means that it is reserved for developers and experienced professionals having in-depth computer knowledge. Users are therefore encouraged to load and test the software's suitability as regards their requirements in conditions enabling the security of their systems and/or data to be ensured and, more generally, to use and operate it in the same conditions as regards security. The fact that you are presently reading this means that you have had knowledge of the CeCILL license and that you accept its terms. Property svn:keywords set to `Date Author Revision`
File size: 21.7 KB

Line
1	#-Q- platine #!/usr/bin/ksh
2	#-Q- platine ###################
3	#-Q- platine ## PLATINE CEA ##
4	#-Q- platine ###################
5	#-Q- platine #BSUB -J SE # Nom du job
6	#-Q- platine #BSUB -N # message a la fin du job
7	#-Q- platine #BSUB -n 1 # reservation des processeurs pour le job
8	#-Q- platine #BSUB -W 1:00 # Limite temps
9	#-Q- platine #BSUB -q post # Passage en queue post
10	#-Q- sx8brodie #!/bin/ksh
11	#-Q- sx8brodie #######################
12	#-Q- sx8brodie ## SX8BRODIE IDRIS ##
13	#-Q- sx8brodie #######################
14	#-Q- sx8brodie # Temps Elapsed max. d'une requete hh:mm:ss
15	#-Q- sx8brodie # @ wall_clock_limit = 20:00:00
16	#-Q- sx8brodie # Nom du travail LoadLeveler
17	#-Q- sx8brodie # @ job_name = SE
18	#-Q- sx8brodie # Fichier de sortie standard du travail
19	#-Q- sx8brodie # @ output = $(job_name).$(jobid)
20	#-Q- sx8brodie # Fichier de sortie d'erreur du travail
21	#-Q- sx8brodie # @ error = $(job_name).$(jobid)
22	#-Q- sx8brodie # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
23	#-Q- sx8brodie # @ notification = error
24	#-Q- sx8brodie # @ environment = $DEBUG_debug ; $MODIPSL ; $libIGCM ; $libIGCM_SX ; $SUBMIT_DIR ; $REBUILD_DIR ; $RebuildFromArchive ; $POST_DIR ; $MASTER ; $DateBegin ; $PeriodDateBegin ; $PeriodDateEnd ; $NbRebuildDir ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $RESOL_SBG ; $MASTER
25	#-Q- sx8brodie # @ queue
26	#-Q- aix6 #!/bin/ksh
27	#-Q- aix6 #######################
28	#-Q- aix6 ## VARGAS IDRIS ##
29	#-Q- aix6 #######################
30	#-Q- aix6 # Temps Elapsed max. d'une requete hh:mm:ss
31	#-Q- aix6 # @ wall_clock_limit = 20:00:00
32	#-Q- aix6 # Nom du travail LoadLeveler
33	#-Q- aix6 # @ job_name = SE
34	#-Q- aix6 # Fichier de sortie standard du travail
35	#-Q- aix6 # @ output = $(job_name).$(jobid)
36	#-Q- aix6 # Fichier de sortie d'erreur du travail
37	#-Q- aix6 # @ error = $(job_name).$(jobid)
38	#-Q- aix6 # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
39	#-Q- aix6 # @ notification = error
40	#-Q- aix6 # @ environment = $DEBUG_debug ; $MODIPSL ; $libIGCM ; $libIGCM_SX ; $SUBMIT_DIR ; $REBUILD_DIR ; $RebuildFromArchive ; $POST_DIR ; $MASTER ; $DateBegin ; $PeriodDateBegin ; $PeriodDateEnd ; $NbRebuildDir ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $RESOL_SBG ; $MASTER
41	#-Q- aix6 # @ queue
42	#-Q- sx8mercure #!/bin/ksh
43	#-Q- sx8mercure ######################
44	#-Q- sx8mercure ## SX8MERCURE CEA ##
45	#-Q- sx8mercure ######################
46	#-Q- sx8mercure #PBS -N SE # Nom du job
47	#-Q- sx8mercure #PBS -j o # regroupement des stdout et stderr
48	#-Q- sx8mercure #PBS -S /usr/bin/ksh # shell de soumission
49	#-Q- sx8mercure #PBS -l memsz_job=1gb # Limite memoire a 1 Go
50	#-Q- sx8mercure #PBS -l cputim_job=1:00:00 # Limite temps a 1 heures
51	#-Q- sx8mercure #PBS -q scalaire
52	#-Q- sx9mercure #!/bin/ksh
53	#-Q- sx9mercure ######################
54	#-Q- sx9mercure ## SX9MERCURE CEA ##
55	#-Q- sx9mercure ######################
56	#-Q- sx9mercure #MSUB -r SE # Nom du job
57	#-Q- sx9mercure #MSUB -N 1 # Reservation du noeud
58	#-Q- sx9mercure #MSUB -n 1 # Reservation du processus
59	#-Q- sx9mercure #MSUB -T 86400 # Limite de temps elapsed du job
60	#-Q- sx9mercure #MSUB -E "-j o"
61	#-Q- sx9mercure #MSUB -E "-S /bin/ksh"
62	#-Q- sx9mercure ##MSUB -e nco.out # Sortie standard
63	#-Q- sx9mercure ##MSUB -o nco.out # Sortie standard
64	#-Q- titane #!/bin/ksh
65	#-Q- titane ######################
66	#-Q- titane ## TITANE CEA ##
67	#-Q- titane ######################
68	#-Q- titane #MSUB -r SE # Nom du job
69	#-Q- titane #MSUB -N 1 # Reservation du noeud
70	#-Q- titane #MSUB -n 1 # Reservation du processus
71	#-Q- titane #MSUB -T 86400 # Limite de temps elapsed du job
72	#-Q- titane #MSUB -E "-j o"
73	#-Q- titane #MSUB -E "-S /bin/ksh"
74	#-Q- titane ##MSUB -e nco.out # Sortie standard
75	#-Q- titane ##MSUB -o nco.out # Sortie standard
76	#-Q- default #!/bin/ksh
77	#-Q- default ##################
78	#-Q- default ## DEFAULT HOST ##
79	#-Q- default ##################
80
81	# $Date$
82	# $Author$
83	# $Revision$
84	# IPSL (2006)
85	# This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
86
87	#set -eu
88	#set -vx
89
90	date
91
92	#-Q- sx8brodie export OMP_NUM_THREADS=1
93	#-Q- aix6 export OMP_NUM_THREADS=1
94
95	########################################################################
96
97	#D- Flag to determine if this job in a standalone mode
98	#D- Default : value from AA_job if any
99	StandAlone=${StandAlone:=true}
100
101	#D- Low level debug : to bypass lib test checks and stack construction
102	#D- Default : value from AA_job if any
103	libIGCM=${libIGCM:=::modipsl::/libIGCM}
104	# WARNING for StandAlone used : To run this script on some machine,
105	# you must check MirrorlibIGCM variable in sys library.
106	# If this variable is true, you must use libIGCM_POST path instead
107	# of your running libIGCM directory.
108
109	#D- Flag to determine if rebuild process has been performed asynchronously
110	#D- Possible value true or false.
111	#D- If true raw files has allready been patched by rebuild job
112	#D- If false create_ts will patch the raw files
113	#D- Default : Value from AA_job if any. Usefull in StandAlone case.
114	RebuildFrequency=${RebuildFrequency:=true}
115
116	#D- Flag to determine atlas job's output directory
117	#D- Default : value from libIGCM_post.ksh if any
118	POST_DIR=${POST_DIR:=${PBS_O_WORKDIR}}
119
120	#D- Increased verbosity (1, 2, 3)
121	#D- Default : value from AA_job if any
122	Verbosity=${Verbosity:=3}
123
124	#D- Low level debug : to bypass lib test checks and stack construction
125	#D- Default : value from AA_job if any
126	DEBUG_debug=${DEBUG_debug:=false}
127
128	#D- TEMPORARY Flag to determine atmospheric resolution
129	#D- Default : value from atmospheric driver if any
130	RESOL_ATM=${RESOL_ATM:=ALL}
131
132	#D- TEMPORARY Flag to determine ocean resolution
133	#D- Default : value from ocean driver if any
134	RESOL_OCE=${RESOL_OCE:=ORCA2}
135
136	#D- TEMPORARY Flag to determine ice resolution
137	#D- Default : value from ice driver if any
138	RESOL_ICE=${RESOL_ICE:=ORCA2}
139
140	#D- TEMPORARY Flag to determine marine biogeochemistry resolution
141	#D- Default : value from ice driver if any
142	RESOL_MBG=${RESOL_MBG:=ORCA2}
143
144	#D- Flag to determine surface resolution
145	#D- Default : value from surface driver if any
146	RESOL_SRF=ALL
147
148	#D- Flag to determine surface resolution
149	#D- Default : value from surface driver if any
150	RESOL_SBG=ALL
151
152	########################################################################
153
154	. ${libIGCM}/libIGCM_debug/libIGCM_debug.ksh
155	( ${DEBUG_debug} ) && IGCM_debug_Check
156	. ${libIGCM}/libIGCM_card/libIGCM_card.ksh
157	( ${DEBUG_debug} ) && IGCM_card_Check
158	. ${libIGCM}/libIGCM_date/libIGCM_date.ksh
159	( ${DEBUG_debug} ) && IGCM_date_Check
160	#-------
161	. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh
162
163	########################################################################
164
165	#set -vx
166
167	IGCM_sys_MkdirWork ${RUN_DIR_PATH}
168	IGCM_sys_Cd ${RUN_DIR_PATH}
169
170	if [ ${StandAlone} = true ] ; then
171	CARD_DIR=${SUBMIT_DIR}
172	else
173	CARD_DIR=${RUN_DIR_PATH}/$( basename ${SUBMIT_DIR} )
174	IGCM_sys_Get_Master ${SUBMIT_DIR} ${RUN_DIR_PATH}
175	fi
176
177	#
178	# First of all
179	#
180	IGCM_card_DefineArrayFromSection ${CARD_DIR}/config.card UserChoices
181	typeset option
182	for option in ${config_UserChoices[*]} ; do
183	IGCM_card_DefineVariableFromOption ${CARD_DIR}/config.card UserChoices ${option}
184	done
185	#
186	echo
187	IGCM_debug_Print 1 "DefineArrayFromOption : config_UserChoices"
188	IGCM_debug_PrintVariables 3 config_UserChoices_JobName
189	IGCM_debug_PrintVariables 3 config_UserChoices_LongName
190	IGCM_debug_PrintVariables 3 config_UserChoices_TagName
191	IGCM_debug_PrintVariables 3 config_UserChoices_CalendarType
192	IGCM_debug_PrintVariables 3 config_UserChoices_DateBegin
193	IGCM_debug_PrintVariables 3 config_UserChoices_DateEnd
194	IGCM_debug_PrintVariables 3 config_UserChoices_PeriodLength
195	echo
196
197	#==================================
198
199	R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
200	#
201	IGCM_card_DefineArrayFromSection ${CARD_DIR}/config.card ListOfComponents
202	#
203	IGCM_card_DefineVariableFromOption ${CARD_DIR}/config.card Post SeasonalFrequency
204	#
205	# Determine period for seasonnal average. Default : value from AA_job if any
206	#
207	DateBegin=${DateBegin:=$( IGCM_date_ConvertFormatToGregorian ${config_UserChoices_DateBegin} )}
208	#
209	PeriodDateEnd=${PeriodDateEnd:=$( IGCM_date_ConvertFormatToGregorian ${config_UserChoices_DateEnd} )}
210	#
211	freq=$( echo ${config_Post_SeasonalFrequency} \| sed -e "s/[yY]//" )
212	#
213	an_fin=$(( $( IGCM_date_ConvertGregorianDateToJulian ${PeriodDateEnd} ) / 1000 ))
214	an_deb=$( IGCM_date_YearDigit $(( an_fin - freq + 1 )) )
215	an_fin=$( IGCM_date_YearDigit ${an_fin} )
216	#
217	# For each component selected determine which files need post-processing
218	#
219	for comp in ${config_ListOfComponents[*]} ; do
220	#
221	IGCM_card_DefineArrayFromOption ${CARD_DIR}/config.card ListOfComponents ${comp}
222	eval compname=\${config_ListOfComponents_${comp}[0]} > /dev/null 2>&1
223	#
224	card=${CARD_DIR}/COMP/${compname}.card
225	IGCM_card_DefineArrayFromOption ${card} OutputFiles List
226	#
227	ListFilesName=${compname}_OutputFiles_List
228	eval FileName0=\${${ListFilesName}[0]} > /dev/null 2>&1
229	#
230	if [ X${FileName0} != X${NULL_STR} ] ; then
231	#
232	# INITIALISATION
233	#
234	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
235	typeset i=2
236	#
237	until [ $i -eq $NbFiles ]; do
238	#
239	eval flag_post_=\${${ListFilesName}[$i]} > /dev/null 2>&1
240	eval flag_post=${flag_post_}
241	#
242	if [ X${flag_post} != XNONE ] ; then
243	#
244	# Check if seasonal is required for this file
245	#
246	IGCM_card_DefineArrayFromOption ${card} ${flag_post} Seasonal
247	#
248	# If option is not found (old cards) put SEASONAL ON by default
249	#
250	if [ "$( eval echo \${${compname}_${flag_post}_Seasonal[*]} )" = "Option not found ${flag_post}" ] ; then
251	eval ${compname}_${flag_post}_Seasonal=ON
252	fi
253	#
254	if [ ! X$( eval echo \${${compname}_${flag_post}_Seasonal} ) = XON ] ; then
255	continue
256	fi
257	#
258	# CREATE LIST
259	#
260	FILE=$( echo ${flag_post} \| awk "-FPost_" '{print $2}' )
261	#
262	DIRECTORY=${R_SAVE}/${comp}/Analyse/SE
263	#
264	TestedFile=${config_UserChoices_JobName}_SE_${an_deb}_${an_fin}_${FILE}.nc
265	#
266	IGCM_sys_TestFileArchive ${DIRECTORY}/${TestedFile}
267	if [ ! $? = 0 ] ; then
268	eval set +A LISTE_FILE_${comp} \$\{LISTE_FILE_${comp}[*]} ${FILE}
269	if [ ! ${RebuildFrequency} = true ] ; then
270	IGCM_card_DefineArrayFromOption ${card} Post_${FILE} Patches
271	eval set +A LISTE_PATCHES_${FILE} \$\{${compname}_Post_${FILE}_Patches[*]}
272	if [ X$( eval echo \${LISTE_PATCHES_${FILE}[0]} ) != X${NULL_STR} ]; then
273	for Patch in $( eval echo \${LISTE_PATCHES_${FILE}[*]} ); do
274	if [ Xload${Patch} != X ] ; then
275	. ${libIGCM}/libIGCM_post/IGCM_${Patch}.ksh
276	eval load${Patch}=loaded
277	fi
278	done
279	fi
280	fi
281	fi
282	fi
283	let $(( i=i+3 ))
284	done # until [ $i -eq $NbFiles ]
285	fi
286	done # for comp
287
288	for comp in ${config_ListOfComponents[*]} ; do
289	#
290	eval R_OUT_${comp}=${R_SAVE}/${comp}
291	#
292	i=0
293	for file in $( eval echo \${LISTE_FILE_${comp}[*]} ); do
294	#
295	# Determine in which output can we find file
296	# IE : Output/MO or Output/DA or ...
297	#
298	FlagDir=$( echo ${file} \| awk -F "_" '{print $1}' )
299	case ${FlagDir} in
300	1Y) FreqDir=YE ;;
301	1M) FreqDir=MO ;;
302	5D\|1D) FreqDir=DA ;;
303	HF) FreqDir=HF ;;
304	INS) FreqDir=INS ;;
305	esac
306	#
307	RESULT_SE=${config_UserChoices_JobName}_SE_${an_deb}_${an_fin}_${file}.nc
308	# Do not redoo an existing SE
309	IGCM_sys_TestFileArchive ${R_SAVE}/${comp}/Analyse/SE/${RESULT_SE}
310	if [ $? = 0 ] ; then
311	continue
312	fi
313	#
314	eval file_path=\${R_OUT_${comp}}/Output/${FreqDir}/
315	#
316	case ${config_UserChoices_PeriodLength} in
317	# For Yearly simulation :
318	1Y\|1y)
319	(( an = an_deb ))
320	# Initialize array
321	#set -A liste_file_se
322	#set -A liste_file_se_tmp
323	unset liste_file_se
324	unset liste_file_se_tmp
325	while [ ${an} -le ${an_fin} ] ; do
326	moisL=$( IGCM_date_DaysInMonth ${an} ${mois} )
327	#
328	an4=$(printf "%04i\n" ${an} )
329	#
330	diy=$( IGCM_date_DaysInYear $an4 )
331	afin=$( IGCM_date_AddDaysToGregorianDate ${an4}0101 $(( diy - 1 )) )
332	date=${an4}0101_${afin}
333	#set +A liste_file_se ${liste_file_se[*]} ${file_path}${config_UserChoices_JobName}_${date}_${file}.nc
334	#set +A liste_file_se_tmp ${liste_file_se_tmp[*]} ${config_UserChoices_JobName}_${date}_${file}.nc
335	liste_file_se[${#liste_file_se[*]}]=${file_path}${config_UserChoices_JobName}_${date}_${file}.nc
336	liste_file_se_tmp[${#liste_file_se_tmp[*]}]=${config_UserChoices_JobName}_${date}_${file}.nc
337	(( an = an + 1 ))
338	done
339	#
340	IGCM_sys_Get /l liste_file_se[*] ${RUN_DIR_PATH}
341	eval ExitFlag=false
342	IGCM_debug_Verif_Exit_Post
343
344	# Apply IGCM_Patch if needed
345	if [ ! ${RebuildFrequency} = true ] ; then
346	if [ X$( eval echo \${LISTE_PATCHES_${file}[0]} ) != X${NULL_STR} ]; then
347	for file_t in $( eval echo ${liste_file_se_tmp[*]} ); do
348	for Patch in $( eval echo \${LISTE_PATCHES_${file}[*]} ); do
349	IGCM_${Patch} ${file_t}
350	done
351	done
352	fi
353	fi
354
355	# Search of common list of variables to be treated
356	nbfile=0
357	for file_common_var in ${liste_file_se_tmp[*]} ; do
358	ncks -m ${file_common_var} \| grep '# dim. =' \| cut -d ':' -f 1 >> tmpfile_ncra
359	let nbfile=nbfile+1
360	done
361	list_var_final_ncra=`cat tmpfile_ncra \| sort \| uniq -c \| awk -v nbfile=$nbfile '{if ($1 == nbfile) {print $2}}' \| paste -s -d ','`
362	IGCM_sys_Rm tmpfile_ncra
363
364	for mois in 01 02 03 04 05 06 07 08 09 10 11 12 ; do
365	#
366	(( nb = ${mois} - 1 ))
367	#
368	OUT_SE[${nb}]=${config_UserChoices_JobName}_SE${mois}_${an_deb}_${an_fin}_${file}.nc
369	IGCM_sys_ncra -O -v ${list_var_final_ncra} -d time_counter,${nb},,12 ${liste_file_se_tmp[*]} ${OUT_SE[${nb}]}
370	done
371	IGCM_sys_Rm ${liste_file_se_tmp[*]}
372	eval ExitFlag=false
373	IGCM_debug_Verif_Exit_Post
374	;;
375	# For Monthly simulation :
376	1M\|1m)
377	for mois in 01 02 03 04 05 06 07 08 09 10 11 12 ; do
378	#
379	(( nb = ${mois} - 1 ))
380	#
381	OUT_SE[${nb}]=${config_UserChoices_JobName}_SE${mois}_${an_deb}_${an_fin}_${file}.nc
382	#
383	(( an = an_deb ))
384	# Initialize array
385	#set -A liste_file_se
386	#set -A liste_file_se_tmp
387	unset liste_file_se
388	unset liste_file_se_tmp
389	while [ ${an} -le ${an_fin} ] ; do
390	moisL=$( IGCM_date_DaysInMonth ${an} ${mois} )
391	#
392	an4=$(printf "%04i\n" ${an} )
393	#
394	date=${an4}${mois}01_${an4}${mois}${moisL}
395	#set +A liste_file_se ${liste_file_se[*]} ${file_path}${config_UserChoices_JobName}_${date}_${file}.nc
396	#set +A liste_file_se_tmp ${liste_file_se_tmp[*]} ${config_UserChoices_JobName}_${date}_${file}.nc
397	liste_file_se[${#liste_file_se[*]}]=${file_path}${config_UserChoices_JobName}_${date}_${file}.nc
398	liste_file_se_tmp[${#liste_file_se_tmp[*]}]=${config_UserChoices_JobName}_${date}_${file}.nc
399
400	(( an = an + 1 ))
401	done
402	#
403	IGCM_sys_Get /l liste_file_se[*] ${RUN_DIR_PATH}
404	eval ExitFlag=false
405	IGCM_debug_Verif_Exit_Post
406
407	# Apply IGCM_Patch if needed
408	if [ ! ${RebuildFrequency} = true ] ; then
409	if [ X$( eval echo \${LISTE_PATCHES_${file}[0]} ) != X${NULL_STR} ]; then
410	for file_t in $( eval echo ${liste_file_se_tmp[*]} ); do
411	for Patch in $( eval echo \${LISTE_PATCHES_${file}[*]} ); do
412	IGCM_${Patch} ${file_t}
413	done
414	done
415	fi
416	fi
417
418	# Search of common list of variables to be treated
419	nbfile=0
420	for file_common_var in ${liste_file_se_tmp[*]} ; do
421	ncks -m ${file_common_var} \| grep '# dim. =' \| cut -d ':' -f 1 >> tmpfile_ncra
422	let nbfile=nbfile+1
423	done
424	list_var_final_ncra=`cat tmpfile_ncra \| sort \| uniq -c \| awk -v nbfile=$nbfile '{if ($1 == nbfile) {print $2}}' \| paste -s -d ','`
425	IGCM_sys_Rm tmpfile_ncra
426	IGCM_sys_ncra -O -v ${list_var_final_ncra} ${liste_file_se_tmp[*]} ${OUT_SE[${nb}]}
427
428	IGCM_sys_Rm ${liste_file_se_tmp[*]}
429	eval ExitFlag=false
430	IGCM_debug_Verif_Exit_Post
431	done
432	;;
433	D\|d)
434	for mois in 01 02 03 04 05 06 07 08 09 10 11 12 ; do
435	#
436	(( nb = ${mois} - 1 ))
437	#
438	OUT_SE[${nb}]=${config_UserChoices_JobName}_SE${mois}_${an_deb}_${an_fin}_${file}.nc
439	#
440	(( an = an_deb ))
441	# Initialize array
442	#set -A liste_file_se
443	#set -A liste_file_se_tmp
444	unset liste_file_se
445	unset liste_file_se_tmp
446	while [ ${an} -le ${an_fin} ] ; do
447	moisL=$( IGCM_date_DaysInMonth ${an} ${mois} )
448	#
449	an4=$(printf "%04i\n" ${an} )
450	#
451	length_d=$(( ${config_UserChoices_PeriodLength} - 1 ))
452	# for one day
453	if [ ${length_d} -eq 1 ] ; then
454	(( length_d = 0 ))
455	fi
456	(( day = 1 ))
457	while [ ${day} -le ${moisL} ] ; do
458	day2=$(printf "%02i\n" ${day} )
459	day_beg=${an4}${mois}${day2}
460	day_end=$( IGCM_date_AddDaysToGregorianDate ${day_beg} ${length_d} )
461	date=${an4}${mois}${day_beg}_${an4}${mois}${day_end}
462	#set +A liste_file_se ${liste_file_se[*]} ${file_path}${config_UserChoices_JobName}_${date}_${file}.nc
463	#set +A liste_file_se_tmp ${liste_file_se_tmp[*]} ${config_UserChoices_JobName}_${date}_${file}.nc
464	liste_file_se[${#liste_file_se[*]}]=${file_path}${config_UserChoices_JobName}_${date}_${file}.nc
465	liste_file_se_tmp[${#liste_file_se_tmp[*]}]=${config_UserChoices_JobName}_${date}_${file}.nc
466	(( day = day + 1 ))
467	done
468	(( an = an + 1 ))
469	done
470	#
471	IGCM_sys_Get /l liste_file_se[*] ${RUN_DIR_PATH}
472	eval ExitFlag=false
473	IGCM_debug_Verif_Exit_Post
474
475	# Apply IGCM_Patch if needed
476	if [ ! ${RebuildFrequency} = true ] ; then
477	if [ X$( eval echo \${LISTE_PATCHES_${file}[0]} ) != X${NULL_STR} ]; then
478	for file_t in $( eval echo ${liste_file_se_tmp[*]} ); do
479	for Patch in $( eval echo \${LISTE_PATCHES_${file}[*]} ); do
480	IGCM_${Patch} ${file_t}
481	done
482	done
483	fi
484	fi
485
486	# Search of common list of variables to be treated
487	nbfile=0
488	for file_common_var in ${liste_file_se_tmp[*]} ; do
489	ncks -m ${file_common_var} \| grep '# dim. =' \| cut -d ':' -f 1 >> tmpfile_ncra
490	let nbfile=nbfile+1
491	done
492	list_var_final_ncra=`cat tmpfile_ncra \| sort \| uniq -c \| awk -v nbfile=$nbfile '{if ($1 == nbfile) {print $2}}' \| paste -s -d ','`
493	IGCM_sys_Rm tmpfile_ncra
494
495	IGCM_sys_ncra -O -v ${list_var_final_ncra} ${liste_file_se_tmp[*]} ${OUT_SE[${nb}]}
496	IGCM_sys_Rm ${liste_file_se_tmp[*]}
497	eval ExitFlag=false
498	IGCM_debug_Verif_Exit_Post
499	done
500	;;
501	esac
502	#
503
504	# Search of common list of variables to be treated
505	nbfile=0
506	for file_common_var in ${OUT_SE[*]} ; do
507	ncks -m ${file_common_var} \| grep '# dim. =' \| cut -d ':' -f 1 >> tmpfile_ncrcat
508	let nbfile=nbfile+1
509	done
510	list_var_final_ncrcat=`cat tmpfile_ncrcat \| sort \| uniq -c \| awk -v nbfile=$nbfile '{if ($1 == nbfile) {print $2}}' \| paste -s -d ','`
511	IGCM_sys_Rm tmpfile_ncrcat
512
513	IGCM_sys_ncrcat -O -v ${list_var_final_ncrcat} ${OUT_SE[*]} ${RESULT_SE}
514	#
515	IGCM_sys_Rm ${OUT_SE[*]}
516	#
517	${ncatted} -a modulo,time_counter,c,c," " ${RESULT_SE}
518	#
519	eval IGCM_sys_Put_Out ${RESULT_SE} \${R_OUT_${comp}}/Analyse/SE/${RESULT_SE}
520	IGCM_sys_Rm ${RESULT_SE}
521	#
522	eval ExitFlag=false
523	IGCM_debug_Verif_Exit_Post
524	done
525	done
526
527	# DODS copy
528	for comp in ${config_ListOfComponents[*]} ; do
529	IGCM_sys_TestDirArchive ${R_SAVE}/${comp}/Analyse/SE
530	[ $? = 0 ] && IGCM_sys_Put_Dods ${comp}/Analyse/SE
531	done
532
533	YEARS=${an_deb}_${an_fin}
534
535	export POST_DIR; export SUBMIT_DIR; export libIGCM; export R_INIT; export R_BC; export StandAlone
536	export RESOL_ATM; export RESOL_OCE ; export RESOL_ICE ; export RESOL_MBG ; export RESOL_SRF ; export RESOL_SBG
537	export R_SAVE; export config_UserChoices_JobName; export config_UserChoices_TagName; export YEARS;
538	listVarEnv="POST_DIR,SUBMIT_DIR,libIGCM,R_INIT,R_BC,StandAlone,RESOL_ATM,RESOL_OCE,RESOL_ICE,RESOL_MBG,RESOL_SRF,RESOL_SBG,R_SAVE,config_UserChoices_JobName,config_UserChoices_TagName,YEARS"
539	export listVarEnv;
540
541	#D-
542	# --------------------------------------------------------------------
543	#D- Test if all was right before ATLAS
544	# --------------------------------------------------------------------
545	IGCM_debug_Verif_Exit_Post
546
547	if [ ${config_UserChoices_TagName} = "IPSLCM4_v1_OASIS3" ] \|\| \
548	[ ${config_UserChoices_TagName} = "IPSLCM4_v2" ] \|\| \
549	[ ${config_UserChoices_TagName} = "IPSL_ESM_V1" ] ; then
550	#
551	IGCM_sys_QsubPost atlas_ORCHIDEE ;
552	IGCM_sys_QsubPost atlas_LMDZ ;
553	IGCM_sys_QsubPost atlas_ORCA_LIM ;
554	IGCM_sys_QsubPost additionnal ;
555	#
556	elif [ ${config_UserChoices_TagName} = "IPSLCM5" ] ; then
557	IGCM_sys_QsubPost atlas_ORCHIDEE ;
558	IGCM_sys_QsubPost atlas_LMDZ ;
559	IGCM_sys_QsubPost atlas_ORCA_LIM ;
560	#
561	elif [ ${config_UserChoices_TagName} = "LMDZ4OR" ] \|\| \
562	[ ${config_UserChoices_TagName} = "LMDZOR" ] \|\| \
563	[ ${config_UserChoices_TagName} = "LMDZ4OR_v2" ] ; then
564	#
565	IGCM_sys_QsubPost atlas_LMDZ ;
566	IGCM_sys_QsubPost atlas_ORCHIDEE ;
567	#
568	elif [ ${config_UserChoices_TagName} = "LMDZ" ] ; then
569	#
570	IGCM_sys_QsubPost atlas_LMDZ ;
571	#
572	elif [ ${config_UserChoices_TagName} = "OL" ] \|\| \
573	[ ${config_UserChoices_TagName} = "OL2" ] ; then
574	#
575	IGCM_sys_QsubPost atlas_ORCHIDEE ;
576	#
577	elif [ ${config_UserChoices_TagName} = "ORCA2_LIM" ] \|\|
578	[ ${config_UserChoices_TagName} = "ORCA2_LIM2" ] \|\|
579	[ ${config_UserChoices_TagName} = "ORCA2_LIM2_PISCES" ] ; then
580	#
581	IGCM_sys_QsubPost atlas_ORCA_LIM ;
582	# IGCM_sys_QsubPost additionnal ;
583	#
584	fi
585
586	# Clean RUN_DIR_PATH (necessary for cesium)
587	IGCM_sys_RmRunDir -Rf ${RUN_DIR_PATH}

Note: See TracBrowser for help on using the repository browser.

Download in other formats: