Changeset 157 for trunk/libIGCM/AA_rebuild_fromArchive

Timestamp:

08/14/09 17:58:55 (15 years ago)

Author:

sdipsl

Message:

• RebuildFromWorkdir? is back. Will use BIG_DIR as temp storage directory
  • ideally RUN_DIR_PATH and BIG_DIR are on the same filesystem (mv REBUILD_DIR BIG_DIR)
  • save lot of time between iteration for IO intensive simulation up to 3 minutes by iteration for CMIP5 like IO.
• rebuild.ksh will be usable as it is (in case you need to run it by hand)
• clean Up : if rebuild run smoothly we clean everything (either FromArchive? or FromWorkdir?)
• Watch your quota on the BIG_DIR (SCRATCHDIR OR WORKDIR depending on machine) before you play with that.

File:

• trunk/libIGCM/AA_rebuild_fromArchive (modified) (2 diffs)

trunk/libIGCM/AA_rebuild_fromArchive

@@ -123 +123 @@
 #set -vx
 
-if [ ${RebuildFromArchive} = true ] ; then
-    RUN_DIR=${RUN_DIR_PATH}
-    ListAllRebuildDir=$( IGCM_sys_RshArchive ls -d ${REBUILD_DIR}/REBUILD_* | grep -B $(( ${NbRebuildDir} -1 )) ${PeriodDateBegin} )
-else
-    RUN_DIR=${REBUILD_DIR}
-    ListAllRebuildDir=$( ls -d ${REBUILD_DIR}/REBUILD_* | grep  ${PeriodDateBegin} | tail -${NbRebuildDir} )
-fi
+RUN_DIR=${RUN_DIR_PATH}
+ListAllRebuildDir=$( IGCM_sys_RshArchive ls -d ${REBUILD_DIR}/REBUILD_* | grep -B $(( ${NbRebuildDir} -1 )) ${PeriodDateBegin} )
+#
 IGCM_sys_Cd ${RUN_DIR}
 
 for directory in ${ListAllRebuildDir} ; do
     #
-    if [ ${RebuildFromArchive} = true ] ; then
-        IGCM_sys_Get_Dir ${directory} ${RUN_DIR}
-    fi
+    IGCM_sys_Get_Dir ${directory} ${RUN_DIR}
+    #
     IGCM_sys_Cd ${RUN_DIR}/$( basename ${directory} )
-    # --------------------------------------------------------------------
-    # Function define in rebuild.ksh has not been closed yet. Do it now
-    # --------------------------------------------------------------------
-    echo IGCM_debug_PopStack "IGCM_FlushRebuild" >> rebuild.ksh
-    echo }                                       >> rebuild.ksh
 
-    IGCM_sys_Put_Out rebuild.ksh ${directory}
     # --------------------------------------------------------------------
     # Source function include in the REBUILD ksh and rebuild
@@ -153 +142 @@
     IGCM_sys_Cd ${RUN_DIR}
     # Clean Up
-    #IGCM_sys_RshArchive IGCM_sys_Rm -rf ${directory}
+    IGCM_sys_RshArchive rm -rf ${directory}
 done