Changeset 1603 for trunk/libIGCM/libIGCM_debug

Timestamp:

10/25/23 14:34:02 (7 months ago)

Author:

aclsce

Message:

• Changed libIGCM behaviour in case of pb in pack_output.job : now, we exit from the job if there is any problem, whatever we are in PROD, DEVT, TEST mode.
• Specification of pack frequency per file :

In order to reduce the number of inodes, it is possible to specify by file the frequency of packing. The syntax to do that is in the 4th column of OutputFiles? section of the component.card, for example as follows in lmdz.card :
[OutputFiles?]
List= (histmth.nc, ${R_OUT_ATM_O_M}/${PREFIX}_1M_histmth.nc, Post_1M_histmth, 100Y), \

(histday.nc, ${R_OUT_ATM_O_D}/${PREFIX}_1D_histday.nc, Post_1D_histday, 10Y), \

...

In this example, histmth files will be packed every 100 years and histday files will be packed every 10 years.
The pack frequency you defined in config.card is the frequency of pack by default, that means if a specific frequency of pack is specified for a file in a component.card, this file will be packed at the specific frequency whereas all other files will be packed at global pack frequency (specified in config.card) and in this case, the frequency pack (from the config.card) is the frequency the pack_output job will be launched at.
There is a constraint to use this fonctionality : the Packfrequency you defined in config.card must be greater or equal to the pack frequencies you specified for each type of file in component.card, otherwise the computing job will be stopped (with an explicit error message).
Surpack mode :
A surpack mode functionality is available through the use of pack_output.job. To enable this functionality, you have to put "surpack_mode=y" (default value is n). The way to use is similar to restart post-processing pack_output jobs, as indicated here : ​http://forge.ipsl.jussieu.fr/igcmg_doc/wiki/Doc/CheckDebug#RestartPack_output. You can either use a global pack frequency in config.card or specific pack frequency per file, as explained above.

File:

• trunk/libIGCM/libIGCM_debug/libIGCM_debug.ksh (modified) (1 diff)

trunk/libIGCM/libIGCM_debug/libIGCM_debug.ksh

@@ -880 +880 @@
       case ${postProcessingName} in
       atlas*|monitoring*|metrics*)
-        [ ${postProcessingStopLevel} -gt 2 ] && StopAll=true ;;
+        [ ${postProcessingStopLevel} -gt 2 ] && StopAll=true
+        echo "The job is not a pack job "
+        echo "SO WE DO NOT EXIT THE JOB."
+        echo
+        date
+        ;; 
       create_*)
-        [ ${postProcessingStopLevel} -gt 1 ] && StopAll=true ;;
+        [ ${postProcessingStopLevel} -gt 1 ] && StopAll=true
+        echo "The job is not a pack job "
+        echo "SO WE DO NOT EXIT THE JOB."
+        echo
+        date   
+        ;;
       rebuild*|pack_*)
-        [ ${postProcessingStopLevel} -gt 0 ] && StopAll=true ;;
+          if [ ${postProcessingStopLevel} -gt 0 ] ; then
+      # Notify the computing job that something wrong happened and stop it.
+              IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration PeriodState "Fatal.${Script_Post_Output}"
+          fi
+        echo "                        EXIT THE POST-PROCESSING JOB."
+        echo
+        IGCM_debug_CallStack
+
+        # Inform the rabbitMQ queue
+        IGCM_debug_BigBro_Finalize
+
+        # And Good Bye
+        date
+        exit 1
+        ;;
       esac
       # Notify the computing job that something wrong happened and stop it.
       ( ${StopAll} ) && IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration PeriodState "Fatal.${Script_Post_Output}"
 
-      # If SpaceName is PROD we stop when post_processing failed
-      if [ X${config_UserChoices_SpaceName} = XPROD ] ; then
-        echo "                        EXIT THE POST-PROCESSING JOB."
-        echo
-        IGCM_debug_CallStack
-
-        # Inform the rabbitMQ queue
-        IGCM_debug_BigBro_Finalize
-
-        # And Good Bye
-        date
-        exit 1
-      else
-        echo "In config.card the variable SpaceName is not in PROD"
-        echo "              SO WE DO NOT EXIT THE JOB."
-        echo
-        date
-      fi
     elif [ X${TaskType} = Xchecking ] ; then
       echo "Nothing will happen for now"