Identify to missing history file(s)

When running a long simulation it sometimes happens that a single year is missing from in your store directory. On curie that would be, for example,

/ccc/store/cont003/dsm/p529luy/IGCM_OUT/OL2/PROD/secsto/JOB_NAME/SBG/Output/MO

Recover the missing files from the scratch

Sometimes LibIGCM has difficulties to copy the history files from the scratch to the store. So it is good to first look in the complementary scratch directory.

/ccc/scratch/cont003/dsm/p529luy/IGCM_OUT/OL2/PROD/secsto/JOB_NAME/SBG/Output/MO

If the missing output file(s) are there, manually copy them to the store. Remember to copy both the SBG and SRF files.

Rebuild the missing history file(s)

If your the run did not crash (check run.card) but there is still a history file missing LibIGCM may have encountered a problem with rebuild job. To check whether this is the case you should find the same number of stomate and sechiba files as the number of processors you are running with. Thus if you run with 32 procs the rebuild folder should contain 64 files.