| 37 | | = VARGAS IBM power 6 at IDRIS = |
| 38 | | The executable create_etat0_limit or ce0l compiled in parallel mode does not finalize correctly at vargas. The files are created but the job exits with error message |
| 39 | | '''''ERROR: 0032-184 MPI was not finalized in routine unknown, task 0'''''. The files are saved to archive but as the job exits abnormaly it is not possible to loop over several years. |
| | 37 | = Problems running at VARGAS? = |
| | 38 | * You should not compile with -O5 at VARGAS. Compile with -O3 or lower optimization. Default compiler xlf 13.1.0.3 is ok with -O3. |
| | 39 | * If the executable create_etat0_limit or ce0l exits with following error message you need to update your LMDZ version to revision 1476 at branch LMDZ4_AR5 or higher : |
| | 40 | '''''ERROR: 0032-184 MPI was not finalized in routine unknown, task 0''''' |
| | 41 | * Check memory in your job. For higher resolutions you may need to add threads just to have more memory. You must then compile in mpi mode (default for create_etat0_limit.e.para) and not mixt mpi_openmpi. In your job, add '''@ parallel_threads = 8'''. This gives you 8 times more memory per process mpi availible and you can multiply data_limit and stack_limit by 8. When adding threads you should remove '''@ resources = !ConsumableCpus(1)'''. For exemple for resolution 280x280x39 put in your job : |
| | 42 | |
| | 43 | {{{ |
| | 44 | # @ total_tasks = 32 |
| | 45 | # @ environment = "BATCH_NUM_PROC_TOT=32" |
| | 46 | # @ parallel_threads = 8 |
| | 47 | # @ data_limit = 18.0gb |
| | 48 | # @ stack_limit = 6.0gb,6.0gb |
| | 49 | ### @ resources = ConsumableCpus(1) |
| | 50 | }}} |
| | 51 | |
| | 52 | * At VARGAS you must desactivate the filtre fft. In run.def set '''use_filtre_fft = n'''. |
| | 53 | |
| | 54 | |
