| 98 | | * You should not compile with -O5 at VARGAS. Compile with -O3 or lower optimization. Default compiler xlf 13.1.0.3 is ok with -O3. |
| 99 | | * If the executable create_etat0_limit or ce0l exits with following error message you need to update your LMDZ version to revision 1476 at branch LMDZ4_AR5 or higher : |
| 100 | | '''''ERROR: 0032-184 MPI was not finalized in routine unknown, task 0''''' |
| 101 | | * Check memory in your job. For higher resolutions you may need to add threads just to have more memory. You must then compile in mpi mode (default for create_etat0_limit.e.para) and not mix mpi_openmpi. In your job, add '''@ parallel_threads = 8'''. This gives you 8 times more memory per process mpi available and you can multiply data_limit and stack_limit by 8. When adding threads you should remove '''@ resources = !ConsumableCpus(1)'''. For exemple for resolution 280x280x39 put in your job : |
| 102 | | |
| 103 | | {{{ |
| 104 | | # @ total_tasks = 32 |
| 105 | | # @ environment = "BATCH_NUM_PROC_TOT=32" |
| 106 | | # @ parallel_threads = 8 |
| 107 | | # @ data_limit = 18.0gb |
| 108 | | # @ stack_limit = 6.0gb,6.0gb |
| 109 | | ### @ resources = ConsumableCpus(1) |
| 110 | | }}} |
| 111 | | |
| 112 | | * You must deactivate the filter fft if using branch LMDZ4_AR5 or earlier version of LMDZ. In run.def set '''use_filtre_fft = n'''. |
| 113 | | |
| 118 | | otherwise you'll have following error message : |
| 119 | | |
| 120 | | '''ERROR: 0031-636 User requested or EOF termination of pm_command''' |
| | 102 | otherwise you'll have following error message : '''ERROR: 0031-636 User requested or EOF termination of pm_command''' |
| | 103 | * You must deactivate the filter fft if using branch LMDZ4_AR5 or earlier version of LMDZ. In run.def set '''use_filtre_fft = n'''. |
| | 104 | * You should not compile with -O5 at VARGAS. Compile with -O3 or lower optimization. Default compiler xlf 13.1.0.3 is ok with -O3. |
| | 105 | * Check memory in your job. For higher resolutions you may need to add threads just to have more memory. You must then compile in mpi mode (default for create_etat0_limit.e.para and gcm.e) and not mix mpi_openmpi. In your job, add for exemple '''@ parallel_threads = 2'''. This gives you 2 times more memory per process mpi available and you can multiply data_limit and stack_limit by 2. When adding threads you should remove '''@ resources = !ConsumableCpus(1)'''. For example for resolution 280x280x39 put in your job : |
| | 106 | {{{ |
| | 107 | # @ total_tasks = 32 |
| | 108 | # @ environment = "BATCH_NUM_PROC_TOT=32" |
| | 109 | # @ parallel_threads = 2 |
| | 110 | # @ data_limit = 6.4gb |
| | 111 | # @ stack_limit = 1.0gb,1.0gb |
| | 112 | ### @ resources = ConsumableCpus(1) |
| | 113 | }}} |
| | 114 | * If the executable create_etat0_limit or ce0l exits with following error message you need to update your LMDZ version to revision 1476 at branch LMDZ4_AR5 or higher : |
| | 115 | '''''ERROR: 0032-184 MPI was not finalized in routine unknown, task 0''''' |
