| Version 1 (modified by mathiot, 4 years ago) (diff) |
|---|
Name and subject of the action
Last edition: Wikinfo(changed_ts)? by Wikinfo(changed_by)?
The PI is responsible to closely follow the progress of the action, and especially to contact NEMO project manager if the delay on preview (or review) are longer than the 2 weeks expected.
Summary
| Action | ENHANCE-05_mathiot_REBUILD: |
|---|---|
| PI(S) | Pierre Mathiot |
| Digest | Decrease memory usagest and speed-up the rebuild by using a reader process and a writer process |
| Dependencies | If any |
| Branch | source:/NEMO/branches/{YEAR}/dev_r{REV}_{ACTION_NAME} |
| Previewer(s) | Names |
| Reviewer(s) | Names |
| Ticket | #XXXX |
Description
- Decreasing the memory usage will be done by avoid the creation of a global 3d array in the tools. To do so, we can read the local domain and write it where it should be write in the netcdf using start and count.
- Elapse time can be decrease by almost 2 by having a reader process which read local domain and send it to a writer process. Using more reader process and more writer process will speedup even more the rebuild but netcdf compression is not available so it will by at the expence of having a nccopy step at the end.
Implementation
...
Documentation updates
...
Preview
...
Tests
...
Review
...
