Opened 8 years ago

Closed 4 years ago

Last modified 2 years ago

#946 closed Enhancement (fixed)

syncing the netcdf file before the end of the model run

Reported by: rkandilarov Owned by: nemo
Priority: low Milestone: Unscheduled
Component: OCE Version: release-3.4
Severity: Keywords: NetCDF* fortran
Cc:

Description

Currently the model doesn't sync the written data.

In my case I would like (as it was once in NEMO) to see what is going on during the run so that I can stop the model if smth unreal is happening :). In details:

As I wrote in https://forge.ipsl.jussieu.fr/nemo/ticket/943 the model does not syncs the data after it writes it to the file. In NEMOGCM/EXTERNAL/IOIPSL/src/histcom.f90:2165 this functionality is intentionally ommited and left to the netcdf ( or hdf5 layer in case of netcdf4). But… as far as I can track what the model+netcdf(3 or 4) do, at some point when the buffer or cache is full the data is written to the disk but without a call to nf90_SYNC one could not see this data from outside the model. 

What is more… I'm not absolutely sure(now looking in the hdf lib docs), but I guess that the caching/buffering future is used with writing chuncks. As NEMO is not chunking over time only space (as described in the docs) I think a new option output_sync_freq in the iodef.xml for calling  nf90_SYNC or more proper SUBROUTINE histsync (idf) every  output_sync_freq time steps, where output_sync_freq could be:

  • 0 - imideatlety (the same as output_sync_freq=output_freq)
  • k - for example on every 2-nd wrote performed when output_sync_freq/output_freq=2
  • -1 - only if crash or at the end of the model ryn (the current situation)

will be a nice future.

 

 

Commit History (0)

(No commits)

Change History (12)

comment:1 Changed 4 years ago by clevy

  • Resolution set to fixed
  • Status changed from new to closed

comment:2 Changed 4 years ago by nicolasmartin

  • Keywords NetCDF4 added; netcdf4 removed

comment:3 Changed 4 years ago by nicolasmartin

  • Keywords nemo_v3_4* added

comment:4 Changed 4 years ago by nicolasmartin

  • Keywords netCDF added; netcdf removed

comment:5 Changed 4 years ago by nicolasmartin

  • Keywords NetCDF added; netCDF removed

comment:6 Changed 4 years ago by nicolasmartin

  • Keywords NetCDF* added; NetCDF NetCDF4 removed

comment:7 Changed 4 years ago by nicolasmartin

  • Keywords fortran added; nf90_sync removed

comment:8 Changed 2 years ago by nemo

  • Keywords Misc. added

comment:9 Changed 2 years ago by nemo

  • Keywords release-3.4* added; nemo_v3_4* removed

comment:10 Changed 2 years ago by nemo

  • Keywords syncing removed

comment:11 Changed 2 years ago by nemo

  • Keywords release-3.4* removed

comment:12 Changed 2 years ago by nemo

  • Keywords Misc. removed
Note: See TracTickets for help on using tickets.