Changeset 453 for XIOS/trunk

Timestamp:

01/09/14 09:41:57 (10 years ago)

Author:

ymipsl

Message:

Work-arround for fixing bug in netcdf4/hdf5 : the chunk size cannot exceed 2GB, so some problem was encountered for very big configuration.

YM

File:

• XIOS/trunk/src/output/onetcdf4.cpp (modified) (2 diffs)

XIOS/trunk/src/output/onetcdf4.cpp

@@ -246 +246 @@
          std::vector<StdSize> dimsizes ;
          StdSize size ;
+         StdSize totalSize ;
+         StdSize maxSize=1024*1024*256 ; // == 2GB/8 if output double
          
          int grpid = this->getCurrentGroup();
@@ -262 +264 @@
          
          CheckError(nc_def_var (grpid, name.c_str(), type, dimids.size(), &(dimids[0]), &varid));
+
+// set chunksize : size of one record
+// but must not be > 2GB (netcdf or HDF5 problem)
+         totalSize=1 ;
+         for(vector<StdSize>::reverse_iterator it=dimsizes.rbegin(); it!=dimsizes.rend();++it)
+         {
+           totalSize*= *it ;
+           if (totalSize>=maxSize) *it=1 ;
+         }
+
          CheckError(nc_def_var_chunking (grpid, varid, NC_CHUNKED, &(dimsizes[0])));
          CheckError(nc_def_var_fill(grpid, varid, true, NULL));