Changeset 202 for trunk/docs/docs_dev

Timestamp:

07/26/13 20:19:25 (11 years ago)

Author:

pinsard

Message:

end of 20130725 update data

File:

• trunk/docs/docs_dev/source/guides/updatedata/updatedata_20130725.rst (modified) (8 diffs)

trunk/docs/docs_dev/source/guides/updatedata/updatedata_20130725.rst

@@ -41 +41 @@
 Only time coverage extension from July 2012 to March 2013
 
-:file:`${PROJECT}/website/data/changes.rst` and :file:`${PROJECT}/adm/website/Readme.rst` are updated. 
+Following files are updated :
+:file:`${PROJECT}/adm/website/data/changes.rst`
+:file:`${PROJECT}/adm/website/data_access.rst`
+:file:`${PROJECT}/adm/website/overview.rst`
+:file:`${PROJECT}/adm/website/Readme.rst` 
+:file:`${PROJECT}/adm/website/_templates/layout.html`
 
 .. _saveold:
@@ -74 +79 @@
 
 Is there enought space ?
+
+::
+
    $ du -sh ${newdir}/daily
    12G     /net/adonis/usr/adonis/varclim/tropflux_v2/daily
@@ -84 +92 @@
 20GB vs 12.4 GB = yes
 
+then, copy ::
+
    $ cp ${PROJECT}/adm/website/Readme.rst /usr/lodyc/incas/fplod/tropflux_d/to_be_published/Readme.rst
    $ cp -r ${newdir}/daily /usr/lodyc/incas/fplod/tropflux_d/to_be_published
@@ -95 +105 @@
 A set of tools must be run to compare obsolete and new versions
 
-TDB
-
-.. parsed-literal::
-
-   $ ++compare.sh -o obsolete_${datemodif} -n /usr/lodyc/incas/fplod/tropflux_d/to_be_published
-
-   mkdir -p /usr/work/incas/fplod/tropflux_d//compare_update/
-   varlist="lhf lwr netflux q2m shf swr t2m tau taux tauy ws"
-   period_list="daily monthly"
-   lastyear=2012
-   for var in $varlist
-   do
-      for period in ${period_list}
-      do 
-         if [ "${period}" == "daily" ]
-         then 
-            suffix=1d
-         else
-            suffix=1m
-         fi
-         newfile=/usr/lodyc/incas/fplod/tropflux_d/to_be_published/${period}/${var}_tropflux_${suffix}_1979_march2013.nc
-         newfile_oldtimecoverage=${PROJECT_ID}/compare_update/${var}_tropflux_${suffix}_1979_${lastdate}.nc
-         # extract old time coverage in the new file
-         nt=$(ncdump -h $oldfile | grep "time = UNLIMITED ;" | sed -e "s@\(time = UNLIMITED ; // (\)\(.*\)\( currently)\)@\2@")
-         slabtime=$(printf "time,0,%d" $((${nt} -1 )))
-         ncks -d ${slabtime} -O -o ${newfile_oldtimecoverage} ${newfile}
-         oldfile=/usr/lodyc/incas/fplod/tropflux_d/obsolete_${datemodif}/${period}/${var}_tropflux_${suffix}_1979_${lastyear}.nc
-         oldfiledump=${PROJECT_ID}/compare_update/${var}_tropflux_${suffix}_1979_${lastyear}.nc_ncdump
-         cdo diff  ${newfile_oldtimecoverage} ${oldfile}
-         read a
-         # we must see "0 of $nt records differ"
-         ncdump -h ${newfile_oldtimecoverage} > ${newfile_oldtimecoverage}_ncdump
-         ncdump -h ${oldfile} > ${oldfiledump}
-         diff ${newfile_oldtimecoverage}_ncdump ${oldfiledump}
-         # we must see a difference in creation date and coverage
-         read a
-         rm ${newfile_oldtimecoverage}_ncdump
-         rm ${oldfiledump}
-         unset suffix
-      done
-      unset period
-      unset period_list
-   done
-   unset var
-   unset varlist
-   rm -rf /usr/work/incas/fplod/tropflux_d//compare_update/
+
+see draft tool :ref:`compare.sh`
+
+::
 
    log=${PROJECT_LOG}/compare.log
-   script ${PROJECT_LOG}/compare.log
+   script ${log}
    compare.sh
    exit
@@ -154 +122 @@
 
    grep "records differ" ${log}
-  
+
 If only "0 of" begin all lines, its ok. Otherwise look inside the log file to
 locate troubles.
@@ -160 +128 @@
 Second, check for differences on global attributes
 
+On creation_date
+
 ::
 
    grep "^>" ${log} | grep creation_date
 
-If nothing appears, you must modified this attributes. see :ref:`change_creation_date.sh` ++
-
+If nothing appears, you must modified this attributes. see :ref:`change_creation_date.sh`.
+
+It is what happened in this 20130725 data update, so:
+
+::
+
+   change_creation_date.sh -d /usr/lodyc/incas/fplod/tropflux_d/to_be_published/ -c 20130725
+   tlogd.sh change_creation_date
+
+
+On time_range
+::
 
    grep "^>" ${log} | grep time_range
 
-If nothing appears, you must modified this attributes. see :ref:`change_timerange.sh` ++
-
-Clean log file::
+If nothing appears, you must modified this attributes. see :ref:`change_time_range.sh`
+
+It is what happened in this 20130725 data update, so::
+
+   change_time_range.sh -d /usr/lodyc/incas/fplod/tropflux_d/to_be_published/ -b 19790101 -e 20130331
+   tlogd.sh change_time_range
+
+Clean comparison log file::
 
    rm ${log}
 
-If modifications has been made, re-run comparaison before next step
+Correct terminology if still necessary:
+
+::
+
+  correct_terminology.sh -d /usr/lodyc/incas/fplod/tropflux_d/to_be_published/ -good "1979_2013" -bad "1979_march2013"
+  tlogd.sh correct_terminology
+
+If modifications has been made, re-run comparison (go back to
+:ref:`compareversion_20130725`)
+before next step
 
 Once comparison is done and PI happy,
@@ -202 +196 @@
 To avoid confusion, old version has to be removed from the website:
 
-.. parsed-literal::
-
-   fplod@sonmac$ ftp www.locean-ipsl.upmc.fr
-   ftp> cd |project_id|/data/
-   ftp> mdelete daily/*
-   ftp> mdelete monthly/*
+.. warning::
+
+   This sequence do not work  on cratos because no ftp command on this plateform.
+   It has been launched on cerbere.locean-ipsl.upmmc.fr
+
+.. parsed-literal::
+
+   ftp www.locean-ipsl.upmc.fr
+   cd |project_id|/data/
+   mdelete daily/*
+   mdelete monthly/*
+   bye
 
 .. _installdata_20130725:
@@ -216 +216 @@
 L'installation se fait ainsi:
 
-.. parsed-literal::
-
-   fplod@sonmac$ cd /Volumes/Lcerbere/tropflux_d/
-   fplod@sonmac$ ftp www.locean-ipsl.upmc.fr
-   ftp> cd |project_id|/data/
-   ftp> put Readme.rst
-   ftp> cd daily
-   ftp> lcd daily
-   ftp> mput \*.nc
-   ftp> put ../Readme.rst
-   ftp> cd ../monthly
-   ftp> lcd ../monthly
-   ftp> put ../Readme.rst
-   ftp> mput \*.nc
-
-
-.. note::
-
-   :file:`/Volumes/Lcerbere/tropflux_d/` is equivalent to file:`/usr/lodyc/incas/fplod/tropflux_d/` thanks to sshfs command.
-
-   .. parsed-literal::
-
-      $ diskext="/Volumes/LCerbere"
-      $ mkdir ${diskext}
-      $ sshfs fplod@cerbere:/usr/lodyc/incas/fplod ${diskext} -odefer_permissions -o sshfs_debug
-
-
- et template pour NEW
-
-et build doc et install doc
-
-(see also :ref:`builddoc` to synchronize dataset and documentation).
-
-
-et svn commit ppur ce fichier et tous ceux mentionnes ici
+.. warning::
+
+   This sequence do not work  on cratos because no ftp command on this plateform.
+   It has been launched on cerbere.locean-ipsl.upmmc.fr
+
+.. parsed-literal::
+
+   cd /usr/lodyc/incas/fplod/tropflux_d/
+   ftp www.locean-ipsl.upmc.fr
+   cd |project_id|/data/
+   put Readme.rst
+   cd daily
+   lcd daily
+   mput \*.nc
+   put ../Readme.rst
+   cd ../monthly
+   lcd ../monthly
+   put ../Readme.rst
+   mput \*.nc
+   bye
+
+
+Update news of website
+----------------------
+
+
+Files in :file:`${PROJECT}/adm/website/` have been modified to tell the new time coverage so 
+see also :ref:`builddoc` to synchronize dataset and documentation
+
+Update svn repository
+---------------------
+
+svn commit pour tous les fichiers modifiés lors de cette mise à jour
+
+Cleanning
+---------
+
 rm /usr/lodyc/incas/fplod/tropflux_d/to_be_published/