Changes between Initial Version and Version 1 of Doc/ComputingCenters/SharedFiles

Timestamp:

03/24/14 16:17:02 (10 years ago)

Author:

trac

Comment:

--

Doc/ComputingCenters/SharedFiles

@@ +1 @@
+{{{
+#!html
+<h1>Repository for shared files and shared tools</h1>
+}}}
+----
+[[PageOutline(1-2,Index du chapitre,,numbered)]]
+
+The necessary files to properly use the IPSL tools and models are located on shared spaces in the various computing centers.
+
+Those shared spaces are located on specific accounts:
+
+ * TGCC  : ''p86ipsl''. Owner O. Marti.
+ * IDRIS : ''rpsl035''. Owner M.-A. Foujols.
+ * IPSL  (ciclad) : ''igcmg''. Owner M.-A. Foujols.
+ * LSCE   : ''igcmg''. Owner O. Marti.
+
+''dods'' accounts also exists at TGCC. They host data distributed by  'OpenDAP'. The owner is O. Marti.
+
+The following people can modify the data and tools on these accounts:  A. Caubel, O. Marti, M.-A. Foujols, P. Brockmann, A. Cozic, S. Denvil, J. Ghattas, C. Ethe, S. Flavoni, J. Servonnat, S. Labetoulle.
+
+# Common tools #
+
+## General environment ##
+
+On the `$HOME` of each common account you will find an executable to properly setup the environment which will allow you to use the IPSL models and tools. Loading modules and specifying `${PATH}` for the basic softwares (compilers, libraries, post processing tools, etc...) The environment file has different versions. Its general name is `.atlas_env_[machine]_[bash|ksh|csh]`.
+
+For example (note the period at the beginning of the name) : 
+{{{
+#!sh
+.atlas_env_asterix_bash   # To use if your connection shell is bash
+.atlas_env_asterix_ksh    #  To use if your connection shell is ksh. 
+.atlas_env_asterix_csh    #  To use if your connection shell is csh or tcsh
+}}}
+
+If the file `_bash` does not exist, use the file `_ksh`.
+
+On a few computing machines, you must setup the environment differently for compilation and execution phases and for the graphic post processing phases. Files therefore exist in two versions.
+
+For example :
+{{{
+#!sh
+.atlas_env_calcul_curie_ksh  # For compiling and executing 
+.atlas_env_post_curie_ksh    # For post processing
+}}}
+
+To this day, only the curie machine at TGCC is concerned.
+
+## Rebuild ##
+
+When the model is in parallel mode and the parallel I/O are not activated, the outputs are truncated into different files (one per MPI process), each of them only containing part of the computation domain. The rebuild phase allows to reconstruct the complete file covering the whole domain.
+
+The rebuild utilitaries are used by the IPSL models in the post-processing phase. The rebuild can also be done interactivly 
+
+The rebuild tools are stored :
+ * at ada : /smphome/rech/psl/rpsl035/bin
+ * at curie : /ccc/cont003/home/dsm/p86ipsl/X64_CURIE/bin
+ * at obelix : /home/users/igcmg/rebuild/bin           
+
+
+## Post processing tools ##
+
+The fast and atlas tools used by the post processing are also stored on a shared space.
+
+ * At TGCC: in `~p86ipsl/atlas` and `~p86ipsl/fast`
+ * At IDRIS: in `~rpsl035/atlas` and `~rpsl035/fast`
+
+# Repository for shared files #
+
+## IGCM directory ##
+
+The files needed to run the models (initial conditions, boundary conditions, forcings) are grouped in common accounts. The shared accounts from the different computing centers are regularly synchronized. Part of it is synchronized at LSCE. The `IGCM` tree exists at TGCC, at IDRIS and at IPSL. The `IGCM` directory is located in the storage spaces of each computing centers.
+
+This common directory is defined by `libIGCM_sys` : variable `R_IN`.
+
+ * The TGCC repository for shared files is located:
+    * On the WORKDIR : `R_IN=/ccc/work/cont003/dsm/p86ipsl/IGCM`.
+    * On the STOREDIR : `/ccc/store/cont003/dsm/p86ipsl/IGCM`. This space migrated on bands is used for back ups and is not used by the IPSL models and tools.
+ * The IDRIS repository for shared files is located:
+    * On the ada machine, on WORKDIR : `R_IN=/workgpfs/rech/psl/rpsl035/IGCM`
+    * On the gaya machine, on `R_IN=/u/rech/psl/rpsl035/IGCM`. This space migrated on bands is used for back ups and is not used by the IPSL models and tools.
+ * IPSL ([wiki:DocBenvDipslAciclad ciclad]) : `R_IN=/ipslfs/igcmg/IGCM`
+
+In this shared directory, there are three directories :
+  * `IGCM/STORAGE`-> contains all the files necessary for the different configurations ;
+  * `IGCM/INIT`  -> for each configuration points to `IGCM/STORAGE/INIT` ;
+  * `IGCM/BC`    -> for each configuration points to `IGCM/STORAGE/BC`.
+
+This link system is not very well respected and lots of files are found in `INIT` and `BC`.
+
+The synchronization procedure between different computing centers is being reorganized (February 2013).
+
+## The IGCM_RESTART directory ##
+
+You will find the `IGCM_RESTART`directory which contains the model initial states for a few important experiments duplicated on the different computing centers at the same location as `IGCM`. To this day, IPSL-CM5A (LR and MR) is the only configuration concerned.
+