wiki:Doc/ComputingCenters/IDRIS

Version 45 (modified by acosce, 5 years ago) (diff)

--

Working at IDRIS


1. IDRIS presentation

See: http://www.idris.fr/eng

2. IDRIS's machines and file systems

No image "IDRIS.jpg" attached to DocBenvAidris

3. How to install your environment at IDRIS

It is important to take the time to install a comfortable and efficient environment.

  • We recommend to follow the example of the rpsl035 login's environment which is in bash. Don't use the default .bash_profile but use instead the ~rpsl035/.bash_login file. Copy this file to your home and remove the default .bash_profile.
    ryyy999@ada: rm $HOME/.bash_profile
    ryyy999@ada: cp ~rpsl035/.bash_login $HOME/.
    
  • The .bash_login file sources the file /smphome/rech/psl/rpsl035/.atlas_env_ada_intel_2013_0_bash which loads libraries and post processing tools needed on our platform such as:
    module load netcdf (currently netcdf/seq/4.1.3 in interactive mode) 
    module load ferret/6.85
    module load nco/4.4.6
    module load cdo/1.6.5
    
  • Avoid messages displayed when connecting on Ada and Ergon. Do the following tests:
    • Make sure that the command rsh ergon pwd returns a unique line with the HOME on Ada.
      ryyy999@ada: rsh ergon pwd
      /arch/home/rech/yyy/ryyy999
      
    • Make sure the copy of a file using rcp works properly in the two directions. The following test transfers the file a containing the date:
      ryyy999@ada: date > a ; rcp a ergon:
      
  • Transfers Ada/Ergon must be done with mfget/mfput.
  • For esgf/thredds access, use the command mfdods on Ergon. This creates the link (24h after the first time) visible here: http://prodn.idris.fr/thredds/catalog/ipsl_public/catalog.html
    # Export a file:
    ryyy999@ergon: mfdods my_file -d pub/ryyy999/my_dir
    
    # Once the access activated, you must do the following to destroy a file:
    ryyy999@ada: mfdods -r /u/DODS/pub/ryyy999/my_dir/my_file
    

4. Accounting

Since 2016, usage of computing time and quotas are printed at beginning of each new session.

***********************************************************************
* Consommation du projet  XXXXX - groupe : XXX                        *
* ada        :       10231 h   (  34.10% de l'allocation )            *
* HOME       :        5394 Mio ( 95%)    - Inodes -     17787 ( 11%)  *
* WORKDIR    :       11018 Gio ( 50%)    - Inodes -   2831719 ( 80%)  *
* Ergon      :      188700 Gio ( 55%)    - Inodes -   6177427 ( 88%)  *
***********************************************************************

To know the computing time used by your group (updated once a day):

plab999@ada:~> cpt 

5. Things to know about file systems

5.1. WORKDIR

5.2. ERGON

  • The $HOME Ergon has to be used for archiving big files
  • The $HOME Ergon can be extended (300 To for the group for example). The project investigator can ask an extension on the IDRIS's extranet. See: http://www.idris.fr/extranet.html or directly from an authorized IP : https://extranet.idris.fr/.
    • you can use idrls to know the status of a file stored on ergon. See idrls -?. m means migrated on tape only, - means on disk.
      idrls IGCM/RESTART/IPSLCM6/DEVT/piControl/O1T03V14/*/Restart/*
      M ACCESS     L USER    GROUP         SIZE   MOD_DATE   ACC_DATE   EXP_DATE FILE_NAME
      = ========== = ======== ===== ============ ========== ========== ========== =========
      - -rwxrwxr-x 1  rpslxxx   psl    218188352 09.06.2015 22.01.2016 22.01.2017 IGCM/RESTART/IPSLCM6/DEVT/piControl/O1T03V14/ICE/Restart/O1T03V14_18891231_restart_icemod.nc
      m -rwxrwxr-x 1  rpslxxx   psl   1411362796 09.06.2015 22.01.2016 22.01.2017 IGCM/RESTART/IPSLCM6/DEVT/piControl/O1T03V14/OCE/Restart/O1T03V14_18891231_restart.nc
      

5.3. Quotas

Since 2016, usage and quotas are printed at beginning of each new session.

***********************************************************************
* Consommation du projet  XXXXX - groupe : xxx                        *
* ada        :       10231 h   (  34.10% de l'allocation )            *
* HOME       :        5394 Mio ( 95%)    - Inodes -     17787 ( 11%)  *
* WORKDIR    :       11018 Gio ( 50%)    - Inodes -   2831719 ( 80%)  *
* Ergon      :      188700 Gio ( 55%)    - Inodes -   6177427 ( 88%)  *
***********************************************************************

To check the used space and the size of the HOME, WORKDIR and ERGON:

# Quota HOME
ryyy999@ada: quota_u

# Quota WORKDIR
ryyy999@ada: quota_u -w

# Quota ERGON
ryyy999@ergon: quota_u

5.4. Access

Since january 2017, access to other is prohibited. You have to use idracl to give specific access. Documentation : http://www.idris.fr/ada/configuration-droits-acces.html

Exemples to give access to a list of groups to HOME ergon, HOME and WORKDIR ada :

ergon>  for g in yyy zzz ; do echo $g ; idracl  -a -g $g ; done
ada> for g in yyy zzz ; do echo $g ; idracl -w -a -g $g ; idracl  -a -g $g ; done

Verification :

ada> cd ; ls -ld .
drwxr-xr-x+ 24 rxxx003 xxx 8192 Jan 19 12:13 .
ada> idracl -l
 
Liste des logins et groupes autorises a acceder 
 a mon espace /linkhome/rech/xxx/rxxx003 
===============================================
 logins autorises : 
 groupes autorises : yyy zzz 

In case of problems, please contact the IDRIS' assistance.

6. Simulation outputs

Final simulation outputs are stored on Ergon in IGCM_OUT directories. There are also available from Adapp in $ARCHIVE/IGCM_OUT but not directly from Ada.

The IDRIS's esgf/thredds server is accessible from here : http://prodn.idris.fr/thredds/catalog/ipsl_public/catalog.html

7. About Password

At IDRIS, you have a unique password for all computers. Password have to be changed one time per year. The command to change your password is passwd . You receive a mail 2 weeks before password expiration.

8. The IDRIS's machines

  • Ada for computing part
  • Adapp for post-processing part
  • Jean Zay for computing part (working version)

Attachments (1)

Download all attachments as: .zip