{{{ #!html

Working at IDRIS

}}} ---- [[PageOutline(1-3,Table of contents,,numbered)]] # IDRIS presentation # The Institute for Development and Resources in Intensive Scientific Computing (IDRIS), founded in 1993, is a centre of excellence in intensive numerical calculations which serves the research branches of extreme computing. '''Jean-Zay''' is the supercomputer currently installed and used at IDRIS. All of the IPSL models and tools are aimed to be supported and maintained at Jean-Zay. See the full presentation on the official site for IDRIS on http://www.idris.fr/eng/ and specific information about the Jean-Zay machine here : http://www.idris.fr/eng/jean-zay/ . The site is also available in french. # How to install your environment at IDRIS # * Connection to IDRIS is possible with ssh command with a personal login from a registered machine. All forms to create or to modify an user account are available here: http://www.idris.fr/eng/docs/formulaires-eng.html * The Jean-Zay machine at IDRIS can be used for our configurations. '''Model execution and post processing can be done at Jean-Zay.''' * Note: the software [http://www.idris.fr/eng/docs/tina/tina-eng.html the Tina software installed at IDRIS] gives access to hourly, daily and weekly backups of your $HOME files. [[NoteBox(note,It is important to take the time to install a comfortable and efficient environment., 600px)]] * We recommend to follow the example of the rpsl035 login's environment which is in bash. Don't use the default .bash_profile but use instead the ~rpsl035/.bash_login file. Copy this file to your home and remove the default .bash_profile. {{{ ryyy999@jean-zay: rm $HOME/.bash_profile ryyy999@jean-zay: cp $WORK/../../psl/commun/MachineEnvironment/jeanzay/bash_login $HOME/.bash_login }}} * The .bash_login file sources the file $WORK/../../psl/commun/MachineEnvironment/jeanzay/env_jeanzay which loads libraries and post processing tools needed on our platform such as: {{{ module load netcdf/4.7.0/intel-19.0.4-mpi module load nco/4.7.9/intel-19.0.4-mpi module load ncview/2.1.7/intel-19.0.4-mpi }}} [[NoteBox(note,If you do not have read acces to $WORK/../../psl/commun\, contact Anne Cozic or the plateforme team who will add read permission for your group, 600px)]] * for [wiki:Doc/DataAnalyse#TheC-ESM-EP:theCliMAFEarthSystemModelEvaluationPlatform C-ESM-EP Atlas] you need to do these commands only once time on your account : {{{ module load singularity container=/gpfswork/rech/psl/commun/Tools/cesmep_environment/20230611_V3.0_IPSL8.sif idrcontmgr cp $container }}} # Repository with input files R_IN # The shared repository with input files is stored at jean-zay here: $WORK/../../psl/commun/IGCM. This folder is noted using the variable R_IN in the comp.card in libIGCM configurations. The folder R_IN is the same and regulary synchronized between the computing centers TGCC, IDRIS, ESPRI mesocenter(ciclad/climserv) and LSCE(obelix). Contact the plateforme groupe if you don't have read access to these files with your login at jean-zay. # Compilation # Note that there is a specific front-end to perform compilations tasks. This front-end allows you to compile faster and in one go : default XIOS compilation may crash because of restricted interactive ressources per user on the standard front-end. You can access the compilation front-end by using ssh protocol : {{{ ssh your_login@jean-zay-pp.idris.fr }}} After the compilation is successfully finished, you must go back to jean-zay standard front-end (jean-zay.idris.fr) to submit your job. # Accounting # To know the computing time used by your group (updated once a day): {{{ plab999@jean-zay:~> idracct }}} `idracct` gives information about all your projects. If you are working on several projects, your current project is referenced by the environnement variable `IDRPROJ` (`echo $IDRPROJ`). You can change the value of `IDRPROJ` (`eval $(idrenv -d `) and run `idracct` again. # Things to know about file systems # ## WORK ($WORK) ## * The $WORK Jean-Zay is large and permanent but it is not backed up. * The $WORK Jean-Zay can be extended (20 To for the group for example). The project investigator can ask an extension on the IDRIS's extranet. See: http://www.idris.fr/extranet.html or directly from an authorized IP : https://extranet.idris.fr/. ## SCRATCH ($SCRATCH) ## * The $SCRATCH is a semi-permanent space with a 30-day file lifespan, not backep-up * Very large quotas per project ## JOBSCRATCH ($JOBSCRATCH) ## is the temporary execution directory specific to batch jobs * The $JOBSCRATCH is created automatically when a batch job starts and, therefore, is unique to each job * It is destroyed automatically at the end of the job. Therefore, it is necessary to manually copy the important files onto another disk space (the WORK or the SCRATCH) before the end of the job. ## STORE ($STORE) ## * The $STORE has to be used for archiving big files * It can be extended (300 To for the group for example). The project investigator can ask an extension on the IDRIS's extranet. See: http://www.idris.fr/extranet.html or directly from an authorized IP : https://extranet.idris.fr/. ## [http://www.idris.fr/eng/jean-zay/cpu/jean-zay-quota-eng.html Quotas] ## To check the used space and the size of the HOME, WORK and STORE: {{{ # Quota HOME ryyy999@jean-zay: idrquota -m # Quota WORKDIR ryyy999@jean-zay: idrquota -w # Quota STORE ryyy999@jean-zay: idrquota -s }}} # Simulation outputs # Final simulation outputs are stored on Jean-Zay $STORE space in `IGCM_OUT` directories. LibIGCM will copy monitorings files on thredds node by using command thredds_cp. You can find all informations on thredds at Idris [http://www.idris.fr/jean-zay/pre-post/jean-zay-thredds.html here]. You can access to data after on this website : https://thredds-su.ipsl.fr/thredds/catalog/idris_thredds/catalog.html # About Password # At IDRIS, you have a unique password for all computers. Password have to be changed one time per year. The command to change your password is `passwd` . You receive a mail 2 weeks before password expiration. # The IDRIS's machines # [wiki:Doc/ComputingCenters/IDRIS/JeanZay Jean Zay] for computing part To have information about the machines' state (if there will be a maintenance for instance), a mailing list was created by IDRIS. To subscribe, the documentation can be found on the [http://www.idris.fr/eng/extranet-eng.html IDRIS extranet], or you can ask the Plateforme group.