wiki:IncaCiclad

Version 5 (modified by xuezhou, 4 years ago) (diff)

--

LMDEZORINCA tests at Ciclad are done with the help of information on the site : https://forge.ipsl.jussieu.fr/igcmg_doc/wiki/Doc/ComputingCenters/ESPRImesocenter

First of all, the environment should be defined by adding

. /home/igcmg/.atlas_env_ciclad_ksh

in

${HOME}/.bashrc

Compilation at Ciclad

The LMDEZORINCA model can be extracted as usual. At Ciclad, ifort is the default compiler. The models LMDZOR_v6 and ORCHIDEE have been tested successfully. Therefore only in INCA model arch-ifort_CICLAD.fcm and arch-ifort_CICLAD.path should be added. Here is a example: arch-ifort_CICLAD.fcm:

%COMPILER            /usr/lib64/openmpi/1.4.5-ifort/bin/mpif90 
%LINK                /usr/lib64/openmpi/1.4.5-ifort/bin/mpif90
%AR                  ar
%MAKE                gmake
%FPP_FLAGS           -P -traditional
%FPP_DEF             CPP_FLUSH
%BASE_FFLAGS         -i4 -r8 -fp-model precise  
%PROD_FFLAGS         -O3
%DEV_FFLAGS          -g -O2 -traceback -fp-stack-check -ftrapuv -check bounds
%DEBUG_FFLAGS        -fpe0 -O0 -g -traceback -fp-stack-check -ftrapuv -check bounds -check all
%MPI_FFLAGS
%OMP_FFLAGS          -openmp -openmp-threadprivate compat
%BASE_LD             -i4 -r8
%MPI_LD
%OMP_LD              -openmp

arch-ifort_CICLAD.path:

NETCDF_INCDIR="-I/opt/netcdf42/ifort/include"
NETCDF_LIBDIR="-L/opt/netcdf42/ifort/lib"
NETCDF_LIB="-lnetcdf -lnetcdff -lstdc++"

IOIPSL_INCDIR="-I${INCADIR}/../../lib -I${INCADIR}/../IOIPSL/inc"
IOIPSL_LIBDIR="-L${INCADIR}/../../lib -L${INCADIR}/../IOIPSL/lib"
IOIPSL_LIB="-lioipsl"

XIOS_INCDIR="-I${INCADIR}/../XIOS/inc"
XIOS_LIBDIR="-L${INCADIR}/../XIOS/lib"
XIOS_LIB="-lxios"

ORCH_INCDIR="-I${INCADIR}/../../lib"
ORCH_LIBDIR="-L${INCADIR}/../../lib"

A pre_proc_ifort_CICLAD.x file should also be added. We can copy pre_proc_X64_IRENE.x and just modifier inca_pp.x64 by inca_pp.ciclad. As at other servers, the script ins_make is used to generate makefiles. In Makefile, for xios : --netcdf_lib netcdf4_seq is added.

xios :
	(cd  ../../modeles/XIOS ; ./make_xios  \
--netcdf_lib netcdf4_seq \
--prod --arch ${FCM_ARCH} --job 8 ; cp bin/xios_server.exe ../../bin/. ; )

P.S. Without this line, it seems to work too.

Run a simulation at CICLAD

As at Irène, a submit directory is created by launching ins_job. At Ciclad only MPI is used and one MPI is set for XIOS, therefore more memory is required. For instance, for a test AER (96*95*19) with 48MPI, #PBS -l mem=60gb #PBS -l vmem=300gb can be set.