Changeset 1551


Ignore:
Timestamp:
06/26/18 00:28:38 (2 years ago)
Author:
yushan
Message:

report updated

Location:
XIOS/dev/branch_openmp/Note
Files:
4 added
6 edited

Legend:

Unmodified
Added
Removed
  • XIOS/dev/branch_openmp/Note/rapport ESIWACE.aux

    r1548 r1551  
    11\relax  
    22\@writefile{toc}{\contentsline {section}{\numberline {1}Context}{1}} 
    3 \@writefile{lof}{\contentsline {figure}{\numberline {1}{\ignorespaces On the left, each peak of computing power corresponds to the vallay of memory bandwidth which shows that the computing resources are alternating between calculates and IO. ON the right, both curves are smooth which means that the computing resources have a stable charge of work, either calculates or IO.}}{1}} 
    4 \@writefile{toc}{\contentsline {section}{\numberline {2}Developpement of a thread-friendly MPI for XIOS}{2}} 
    5 \@writefile{toc}{\contentsline {section}{\numberline {3}Performance of LMDZ using EP\_XIOS}{3}} 
    6 \@writefile{lof}{\contentsline {figure}{\numberline {2}{\ignorespaces Speedup obtained by using EP in LMDZ simulations.}}{4}} 
    7 \@writefile{toc}{\contentsline {section}{\numberline {4}Perspectives of EP\_XIOS}{4}} 
     3\@writefile{lof}{\contentsline {figure}{\numberline {1}{\ignorespaces On the left, each peak of computing power corresponds to the valley of memory bandwidth which shows that the computing resources are alternating between calculates and I/O. ON the right, both curves are smooth which means that the computing resources have a stable charge of work, either calculates or I/O.}}{1}} 
     4\@writefile{toc}{\contentsline {section}{\numberline {2}Development of thread-friendly XIOS}{2}} 
     5\@writefile{lof}{\contentsline {figure}{\numberline {2}{\ignorespaces Illustration of the domain decomposition used in LMDZ.}}{2}} 
     6\citation{Dinan:2013} 
     7\citation{Sridharan:2014} 
     8\@writefile{lof}{\contentsline {figure}{\numberline {3}{\ignorespaces }}{3}} 
     9\newlabel{fig:omp}{{3}{3}} 
     10\@writefile{lof}{\contentsline {figure}{\numberline {4}{\ignorespaces }}{3}} 
     11\newlabel{fig:scheme}{{4}{3}} 
     12\@writefile{toc}{\contentsline {section}{\numberline {3}Performance of LMDZ using EP\_XIOS}{5}} 
     13\@writefile{lof}{\contentsline {figure}{\numberline {5}{\ignorespaces Speedup obtained by using EP in LMDZ simulations.}}{5}} 
     14\bibstyle{plain} 
     15\bibdata{reference} 
     16\bibcite{Dinan:2013}{1} 
     17\bibcite{Sridharan:2014}{2} 
     18\@writefile{toc}{\contentsline {section}{\numberline {4}Performance of EP\_XIOS}{6}} 
     19\@writefile{toc}{\contentsline {section}{\numberline {5}Perspectives of EP\_XIOS}{6}} 
  • XIOS/dev/branch_openmp/Note/rapport ESIWACE.bbl

    r1548 r1551  
     1\begin{thebibliography}{1} 
     2 
     3\bibitem{Dinan:2013} 
     4J.~Dinan, Pavan Balaji, D.~Goodell, D.~Miller, M.~Snir, and Rajeev Thakur. 
     5\newblock Enabling mpi interoperability through flexible communication 
     6  endpoints. 
     7\newblock In {\em EuroMPI 2013}, Madrid, Spain, 2013. 
     8 
     9\bibitem{Sridharan:2014} 
     10S.~Sridharan, J.~Dinan, and D.~D. Kalamkar. 
     11\newblock Enabling efficient multithreaded mpi communication through a 
     12  library-based implementation of mpi endpoints. 
     13\newblock In {\em SC14: International Conference for High Performance 
     14  Computing, Networking, Storage and Analysis}, pages 487--498, Nov 2014. 
     15 
     16\end{thebibliography} 
  • XIOS/dev/branch_openmp/Note/rapport ESIWACE.blg

    r1548 r1551  
    1 This is BibTeX, Version 0.99d (TeX Live 2015/Debian) 
     1This is BibTeX, Version 0.99d (TeX Live 2016) 
    22Capacity: max_strings=35307, hash_size=35307, hash_prime=30011 
    33The top-level auxiliary file: rapport ESIWACE.aux 
    4 I found no \citation commands---while reading file rapport ESIWACE.aux 
    5 I found no \bibdata command---while reading file rapport ESIWACE.aux 
    6 I found no \bibstyle command---while reading file rapport ESIWACE.aux 
    7 You've used 0 entries, 
    8             0 wiz_defined-function locations, 
    9             83 strings with 504 characters, 
    10 and the built_in function-call counts, 0 in all, are: 
    11 = -- 0 
    12 > -- 0 
    13 < -- 0 
    14 + -- 0 
    15 - -- 0 
    16 * -- 0 
    17 := -- 0 
    18 add.period$ -- 0 
    19 call.type$ -- 0 
    20 change.case$ -- 0 
     4The style file: plain.bst 
     5Database file #1: reference.bib 
     6You've used 2 entries, 
     7            2118 wiz_defined-function locations, 
     8            512 strings with 4502 characters, 
     9and the built_in function-call counts, 893 in all, are: 
     10= -- 80 
     11> -- 51 
     12< -- 1 
     13+ -- 20 
     14- -- 18 
     15* -- 63 
     16:= -- 146 
     17add.period$ -- 6 
     18call.type$ -- 2 
     19change.case$ -- 15 
    2120chr.to.int$ -- 0 
    22 cite$ -- 0 
    23 duplicate$ -- 0 
    24 empty$ -- 0 
    25 format.name$ -- 0 
    26 if$ -- 0 
     21cite$ -- 2 
     22duplicate$ -- 37 
     23empty$ -- 68 
     24format.name$ -- 18 
     25if$ -- 192 
    2726int.to.chr$ -- 0 
    28 int.to.str$ -- 0 
    29 missing$ -- 0 
    30 newline$ -- 0 
    31 num.names$ -- 0 
    32 pop$ -- 0 
    33 preamble$ -- 0 
    34 purify$ -- 0 
     27int.to.str$ -- 2 
     28missing$ -- 2 
     29newline$ -- 13 
     30num.names$ -- 4 
     31pop$ -- 22 
     32preamble$ -- 1 
     33purify$ -- 13 
    3534quote$ -- 0 
    36 skip$ -- 0 
     35skip$ -- 25 
    3736stack$ -- 0 
    38 substring$ -- 0 
    39 swap$ -- 0 
    40 text.length$ -- 0 
     37substring$ -- 38 
     38swap$ -- 12 
     39text.length$ -- 1 
    4140text.prefix$ -- 0 
    4241top$ -- 0 
    43 type$ -- 0 
     42type$ -- 8 
    4443warning$ -- 0 
    45 while$ -- 0 
    46 width$ -- 0 
    47 write$ -- 0 
    48 (There were 3 error messages) 
     44while$ -- 6 
     45width$ -- 3 
     46write$ -- 24 
  • XIOS/dev/branch_openmp/Note/rapport ESIWACE.log

    r1548 r1551  
    1 This is pdfTeX, Version 3.14159265-2.6-1.40.16 (TeX Live 2015/Debian) (preloaded format=pdflatex 2017.8.24)  22 JUN 2018 17:31 
     1This is pdfTeX, Version 3.14159265-2.6-1.40.17 (TeX Live 2016) (preloaded format=pdflatex 2016.7.25)  25 JUN 2018 17:20 
    22entering extended mode 
    33 restricted \write18 enabled. 
     
    55**"rapport ESIWACE.tex" 
    66(./rapport ESIWACE.tex 
    7 LaTeX2e <2016/02/01> 
    8 Babel <3.9q> and hyphenation patterns for 3 language(s) loaded. 
    9 (/usr/share/texlive/texmf-dist/tex/latex/base/article.cls 
     7LaTeX2e <2016/03/31> 
     8Babel <3.9r> and hyphenation patterns for 83 language(s) loaded. 
     9(/usr/local/texlive/2016/texmf-dist/tex/latex/base/article.cls 
    1010Document Class: article 2014/09/29 v1.4h Standard LaTeX document class 
    11 (/usr/share/texlive/texmf-dist/tex/latex/base/size10.clo 
     11(/usr/local/texlive/2016/texmf-dist/tex/latex/base/size10.clo 
    1212File: size10.clo 2014/09/29 v1.4h Standard LaTeX file (size option) 
    1313) 
     
    2424\bibindent=\dimen102 
    2525) 
    26 (/usr/share/texlive/texmf-dist/tex/latex/base/inputenc.sty 
     26(/usr/local/texlive/2016/texmf-dist/tex/latex/base/inputenc.sty 
    2727Package: inputenc 2015/03/17 v1.2c Input encoding file 
    2828\inpenc@prehook=\toks14 
    2929\inpenc@posthook=\toks15 
    3030 
    31 (/usr/share/texlive/texmf-dist/tex/latex/base/utf8.def 
    32 File: utf8.def 2015/12/03 v1.1r UTF-8 support for inputenc 
     31(/usr/local/texlive/2016/texmf-dist/tex/latex/base/utf8.def 
     32File: utf8.def 2016/02/28 v1.1s UTF-8 support for inputenc 
    3333Now handling font encoding OML ... 
    3434... no UTF-8 mapping file for font encoding OML 
     
    3636... processing UTF-8 mapping file for font encoding T1 
    3737 
    38 (/usr/share/texlive/texmf-dist/tex/latex/base/t1enc.dfu 
    39 File: t1enc.dfu 2015/12/03 v1.1r UTF-8 support for inputenc 
     38(/usr/local/texlive/2016/texmf-dist/tex/latex/base/t1enc.dfu 
     39File: t1enc.dfu 2016/02/28 v1.1s UTF-8 support for inputenc 
    4040   defining Unicode char U+00A0 (decimal 160) 
    4141   defining Unicode char U+00A1 (decimal 161) 
     
    249249   defining Unicode char U+021A (decimal 538) 
    250250   defining Unicode char U+021B (decimal 539) 
    251    defining Unicode char U+01E02 (decimal 7682) 
    252    defining Unicode char U+01E03 (decimal 7683) 
     251   defining Unicode char U+1E02 (decimal 7682) 
     252   defining Unicode char U+1E03 (decimal 7683) 
    253253   defining Unicode char U+200C (decimal 8204) 
     254   defining Unicode char U+2010 (decimal 8208) 
     255   defining Unicode char U+2011 (decimal 8209) 
     256   defining Unicode char U+2012 (decimal 8210) 
    254257   defining Unicode char U+2013 (decimal 8211) 
    255258   defining Unicode char U+2014 (decimal 8212) 
     259   defining Unicode char U+2015 (decimal 8213) 
    256260   defining Unicode char U+2018 (decimal 8216) 
    257261   defining Unicode char U+2019 (decimal 8217) 
     
    269273... processing UTF-8 mapping file for font encoding OT1 
    270274 
    271 (/usr/share/texlive/texmf-dist/tex/latex/base/ot1enc.dfu 
    272 File: ot1enc.dfu 2015/12/03 v1.1r UTF-8 support for inputenc 
     275(/usr/local/texlive/2016/texmf-dist/tex/latex/base/ot1enc.dfu 
     276File: ot1enc.dfu 2016/02/28 v1.1s UTF-8 support for inputenc 
    273277   defining Unicode char U+00A0 (decimal 160) 
    274278   defining Unicode char U+00A1 (decimal 161) 
     
    310314... processing UTF-8 mapping file for font encoding OMS 
    311315 
    312 (/usr/share/texlive/texmf-dist/tex/latex/base/omsenc.dfu 
    313 File: omsenc.dfu 2015/12/03 v1.1r UTF-8 support for inputenc 
     316(/usr/local/texlive/2016/texmf-dist/tex/latex/base/omsenc.dfu 
     317File: omsenc.dfu 2016/02/28 v1.1s UTF-8 support for inputenc 
    314318   defining Unicode char U+00A7 (decimal 167) 
    315319   defining Unicode char U+00B6 (decimal 182) 
     
    334338   defining Unicode char U+2423 (decimal 9251) 
    335339)) 
    336 (/usr/share/texlive/texmf-dist/tex/latex/graphics/graphicx.sty 
     340(/usr/local/texlive/2016/texmf-dist/tex/latex/graphics/graphicx.sty 
    337341Package: graphicx 2014/10/28 v1.0g Enhanced LaTeX Graphics (DPC,SPQR) 
    338342 
    339 (/usr/share/texlive/texmf-dist/tex/latex/graphics/keyval.sty 
     343(/usr/local/texlive/2016/texmf-dist/tex/latex/graphics/keyval.sty 
    340344Package: keyval 2014/10/28 v1.15 key=value parser (DPC) 
    341345\KV@toks@=\toks16 
    342346) 
    343 (/usr/share/texlive/texmf-dist/tex/latex/graphics/graphics.sty 
    344 Package: graphics 2016/01/03 v1.0q Standard LaTeX Graphics (DPC,SPQR) 
    345  
    346 (/usr/share/texlive/texmf-dist/tex/latex/graphics/trig.sty 
     347(/usr/local/texlive/2016/texmf-dist/tex/latex/graphics/graphics.sty 
     348Package: graphics 2016/05/09 v1.0r Standard LaTeX Graphics (DPC,SPQR) 
     349 
     350(/usr/local/texlive/2016/texmf-dist/tex/latex/graphics/trig.sty 
    347351Package: trig 2016/01/03 v1.10 sin cos tan (DPC) 
    348352) 
    349 (/usr/share/texlive/texmf-dist/tex/latex/latexconfig/graphics.cfg 
    350 File: graphics.cfg 2010/04/23 v1.9 graphics configuration of TeX Live 
    351 ) 
    352 Package graphics Info: Driver file: pdftex.def on input line 95. 
    353  
    354 (/usr/share/texlive/texmf-dist/tex/latex/pdftex-def/pdftex.def 
     353(/usr/local/texlive/2016/texmf-dist/tex/latex/graphics-cfg/graphics.cfg 
     354File: graphics.cfg 2016/01/02 v1.10 sample graphics configuration 
     355) 
     356Package graphics Info: Driver file: pdftex.def on input line 96. 
     357 
     358(/usr/local/texlive/2016/texmf-dist/tex/latex/pdftex-def/pdftex.def 
    355359File: pdftex.def 2011/05/27 v0.06d Graphics/color for pdfTeX 
    356360 
    357 (/usr/share/texlive/texmf-dist/tex/generic/oberdiek/infwarerr.sty 
    358 Package: infwarerr 2010/04/08 v1.3 Providing info/warning/error messages (HO) 
    359 ) 
    360 (/usr/share/texlive/texmf-dist/tex/generic/oberdiek/ltxcmds.sty 
    361 Package: ltxcmds 2011/11/09 v1.22 LaTeX kernel commands for general use (HO) 
     361(/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/infwarerr.sty 
     362Package: infwarerr 2016/05/16 v1.4 Providing info/warning/error messages (HO) 
     363) 
     364(/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/ltxcmds.sty 
     365Package: ltxcmds 2016/05/16 v1.23 LaTeX kernel commands for general use (HO) 
    362366) 
    363367\Gread@gobject=\count87 
     
    366370\Gin@req@width=\dimen104 
    367371) 
    368 (/usr/share/texlive/texmf-dist/tex/latex/listings/listings.sty 
     372(/usr/local/texlive/2016/texmf-dist/tex/latex/listings/listings.sty 
    369373\lst@mode=\count88 
    370374\lst@gtempboxa=\box26 
     
    380384\lst@maxwidth=\dimen108 
    381385 
    382 (/usr/share/texlive/texmf-dist/tex/latex/listings/lstmisc.sty 
     386(/usr/local/texlive/2016/texmf-dist/tex/latex/listings/lstmisc.sty 
    383387File: lstmisc.sty 2015/06/04 1.6 (Carsten Heinz) 
    384388\c@lstnumber=\count94 
     
    386390\lst@framebox=\box27 
    387391) 
    388 (/usr/share/texlive/texmf-dist/tex/latex/listings/listings.cfg 
     392(/usr/local/texlive/2016/texmf-dist/tex/latex/listings/listings.cfg 
    389393File: listings.cfg 2015/06/04 1.6 listings configuration 
    390394)) 
    391395Package: listings 2015/06/04 1.6 (Carsten Heinz) 
    392396 
    393 (/usr/share/texlive/texmf-dist/tex/latex/xcolor/xcolor.sty 
    394 Package: xcolor 2007/01/21 v2.11 LaTeX color extensions (UK) 
    395  
    396 (/usr/share/texlive/texmf-dist/tex/latex/latexconfig/color.cfg 
    397 File: color.cfg 2007/01/18 v1.5 color configuration of teTeX/TeXLive 
     397(/usr/local/texlive/2016/texmf-dist/tex/latex/xcolor/xcolor.sty 
     398Package: xcolor 2016/05/11 v2.12 LaTeX color extensions (UK) 
     399 
     400(/usr/local/texlive/2016/texmf-dist/tex/latex/graphics-cfg/color.cfg 
     401File: color.cfg 2016/01/02 v1.6 sample color configuration 
    398402) 
    399403Package xcolor Info: Package option `usenames' ignored on input line 216. 
    400404Package xcolor Info: Driver file: pdftex.def on input line 225. 
    401405 
    402 (/usr/share/texlive/texmf-dist/tex/latex/colortbl/colortbl.sty 
     406(/usr/local/texlive/2016/texmf-dist/tex/latex/colortbl/colortbl.sty 
    403407Package: colortbl 2012/02/13 v1.0a Color table columns (DPC) 
    404408 
    405 (/usr/share/texlive/texmf-dist/tex/latex/tools/array.sty 
     409(/usr/local/texlive/2016/texmf-dist/tex/latex/tools/array.sty 
    406410Package: array 2014/10/28 v2.4c Tabular extension package (FMi) 
    407411\col@sep=\dimen109 
     
    415419) 
    416420\rownum=\count96 
    417 Package xcolor Info: Model `cmy' substituted by `cmy0' on input line 1337. 
    418 Package xcolor Info: Model `hsb' substituted by `rgb' on input line 1341. 
    419 Package xcolor Info: Model `RGB' extended on input line 1353. 
    420 Package xcolor Info: Model `HTML' substituted by `rgb' on input line 1355. 
    421 Package xcolor Info: Model `Hsb' substituted by `hsb' on input line 1356. 
    422 Package xcolor Info: Model `tHsb' substituted by `hsb' on input line 1357. 
    423 Package xcolor Info: Model `HSB' substituted by `hsb' on input line 1358. 
    424 Package xcolor Info: Model `Gray' substituted by `gray' on input line 1359. 
    425 Package xcolor Info: Model `wave' substituted by `hsb' on input line 1360. 
    426  
    427 (/usr/share/texlive/texmf-dist/tex/latex/graphics/dvipsnam.def 
     421Package xcolor Info: Model `cmy' substituted by `cmy0' on input line 1348. 
     422Package xcolor Info: Model `hsb' substituted by `rgb' on input line 1352. 
     423Package xcolor Info: Model `RGB' extended on input line 1364. 
     424Package xcolor Info: Model `HTML' substituted by `rgb' on input line 1366. 
     425Package xcolor Info: Model `Hsb' substituted by `hsb' on input line 1367. 
     426Package xcolor Info: Model `tHsb' substituted by `hsb' on input line 1368. 
     427Package xcolor Info: Model `HSB' substituted by `hsb' on input line 1369. 
     428Package xcolor Info: Model `Gray' substituted by `gray' on input line 1370. 
     429Package xcolor Info: Model `wave' substituted by `hsb' on input line 1371. 
     430 
     431(/usr/local/texlive/2016/texmf-dist/tex/latex/graphics/dvipsnam.def 
    428432File: dvipsnam.def 2015/12/30 v3.0k Driver-dependent file (DPC,SPQR) 
    429433) 
    430 (/usr/share/texlive/texmf-dist/tex/latex/xcolor/svgnam.def 
    431 File: svgnam.def 2007/01/21 v2.11 Predefined colors according to SVG 1.1 (UK) 
     434(/usr/local/texlive/2016/texmf-dist/tex/latex/xcolor/svgnam.def 
     435File: svgnam.def 2016/05/11 v2.12 Predefined colors according to SVG 1.1 (UK) 
    432436)) 
    433 (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsmath.sty 
    434 Package: amsmath 2016/03/03 v2.15a AMS math features 
     437(/usr/local/texlive/2016/texmf-dist/tex/latex/amsmath/amsmath.sty 
     438Package: amsmath 2016/03/10 v2.15b AMS math features 
    435439\@mathmargin=\skip46 
    436440 
    437441For additional information on amsmath, use the `?' option. 
    438 (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amstext.sty 
     442(/usr/local/texlive/2016/texmf-dist/tex/latex/amsmath/amstext.sty 
    439443Package: amstext 2000/06/29 v2.01 AMS text 
    440444 
    441 (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsgen.sty 
     445(/usr/local/texlive/2016/texmf-dist/tex/latex/amsmath/amsgen.sty 
    442446File: amsgen.sty 1999/11/30 v2.0 generic functions 
    443447\@emptytoks=\toks20 
    444448\ex@=\dimen111 
    445449)) 
    446 (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsbsy.sty 
     450(/usr/local/texlive/2016/texmf-dist/tex/latex/amsmath/amsbsy.sty 
    447451Package: amsbsy 1999/11/29 v1.2d Bold Symbols 
    448452\pmbraise@=\dimen112 
    449453) 
    450 (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsopn.sty 
    451 Package: amsopn 1999/12/14 v2.01 operator names 
     454(/usr/local/texlive/2016/texmf-dist/tex/latex/amsmath/amsopn.sty 
     455Package: amsopn 2016/03/08 v2.02 operator names 
    452456) 
    453457\inf@bad=\count97 
     
    464468\strutbox@=\box29 
    465469\big@size=\dimen113 
    466 LaTeX Font Info:    Redeclaring font encoding OML on input line 630. 
    467 LaTeX Font Info:    Redeclaring font encoding OMS on input line 631. 
     470LaTeX Font Info:    Redeclaring font encoding OML on input line 634. 
     471LaTeX Font Info:    Redeclaring font encoding OMS on input line 635. 
    468472\macc@depth=\count102 
    469473\c@MaxMatrixCols=\count103 
     
    486490\multlinetaggap=\skip48 
    487491\mathdisplay@stack=\toks24 
    488 LaTeX Info: Redefining \[ on input line 2735. 
    489 LaTeX Info: Redefining \] on input line 2736. 
    490 ) 
    491 (/usr/share/texlive/texmf-dist/tex/latex/url/url.sty 
     492LaTeX Info: Redefining \[ on input line 2739. 
     493LaTeX Info: Redefining \] on input line 2740. 
     494) 
     495(/usr/local/texlive/2016/texmf-dist/tex/latex/url/url.sty 
    492496\Urlmuskip=\muskip11 
    493497Package: url 2013/09/16  ver 3.4  Verb mode for urls, etc. 
    494 ) (./rapport ESIWACE.aux) 
     498) 
     499(./rapport ESIWACE.aux) 
    495500\openout1 = `"rapport ESIWACE.aux"'. 
    496501 
     
    508513LaTeX Font Info:    ... okay on input line 16. 
    509514 
    510 (/usr/share/texlive/texmf-dist/tex/context/base/supp-pdf.mkii 
     515(/usr/local/texlive/2016/texmf-dist/tex/context/base/mkii/supp-pdf.mkii 
    511516[Loading MPS to PDF converter (version 2006.09.02).] 
    512517\scratchcounter=\count109 
     
    521526\makeMPintoPDFobject=\count114 
    522527\everyMPtoPDFconversion=\toks26 
    523 ) (/usr/share/texlive/texmf-dist/tex/generic/oberdiek/pdftexcmds.sty 
    524 Package: pdftexcmds 2011/11/29 v0.20 Utility functions of pdfTeX for LuaTeX (HO 
    525 ) 
    526  
    527 (/usr/share/texlive/texmf-dist/tex/generic/oberdiek/ifluatex.sty 
    528 Package: ifluatex 2010/03/01 v1.3 Provides the ifluatex switch (HO) 
     528) (/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/pdftexcmds.sty 
     529Package: pdftexcmds 2016/05/10 v0.21 Utility functions of pdfTeX for LuaTeX (HO 
     530) 
     531 
     532(/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/ifluatex.sty 
     533Package: ifluatex 2016/05/16 v1.4 Provides the ifluatex switch (HO) 
    529534Package ifluatex Info: LuaTeX not detected. 
    530535) 
    531 (/usr/share/texlive/texmf-dist/tex/generic/oberdiek/ifpdf.sty 
    532 Package: ifpdf 2011/01/30 v2.3 Provides the ifpdf switch (HO) 
    533 Package ifpdf Info: pdfTeX in PDF mode is detected. 
     536(/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/ifpdf.sty 
     537Package: ifpdf 2016/05/14 v3.1 Provides the ifpdf switch 
    534538) 
    535539Package pdftexcmds Info: LuaTeX not detected. 
     
    538542Package pdftexcmds Info: \pdfdraftmode found. 
    539543) 
    540 (/usr/share/texlive/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty 
    541 Package: epstopdf-base 2010/02/09 v2.5 Base part for package epstopdf 
    542  
    543 (/usr/share/texlive/texmf-dist/tex/latex/oberdiek/grfext.sty 
    544 Package: grfext 2010/08/19 v1.1 Manage graphics extensions (HO) 
    545  
    546 (/usr/share/texlive/texmf-dist/tex/generic/oberdiek/kvdefinekeys.sty 
    547 Package: kvdefinekeys 2011/04/07 v1.3 Define keys (HO) 
     544(/usr/local/texlive/2016/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty 
     545Package: epstopdf-base 2016/05/15 v2.6 Base part for package epstopdf 
     546 
     547(/usr/local/texlive/2016/texmf-dist/tex/latex/oberdiek/grfext.sty 
     548Package: grfext 2016/05/16 v1.2 Manage graphics extensions (HO) 
     549 
     550(/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/kvdefinekeys.sty 
     551Package: kvdefinekeys 2016/05/16 v1.4 Define keys (HO) 
    548552)) 
    549 (/usr/share/texlive/texmf-dist/tex/latex/oberdiek/kvoptions.sty 
    550 Package: kvoptions 2011/06/30 v3.11 Key value format for package options (HO) 
    551  
    552 (/usr/share/texlive/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty 
    553 Package: kvsetkeys 2012/04/25 v1.16 Key value parser (HO) 
    554  
    555 (/usr/share/texlive/texmf-dist/tex/generic/oberdiek/etexcmds.sty 
    556 Package: etexcmds 2011/02/16 v1.5 Avoid name clashes with e-TeX commands (HO) 
     553(/usr/local/texlive/2016/texmf-dist/tex/latex/oberdiek/kvoptions.sty 
     554Package: kvoptions 2016/05/16 v3.12 Key value format for package options (HO) 
     555 
     556(/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty 
     557Package: kvsetkeys 2016/05/16 v1.17 Key value parser (HO) 
     558 
     559(/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/etexcmds.sty 
     560Package: etexcmds 2016/05/16 v1.6 Avoid name clashes with e-TeX commands (HO) 
    557561Package etexcmds Info: Could not find \expanded. 
    558562(etexcmds)             That can mean that you are not using pdfTeX 1.50 or 
     
    563567(grfext)             [.png,.pdf,.jpg,.mps,.jpeg,.jbig2,.jb2,.PNG,.PDF,.JPG,.JPE 
    564568G,.JBIG2,.JB2,.eps] 
    565 (grfext)             \AppendGraphicsExtensions on input line 452. 
    566  
    567 (/usr/share/texlive/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg 
     569(grfext)             \AppendGraphicsExtensions on input line 456. 
     570 
     571(/usr/local/texlive/2016/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg 
    568572File: epstopdf-sys.cfg 2010/07/13 v1.3 Configuration of (r)epstopdf for TeX Liv 
    569573e 
     
    584588 [1 
    585589 
    586 {/var/lib/texmf/fonts/map/pdftex/updmap/pdftex.map} <./Charge1.png> <./Charge2. 
    587 png>] [2] 
    588 [3] <LMDZ_perf.png, id=24, 530.73282pt x 255.95625pt> 
     590{/usr/local/texlive/2016/texmf-var/fonts/map/pdftex/updmap/pdftex.map} <./Charg 
     591e1.png> <./Charge2.png>] <domain.pdf, id=16, 472.31454pt x 142.26149pt> 
     592File: domain.pdf Graphic file (type pdf) 
     593 <use domain.pdf> 
     594Package pdftex.def Info: domain.pdf used on input line 59. 
     595(pdftex.def)             Requested size: 236.1567pt x 71.13055pt. 
     596 
     597<omp.pdf, id=17, 486.07599pt x 210.5466pt> 
     598File: omp.pdf Graphic file (type pdf) 
     599 <use omp.pdf> 
     600Package pdftex.def Info: omp.pdf used on input line 67. 
     601(pdftex.def)             Requested size: 291.64784pt x 126.32893pt. 
     602 
     603 
     604LaTeX Warning: `!h' float specifier changed to `!ht'. 
     605 
     606[2 <./domain.pdf>] <scheme.png, id=27, 665.48625pt x 517.935pt> 
     607File: scheme.png Graphic file (type png) 
     608 
     609<use scheme.png> 
     610Package pdftex.def Info: scheme.png used on input line 79. 
     611(pdftex.def)             Requested size: 266.18977pt x 207.17032pt. 
     612 [3 <./omp.pdf> <./scheme.png (PNG copy)>] [4] 
     613<LMDZ_perf.png, id=39, 530.73282pt x 255.95625pt> 
    589614File: LMDZ_perf.png Graphic file (type png) 
    590615 <use LMDZ_perf.png> 
    591 Package pdftex.def Info: LMDZ_perf.png used on input line 122. 
     616Package pdftex.def Info: LMDZ_perf.png used on input line 144. 
    592617(pdftex.def)             Requested size: 318.44214pt x 153.57492pt. 
    593  
    594 [4 <./LMDZ_perf.png (PNG copy)>] (./rapport ESIWACE.aux) )  
     618 [5 <./LMDZ_perf.png (PNG copy)>] (./rapport ESIWACE.bbl) [6] (./rapport ESIWAC 
     619E.aux) )  
    595620Here is how much of TeX's memory you used: 
    596  4569 strings out of 494953 
    597  60237 string characters out of 6180977 
    598  137800 words of memory out of 5000000 
    599  7791 multiletter control sequences out of 15000+600000 
     621 4595 strings out of 493014 
     622 61054 string characters out of 6133351 
     623 142700 words of memory out of 5000000 
     624 8068 multiletter control sequences out of 15000+600000 
    600625 9090 words of font info for 34 fonts, out of 8000000 for 9000 
    601  14 hyphenation exceptions out of 8191 
    602  41i,8n,35p,426b,262s stack positions out of 5000i,500n,10000p,200000b,80000s 
    603 </usr/share/texlive/t 
    604 exmf-dist/fonts/type1/public/amsfonts/cm/cmbx12.pfb></usr/share/texlive/texmf-d 
    605 ist/fonts/type1/public/amsfonts/cm/cmmi10.pfb></usr/share/texlive/texmf-dist/fo 
    606 nts/type1/public/amsfonts/cm/cmmi7.pfb></usr/share/texlive/texmf-dist/fonts/typ 
    607 e1/public/amsfonts/cm/cmr10.pfb></usr/share/texlive/texmf-dist/fonts/type1/publ 
    608 ic/amsfonts/cm/cmr12.pfb></usr/share/texlive/texmf-dist/fonts/type1/public/amsf 
    609 onts/cm/cmr17.pfb></usr/share/texlive/texmf-dist/fonts/type1/public/amsfonts/cm 
    610 /cmr6.pfb></usr/share/texlive/texmf-dist/fonts/type1/public/amsfonts/cm/cmr7.pf 
    611 b></usr/share/texlive/texmf-dist/fonts/type1/public/amsfonts/cm/cmr8.pfb></usr/ 
    612 share/texlive/texmf-dist/fonts/type1/public/amsfonts/cm/cmsy10.pfb></usr/share/ 
    613 texlive/texmf-dist/fonts/type1/public/amsfonts/cm/cmti10.pfb></usr/share/texliv 
    614 e/texmf-dist/fonts/type1/public/amsfonts/cm/cmtt10.pfb></usr/share/texlive/texm 
    615 f-dist/fonts/type1/public/amsfonts/cm/cmtt8.pfb> 
    616 Output written on "rapport ESIWACE.pdf" (4 pages, 178489 bytes). 
     626 1141 hyphenation exceptions out of 8191 
     627 41i,8n,35p,1270b,264s stack positions out of 5000i,500n,10000p,200000b,80000s 
     628</usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx 
     62912.pfb></usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi1 
     6300.pfb></usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi7. 
     631pfb></usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr10.pf 
     632b></usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr12.pfb> 
     633</usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr17.pfb></ 
     634usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr6.pfb></usr 
     635/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr7.pfb></usr/lo 
     636cal/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr8.pfb></usr/local 
     637/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmsy10.pfb></usr/local/ 
     638texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmti10.pfb></usr/local/t 
     639exlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmtt10.pfb></usr/local/te 
     640xlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmtt8.pfb> 
     641Output written on "rapport ESIWACE.pdf" (6 pages, 229957 bytes). 
    617642PDF statistics: 
    618  72 PDF objects out of 1000 (max. 8388607) 
    619  49 compressed objects within 1 object stream 
     643 90 PDF objects out of 1000 (max. 8388607) 
     644 62 compressed objects within 1 object stream 
    620645 0 named destinations out of 1000 (max. 500000) 
    621  16 words of extra memory for PDF output out of 10000 (max. 10000000) 
    622  
     646 31 words of extra memory for PDF output out of 10000 (max. 10000000) 
     647 
  • XIOS/dev/branch_openmp/Note/rapport ESIWACE.tex

    r1548 r1551  
    99% Title Page 
    1010 
    11 \title{Developping XIOS with multithread : to accelerate the IO of climate models} 
     11\title{Developing XIOS with multi-thread : to accelerate the I/O of climate models} 
    1212 
    1313\author{} 
     
    2020 
    2121The simulation models of climate systems, running on a large number of computing resources can produce an important volume of data. At this  
    22 scale, the IO and the post-treatement of data becomes a bottle-neck for the performance. In order to manage efficiently the data flux  
    23 generated by the simulations, we use XIOS developped by the Institut Pierre Simon Laplace and Maison de la simulation. 
     22scale, the I/O and the post-treatment of data becomes a bottle-neck for the performance. In order to manage efficiently the data flux  
     23generated by the simulations, we use XIOS developed by the Institut Pierre Simon Laplace and Maison de la simulation. 
    2424 
    25 XIOS, a libarary dedicated to intense calculates, allows us to easily and efficiently manage the parallel IO on the storage systems. XIOS  
     25XIOS, a library dedicated to intense calculates, allows us to easily and efficiently manage the parallel I/O on the storage systems. XIOS  
    2626uses the client/server scheme in which computing resources (server) are reserved exclusively for IO in order to minimize their impact on  
    27 the performance of the climate models (client). The clients and servers are executed in parallel and communicate asynchronuously. In this  
    28 way, the IO peaks can be smoothed out as data fluxes are send to server constantly throughout the simulation and the time spent on data  
     27the performance of the climate models (client). The clients and servers are executed in parallel and communicate asynchronously. In this  
     28way, the I/O peaks can be smoothed out as data fluxes are send to server constantly throughout the simulation and the time spent on data  
    2929writing on the server side can be overlapped completely by calculates on the client side.  
    3030 
     
    3232\includegraphics[scale=0.4]{Charge1.png} 
    3333\includegraphics[scale=0.4]{Charge2.png} 
    34 \caption{On the left, each peak of computing power corresponds to the vallay of memory bandwidth which shows that the computing resources  
    35 are alternating between calculates and IO. ON the right, both curves are smooth which means that the computing resources have a stable  
    36 charge of work, either calculates or IO.} 
     34\caption{On the left, each peak of computing power corresponds to the valley of memory bandwidth which shows that the computing resources  
     35are alternating between calculates and I/O. ON the right, both curves are smooth which means that the computing resources have a stable  
     36charge of work, either calculates or I/O.} 
    3737\end{figure} 
    3838 
    3939 
    4040XIOS works well with many climate simulation codes. For example, LMDZ\footnote{LMDZ is a general circulation model (or global climate model)  
    41 developped since the 70s at the "Laboratoire de Météorologie Dynamique", which includes various variants for the Earth and other planets  
     41developed since the 70s at the "Laboratoire de Météorologie Dynamique", which includes various variants for the Earth and other planets  
    4242(Mars, Titan, Venus, Exoplanets). The 'Z' in LMDZ stands for "zoom" (and the 'LMD' is for  'Laboratoire de Météorologie Dynamique").  
    43 \url{http://lmdz.lmd.jussieu.fr}}, NENO\footnote{Nucleus for European Modelling of the Ocean alias NEMO is a  
     43\url{http://lmdz.lmd.jussieu.fr}}, NENO\footnote{Nucleus for European Modeling of the Ocean alias NEMO is a  
    4444state-of-the-art modelling framework of ocean related engines. \url{https://www.nemo-ocean.eu}}, ORCHIDEE\footnote{the land surface  
    4545model of the IPSL (Institut Pierre Simon Laplace) Earth System Model. \url{https://orchidee.ipsl.fr}}, and DYNAMICO\footnote{The DYNAMICO  
    4646project develops a new dynamical core for LMD-Z, the atmospheric general circulation model (GCM) part of IPSL-CM Earth System Model.  
    47 \url{http://www.lmd.polytechnique.fr/~dubos/DYNAMICO/}} all use XIOS as the output backend. M\'et\'eoFrance and MetOffice also choose XIOS  
    48 to manege the IO for their models. 
     47\url{http://www.lmd.polytechnique.fr/~dubos/DYNAMICO/}} all use XIOS as the output back end. M\'et\'eoFrance and MetOffice also choose XIOS  
     48to manege the I/O for their models. 
    4949 
    5050 
    51 \section{Developpement of thread-friendly XIOS} 
     51\section{Development of thread-friendly XIOS} 
     52 
     53Although XIOS copes well with many models, there is one potential optimization in XIOS which needs to be investigated: making XIOS thread-friendly. 
     54 
     55This topic comes along with the configuration of the climate models. Take LMDZ as example, it is designed with the 2-level parallelization scheme. To be more specific, LMDZ uses the domain decomposition method in which each sub-domain is associated with one MPI process. Inside of the sub-domain, the model also uses OpenMP derivatives to accelerate the computation. We can imagine that the sub-domain be divided into sub-sub-domain and is managed by threads.  
     56 
     57\begin{figure}[h] 
     58\centering 
     59\includegraphics[scale=0.5]{domain.pdf} 
     60\caption{Illustration of the domain decomposition used in LMDZ.} 
     61\end{figure} 
     62 
     63As we know, each sub-domain, or in another word, each MPI process is a XIOS client. The data exchange between client and XIOS servers is handled by MPI communications. In order to write an output field, all threads must gather the data to the master thread who acts as MPI process in order to call MPI routines. There are two disadvantages about this method : first, we have to spend time on gathering information to the master thread which not only increases the memory use, but also implies an OpenMP barrier; second, while the master thread calls MPI routine, other threads are in the idle state thus a waster of computing resources. What we want obtain with the thread-friendly XIOS is that all threads can act like MPI processes. They can call directly the MPI routine thus no waste in memory nor in computing resources as shown in Figure \ref{fig:omp}. 
     64 
     65\begin{figure}[h!] 
     66\centering 
     67\includegraphics[scale=0.6]{omp.pdf} 
     68\caption{} 
     69\label{fig:omp} 
     70\end{figure} 
     71 
     72There are two ways to make XIOS thread-friendly. First of all, change the structure of XIOS which demands a lot of modification is the XIOS library. Knowing that XIOS is about 100 000 lines of code, this method will be very time consuming. What's more, the modification will be local to XIOS. If we want to optimize an other code to be thread-friendly, we have to redo the modifications. The second choice is to add an extra interface to MPI in order to manage the threads. When a thread want to call an MPI routine inside XIOS, it will first pass the interface, in which the communication information will be analyzed before the MPI routine is invoked. With this method, we only need to modify a very small part of XIOS in order to make it work. What is more interesting is that the interface we created can be adjusted to suit other MPI based libraries. 
    5273 
    5374 
    54 XIOS is a library dedicated to IO management of climate code. It has a client-server pattern in which clients are in charge of computations  
    55 and servers manage the reading and writing of files. The communication between clients and servers are handled by MPI. 
    56 However, some of the climate models (\textit{e.g.} LMDZ) nowadays use an hybrid programming policy. Within a shared memory node, OpenMP  
    57 directives are used to manage message exchanges. In such configuration, XIOS can not take full advantages of the computing resources to  
    58 maximize the performance. This is because XIOS can only work with MPI processes. Before each call of XIOS routines, threads of one MPI  
    59 process must gather their information to the master thread who works as an MPI process. After the call, the master thread distributes the  
    60 updated information among its slave threads. As result, all slave threads have to wait while the master thread calls the XIOS routines.  
    61 This introduce extra synchronization into the model and leads to not optimized performance. Aware of this situation, we need to develop a  
    62 new version of XIOS (EP\_XIOS) which can work with threads, or in other words, can consider threads as they were processes. To do so, we  
    63 introduce the MPI endpoints.   
     75In this project, we choose to implement the interface to handle the threads. To do so, we introduce the MPI\_endpoint which is a concept proposed in the last MPI Forum and several papers has already discussed the importance of such idea and have introduced the framework of the MPI\_endpoint \cite{Dinan:2013}\cite{Sridharan:2014}. The concept of an endpoint is shown by Figure \ref{fig:scheme}. Threads of an MPI process is associated with a unique rank (global endpoint rank) and an endpoint communicator. They also have a local rank (rank inside the MPI process) which is very similar to the \verb|OMP_thread_num| rank.  
     76 
     77\begin{figure}[h!] 
     78\begin{center} 
     79\includegraphics[scale=0.4]{scheme.png}  
     80\end{center} 
     81\caption{} 
     82\label{fig:scheme} 
     83\end{figure} 
     84 
     85%XIOS is a library dedicated to IO management of climate code. It has a client-server pattern in which clients are in charge of computations and servers manage the reading and writing of files. The communication between clients and servers are handled by MPI. However, some of the climate models (\textit{e.g.} LMDZ) nowadays use an hybrid programming policy. Within a shared memory node, OpenMP directives are used to manage message exchanges. In such configuration, XIOS can not take full advantages of the computing resources to maximize the performance. This is because XIOS can only work with MPI processes. Before each call of XIOS routines, threads of one MPI process must gather their information to the master thread who works as an MPI process. After the call, the master thread distributes the updated information among its slave threads. As result, all slave threads have to wait while the master thread calls the XIOS routines. This introduce extra synchronization into the model and leads to not optimized performance. Aware of this situation, we need to develop a new version of XIOS (EP\_XIOS) which can work with threads, or in other words, can consider threads as they were processes. To do so, we introduce the MPI endpoints.   
    6486 
    6587 
    66 The MPI endpoints (EP) is a layer on top of an existing MPI Implementation. All MPI function, or in our work the functions used in XIOS,  
    67 will be reimplemented in order to cope with OpenMP threads. The idea is that, in the MPI endpoints environment, each OpenMP thread will be  
     88The MPI\_endpoints interface we implemented lies on top of an existing MPI Implementation. It consists of wrappers to all MPI functions used in XIOS.  
     89 
     90will be re-implemented in order to cope with OpenMP threads. The idea is that, in the MPI endpoints environment, each OpenMP thread will be  
    6891associated with a unique rank and with an endpoint communicator. This rank (EP rank) will replace the role of the classic MPI rank and will  
    6992be used in MPI communications. In order to successfully execute an MPI communication, for example \verb|MPI_Send|, we know already which  
     
    7396 
    7497In XIOS, we used the ``probe'' technique to search for arrived messages and then performing the receive action. The principle is  
    75 that sender processes execute the send operations as usual. However, to minimise the time spent on waiting incoming messages, the receiver  
     98that sender processes execute the send operations as usual. However, to minimize the time spent on waiting incoming messages, the receiver  
    7699processe performs in the first place the \verb|MPI_Probe| function to check if a message destinated to it has been published. If yes, the  
    77100process execute in the second place the \verb|MPI_Recv| to receive the message. In this situation, if we introduce the threads, problems  
     
    135158decrease in time of 25\%. Even the 25\% may seems to be small, it is still a gain in performance with existing computing resources. 
    136159 
     160\section{Performance of EP\_XIOS} 
     161 
     162workfloz\_cmip6  
     163light output 
     16424*8+2 
     16530s - 52s 
     16632 days 
     167histmth with daily output 
     168 
    137169\section{Perspectives of EP\_XIOS} 
    138170 
     171 
     172\bibliographystyle{plain} 
     173\bibliography{reference} 
     174 
    139175\end{document}           
Note: See TracChangeset for help on using the changeset viewer.