Changeset 1551
- Timestamp:
- 06/26/18 00:28:38 (6 years ago)
- Location:
- XIOS/dev/branch_openmp/Note
- Files:
-
- 4 added
- 6 edited
Legend:
- Unmodified
- Added
- Removed
-
XIOS/dev/branch_openmp/Note/rapport ESIWACE.aux
r1548 r1551 1 1 \relax 2 2 \@writefile{toc}{\contentsline {section}{\numberline {1}Context}{1}} 3 \@writefile{lof}{\contentsline {figure}{\numberline {1}{\ignorespaces On the left, each peak of computing power corresponds to the vallay of memory bandwidth which shows that the computing resources are alternating between calculates and IO. ON the right, both curves are smooth which means that the computing resources have a stable charge of work, either calculates or IO.}}{1}} 4 \@writefile{toc}{\contentsline {section}{\numberline {2}Developpement of a thread-friendly MPI for XIOS}{2}} 5 \@writefile{toc}{\contentsline {section}{\numberline {3}Performance of LMDZ using EP\_XIOS}{3}} 6 \@writefile{lof}{\contentsline {figure}{\numberline {2}{\ignorespaces Speedup obtained by using EP in LMDZ simulations.}}{4}} 7 \@writefile{toc}{\contentsline {section}{\numberline {4}Perspectives of EP\_XIOS}{4}} 3 \@writefile{lof}{\contentsline {figure}{\numberline {1}{\ignorespaces On the left, each peak of computing power corresponds to the valley of memory bandwidth which shows that the computing resources are alternating between calculates and I/O. ON the right, both curves are smooth which means that the computing resources have a stable charge of work, either calculates or I/O.}}{1}} 4 \@writefile{toc}{\contentsline {section}{\numberline {2}Development of thread-friendly XIOS}{2}} 5 \@writefile{lof}{\contentsline {figure}{\numberline {2}{\ignorespaces Illustration of the domain decomposition used in LMDZ.}}{2}} 6 \citation{Dinan:2013} 7 \citation{Sridharan:2014} 8 \@writefile{lof}{\contentsline {figure}{\numberline {3}{\ignorespaces }}{3}} 9 \newlabel{fig:omp}{{3}{3}} 10 \@writefile{lof}{\contentsline {figure}{\numberline {4}{\ignorespaces }}{3}} 11 \newlabel{fig:scheme}{{4}{3}} 12 \@writefile{toc}{\contentsline {section}{\numberline {3}Performance of LMDZ using EP\_XIOS}{5}} 13 \@writefile{lof}{\contentsline {figure}{\numberline {5}{\ignorespaces Speedup obtained by using EP in LMDZ simulations.}}{5}} 14 \bibstyle{plain} 15 \bibdata{reference} 16 \bibcite{Dinan:2013}{1} 17 \bibcite{Sridharan:2014}{2} 18 \@writefile{toc}{\contentsline {section}{\numberline {4}Performance of EP\_XIOS}{6}} 19 \@writefile{toc}{\contentsline {section}{\numberline {5}Perspectives of EP\_XIOS}{6}} -
XIOS/dev/branch_openmp/Note/rapport ESIWACE.bbl
r1548 r1551 1 \begin{thebibliography}{1} 2 3 \bibitem{Dinan:2013} 4 J.~Dinan, Pavan Balaji, D.~Goodell, D.~Miller, M.~Snir, and Rajeev Thakur. 5 \newblock Enabling mpi interoperability through flexible communication 6 endpoints. 7 \newblock In {\em EuroMPI 2013}, Madrid, Spain, 2013. 8 9 \bibitem{Sridharan:2014} 10 S.~Sridharan, J.~Dinan, and D.~D. Kalamkar. 11 \newblock Enabling efficient multithreaded mpi communication through a 12 library-based implementation of mpi endpoints. 13 \newblock In {\em SC14: International Conference for High Performance 14 Computing, Networking, Storage and Analysis}, pages 487--498, Nov 2014. 15 16 \end{thebibliography} -
XIOS/dev/branch_openmp/Note/rapport ESIWACE.blg
r1548 r1551 1 This is BibTeX, Version 0.99d (TeX Live 201 5/Debian)1 This is BibTeX, Version 0.99d (TeX Live 2016) 2 2 Capacity: max_strings=35307, hash_size=35307, hash_prime=30011 3 3 The top-level auxiliary file: rapport ESIWACE.aux 4 I found no \citation commands---while reading file rapport ESIWACE.aux 5 I found no \bibdata command---while reading file rapport ESIWACE.aux 6 I found no \bibstyle command---while reading file rapport ESIWACE.aux 7 You've used 0 entries, 8 0 wiz_defined-function locations, 9 83 strings with 504 characters, 10 and the built_in function-call counts, 0 in all, are: 11 = -- 0 12 > -- 0 13 < -- 0 14 + -- 0 15 - -- 0 16 * -- 0 17 := -- 0 18 add.period$ -- 0 19 call.type$ -- 0 20 change.case$ -- 0 4 The style file: plain.bst 5 Database file #1: reference.bib 6 You've used 2 entries, 7 2118 wiz_defined-function locations, 8 512 strings with 4502 characters, 9 and the built_in function-call counts, 893 in all, are: 10 = -- 80 11 > -- 51 12 < -- 1 13 + -- 20 14 - -- 18 15 * -- 63 16 := -- 146 17 add.period$ -- 6 18 call.type$ -- 2 19 change.case$ -- 15 21 20 chr.to.int$ -- 0 22 cite$ -- 023 duplicate$ -- 024 empty$ -- 025 format.name$ -- 026 if$ -- 021 cite$ -- 2 22 duplicate$ -- 37 23 empty$ -- 68 24 format.name$ -- 18 25 if$ -- 192 27 26 int.to.chr$ -- 0 28 int.to.str$ -- 029 missing$ -- 030 newline$ -- 031 num.names$ -- 032 pop$ -- 033 preamble$ -- 034 purify$ -- 027 int.to.str$ -- 2 28 missing$ -- 2 29 newline$ -- 13 30 num.names$ -- 4 31 pop$ -- 22 32 preamble$ -- 1 33 purify$ -- 13 35 34 quote$ -- 0 36 skip$ -- 035 skip$ -- 25 37 36 stack$ -- 0 38 substring$ -- 039 swap$ -- 040 text.length$ -- 037 substring$ -- 38 38 swap$ -- 12 39 text.length$ -- 1 41 40 text.prefix$ -- 0 42 41 top$ -- 0 43 type$ -- 042 type$ -- 8 44 43 warning$ -- 0 45 while$ -- 0 46 width$ -- 0 47 write$ -- 0 48 (There were 3 error messages) 44 while$ -- 6 45 width$ -- 3 46 write$ -- 24 -
XIOS/dev/branch_openmp/Note/rapport ESIWACE.log
r1548 r1551 1 This is pdfTeX, Version 3.14159265-2.6-1.40.1 6 (TeX Live 2015/Debian) (preloaded format=pdflatex 2017.8.24) 22 JUN 2018 17:311 This is pdfTeX, Version 3.14159265-2.6-1.40.17 (TeX Live 2016) (preloaded format=pdflatex 2016.7.25) 25 JUN 2018 17:20 2 2 entering extended mode 3 3 restricted \write18 enabled. … … 5 5 **"rapport ESIWACE.tex" 6 6 (./rapport ESIWACE.tex 7 LaTeX2e <2016/0 2/01>8 Babel <3.9 q> and hyphenation patterns for3 language(s) loaded.9 (/usr/ share/texlive/texmf-dist/tex/latex/base/article.cls7 LaTeX2e <2016/03/31> 8 Babel <3.9r> and hyphenation patterns for 83 language(s) loaded. 9 (/usr/local/texlive/2016/texmf-dist/tex/latex/base/article.cls 10 10 Document Class: article 2014/09/29 v1.4h Standard LaTeX document class 11 (/usr/ share/texlive/texmf-dist/tex/latex/base/size10.clo11 (/usr/local/texlive/2016/texmf-dist/tex/latex/base/size10.clo 12 12 File: size10.clo 2014/09/29 v1.4h Standard LaTeX file (size option) 13 13 ) … … 24 24 \bibindent=\dimen102 25 25 ) 26 (/usr/ share/texlive/texmf-dist/tex/latex/base/inputenc.sty26 (/usr/local/texlive/2016/texmf-dist/tex/latex/base/inputenc.sty 27 27 Package: inputenc 2015/03/17 v1.2c Input encoding file 28 28 \inpenc@prehook=\toks14 29 29 \inpenc@posthook=\toks15 30 30 31 (/usr/ share/texlive/texmf-dist/tex/latex/base/utf8.def32 File: utf8.def 201 5/12/03 v1.1rUTF-8 support for inputenc31 (/usr/local/texlive/2016/texmf-dist/tex/latex/base/utf8.def 32 File: utf8.def 2016/02/28 v1.1s UTF-8 support for inputenc 33 33 Now handling font encoding OML ... 34 34 ... no UTF-8 mapping file for font encoding OML … … 36 36 ... processing UTF-8 mapping file for font encoding T1 37 37 38 (/usr/ share/texlive/texmf-dist/tex/latex/base/t1enc.dfu39 File: t1enc.dfu 201 5/12/03 v1.1rUTF-8 support for inputenc38 (/usr/local/texlive/2016/texmf-dist/tex/latex/base/t1enc.dfu 39 File: t1enc.dfu 2016/02/28 v1.1s UTF-8 support for inputenc 40 40 defining Unicode char U+00A0 (decimal 160) 41 41 defining Unicode char U+00A1 (decimal 161) … … 249 249 defining Unicode char U+021A (decimal 538) 250 250 defining Unicode char U+021B (decimal 539) 251 defining Unicode char U+ 01E02 (decimal 7682)252 defining Unicode char U+ 01E03 (decimal 7683)251 defining Unicode char U+1E02 (decimal 7682) 252 defining Unicode char U+1E03 (decimal 7683) 253 253 defining Unicode char U+200C (decimal 8204) 254 defining Unicode char U+2010 (decimal 8208) 255 defining Unicode char U+2011 (decimal 8209) 256 defining Unicode char U+2012 (decimal 8210) 254 257 defining Unicode char U+2013 (decimal 8211) 255 258 defining Unicode char U+2014 (decimal 8212) 259 defining Unicode char U+2015 (decimal 8213) 256 260 defining Unicode char U+2018 (decimal 8216) 257 261 defining Unicode char U+2019 (decimal 8217) … … 269 273 ... processing UTF-8 mapping file for font encoding OT1 270 274 271 (/usr/ share/texlive/texmf-dist/tex/latex/base/ot1enc.dfu272 File: ot1enc.dfu 201 5/12/03 v1.1rUTF-8 support for inputenc275 (/usr/local/texlive/2016/texmf-dist/tex/latex/base/ot1enc.dfu 276 File: ot1enc.dfu 2016/02/28 v1.1s UTF-8 support for inputenc 273 277 defining Unicode char U+00A0 (decimal 160) 274 278 defining Unicode char U+00A1 (decimal 161) … … 310 314 ... processing UTF-8 mapping file for font encoding OMS 311 315 312 (/usr/ share/texlive/texmf-dist/tex/latex/base/omsenc.dfu313 File: omsenc.dfu 201 5/12/03 v1.1rUTF-8 support for inputenc316 (/usr/local/texlive/2016/texmf-dist/tex/latex/base/omsenc.dfu 317 File: omsenc.dfu 2016/02/28 v1.1s UTF-8 support for inputenc 314 318 defining Unicode char U+00A7 (decimal 167) 315 319 defining Unicode char U+00B6 (decimal 182) … … 334 338 defining Unicode char U+2423 (decimal 9251) 335 339 )) 336 (/usr/ share/texlive/texmf-dist/tex/latex/graphics/graphicx.sty340 (/usr/local/texlive/2016/texmf-dist/tex/latex/graphics/graphicx.sty 337 341 Package: graphicx 2014/10/28 v1.0g Enhanced LaTeX Graphics (DPC,SPQR) 338 342 339 (/usr/ share/texlive/texmf-dist/tex/latex/graphics/keyval.sty343 (/usr/local/texlive/2016/texmf-dist/tex/latex/graphics/keyval.sty 340 344 Package: keyval 2014/10/28 v1.15 key=value parser (DPC) 341 345 \KV@toks@=\toks16 342 346 ) 343 (/usr/ share/texlive/texmf-dist/tex/latex/graphics/graphics.sty344 Package: graphics 2016/0 1/03 v1.0qStandard LaTeX Graphics (DPC,SPQR)345 346 (/usr/ share/texlive/texmf-dist/tex/latex/graphics/trig.sty347 (/usr/local/texlive/2016/texmf-dist/tex/latex/graphics/graphics.sty 348 Package: graphics 2016/05/09 v1.0r Standard LaTeX Graphics (DPC,SPQR) 349 350 (/usr/local/texlive/2016/texmf-dist/tex/latex/graphics/trig.sty 347 351 Package: trig 2016/01/03 v1.10 sin cos tan (DPC) 348 352 ) 349 (/usr/ share/texlive/texmf-dist/tex/latex/latexconfig/graphics.cfg350 File: graphics.cfg 201 0/04/23 v1.9 graphics configuration of TeX Live351 ) 352 Package graphics Info: Driver file: pdftex.def on input line 9 5.353 354 (/usr/ share/texlive/texmf-dist/tex/latex/pdftex-def/pdftex.def353 (/usr/local/texlive/2016/texmf-dist/tex/latex/graphics-cfg/graphics.cfg 354 File: graphics.cfg 2016/01/02 v1.10 sample graphics configuration 355 ) 356 Package graphics Info: Driver file: pdftex.def on input line 96. 357 358 (/usr/local/texlive/2016/texmf-dist/tex/latex/pdftex-def/pdftex.def 355 359 File: pdftex.def 2011/05/27 v0.06d Graphics/color for pdfTeX 356 360 357 (/usr/ share/texlive/texmf-dist/tex/generic/oberdiek/infwarerr.sty358 Package: infwarerr 201 0/04/08 v1.3Providing info/warning/error messages (HO)359 ) 360 (/usr/ share/texlive/texmf-dist/tex/generic/oberdiek/ltxcmds.sty361 Package: ltxcmds 201 1/11/09 v1.22LaTeX kernel commands for general use (HO)361 (/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/infwarerr.sty 362 Package: infwarerr 2016/05/16 v1.4 Providing info/warning/error messages (HO) 363 ) 364 (/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/ltxcmds.sty 365 Package: ltxcmds 2016/05/16 v1.23 LaTeX kernel commands for general use (HO) 362 366 ) 363 367 \Gread@gobject=\count87 … … 366 370 \Gin@req@width=\dimen104 367 371 ) 368 (/usr/ share/texlive/texmf-dist/tex/latex/listings/listings.sty372 (/usr/local/texlive/2016/texmf-dist/tex/latex/listings/listings.sty 369 373 \lst@mode=\count88 370 374 \lst@gtempboxa=\box26 … … 380 384 \lst@maxwidth=\dimen108 381 385 382 (/usr/ share/texlive/texmf-dist/tex/latex/listings/lstmisc.sty386 (/usr/local/texlive/2016/texmf-dist/tex/latex/listings/lstmisc.sty 383 387 File: lstmisc.sty 2015/06/04 1.6 (Carsten Heinz) 384 388 \c@lstnumber=\count94 … … 386 390 \lst@framebox=\box27 387 391 ) 388 (/usr/ share/texlive/texmf-dist/tex/latex/listings/listings.cfg392 (/usr/local/texlive/2016/texmf-dist/tex/latex/listings/listings.cfg 389 393 File: listings.cfg 2015/06/04 1.6 listings configuration 390 394 )) 391 395 Package: listings 2015/06/04 1.6 (Carsten Heinz) 392 396 393 (/usr/ share/texlive/texmf-dist/tex/latex/xcolor/xcolor.sty394 Package: xcolor 20 07/01/21 v2.11LaTeX color extensions (UK)395 396 (/usr/ share/texlive/texmf-dist/tex/latex/latexconfig/color.cfg397 File: color.cfg 20 07/01/18 v1.5 color configuration of teTeX/TeXLive397 (/usr/local/texlive/2016/texmf-dist/tex/latex/xcolor/xcolor.sty 398 Package: xcolor 2016/05/11 v2.12 LaTeX color extensions (UK) 399 400 (/usr/local/texlive/2016/texmf-dist/tex/latex/graphics-cfg/color.cfg 401 File: color.cfg 2016/01/02 v1.6 sample color configuration 398 402 ) 399 403 Package xcolor Info: Package option `usenames' ignored on input line 216. 400 404 Package xcolor Info: Driver file: pdftex.def on input line 225. 401 405 402 (/usr/ share/texlive/texmf-dist/tex/latex/colortbl/colortbl.sty406 (/usr/local/texlive/2016/texmf-dist/tex/latex/colortbl/colortbl.sty 403 407 Package: colortbl 2012/02/13 v1.0a Color table columns (DPC) 404 408 405 (/usr/ share/texlive/texmf-dist/tex/latex/tools/array.sty409 (/usr/local/texlive/2016/texmf-dist/tex/latex/tools/array.sty 406 410 Package: array 2014/10/28 v2.4c Tabular extension package (FMi) 407 411 \col@sep=\dimen109 … … 415 419 ) 416 420 \rownum=\count96 417 Package xcolor Info: Model `cmy' substituted by `cmy0' on input line 13 37.418 Package xcolor Info: Model `hsb' substituted by `rgb' on input line 13 41.419 Package xcolor Info: Model `RGB' extended on input line 13 53.420 Package xcolor Info: Model `HTML' substituted by `rgb' on input line 13 55.421 Package xcolor Info: Model `Hsb' substituted by `hsb' on input line 13 56.422 Package xcolor Info: Model `tHsb' substituted by `hsb' on input line 13 57.423 Package xcolor Info: Model `HSB' substituted by `hsb' on input line 13 58.424 Package xcolor Info: Model `Gray' substituted by `gray' on input line 13 59.425 Package xcolor Info: Model `wave' substituted by `hsb' on input line 13 60.426 427 (/usr/ share/texlive/texmf-dist/tex/latex/graphics/dvipsnam.def421 Package xcolor Info: Model `cmy' substituted by `cmy0' on input line 1348. 422 Package xcolor Info: Model `hsb' substituted by `rgb' on input line 1352. 423 Package xcolor Info: Model `RGB' extended on input line 1364. 424 Package xcolor Info: Model `HTML' substituted by `rgb' on input line 1366. 425 Package xcolor Info: Model `Hsb' substituted by `hsb' on input line 1367. 426 Package xcolor Info: Model `tHsb' substituted by `hsb' on input line 1368. 427 Package xcolor Info: Model `HSB' substituted by `hsb' on input line 1369. 428 Package xcolor Info: Model `Gray' substituted by `gray' on input line 1370. 429 Package xcolor Info: Model `wave' substituted by `hsb' on input line 1371. 430 431 (/usr/local/texlive/2016/texmf-dist/tex/latex/graphics/dvipsnam.def 428 432 File: dvipsnam.def 2015/12/30 v3.0k Driver-dependent file (DPC,SPQR) 429 433 ) 430 (/usr/ share/texlive/texmf-dist/tex/latex/xcolor/svgnam.def431 File: svgnam.def 20 07/01/21 v2.11Predefined colors according to SVG 1.1 (UK)434 (/usr/local/texlive/2016/texmf-dist/tex/latex/xcolor/svgnam.def 435 File: svgnam.def 2016/05/11 v2.12 Predefined colors according to SVG 1.1 (UK) 432 436 )) 433 (/usr/ share/texlive/texmf-dist/tex/latex/amsmath/amsmath.sty434 Package: amsmath 2016/03/ 03 v2.15aAMS math features437 (/usr/local/texlive/2016/texmf-dist/tex/latex/amsmath/amsmath.sty 438 Package: amsmath 2016/03/10 v2.15b AMS math features 435 439 \@mathmargin=\skip46 436 440 437 441 For additional information on amsmath, use the `?' option. 438 (/usr/ share/texlive/texmf-dist/tex/latex/amsmath/amstext.sty442 (/usr/local/texlive/2016/texmf-dist/tex/latex/amsmath/amstext.sty 439 443 Package: amstext 2000/06/29 v2.01 AMS text 440 444 441 (/usr/ share/texlive/texmf-dist/tex/latex/amsmath/amsgen.sty445 (/usr/local/texlive/2016/texmf-dist/tex/latex/amsmath/amsgen.sty 442 446 File: amsgen.sty 1999/11/30 v2.0 generic functions 443 447 \@emptytoks=\toks20 444 448 \ex@=\dimen111 445 449 )) 446 (/usr/ share/texlive/texmf-dist/tex/latex/amsmath/amsbsy.sty450 (/usr/local/texlive/2016/texmf-dist/tex/latex/amsmath/amsbsy.sty 447 451 Package: amsbsy 1999/11/29 v1.2d Bold Symbols 448 452 \pmbraise@=\dimen112 449 453 ) 450 (/usr/ share/texlive/texmf-dist/tex/latex/amsmath/amsopn.sty451 Package: amsopn 1999/12/14 v2.01operator names454 (/usr/local/texlive/2016/texmf-dist/tex/latex/amsmath/amsopn.sty 455 Package: amsopn 2016/03/08 v2.02 operator names 452 456 ) 453 457 \inf@bad=\count97 … … 464 468 \strutbox@=\box29 465 469 \big@size=\dimen113 466 LaTeX Font Info: Redeclaring font encoding OML on input line 63 0.467 LaTeX Font Info: Redeclaring font encoding OMS on input line 63 1.470 LaTeX Font Info: Redeclaring font encoding OML on input line 634. 471 LaTeX Font Info: Redeclaring font encoding OMS on input line 635. 468 472 \macc@depth=\count102 469 473 \c@MaxMatrixCols=\count103 … … 486 490 \multlinetaggap=\skip48 487 491 \mathdisplay@stack=\toks24 488 LaTeX Info: Redefining \[ on input line 273 5.489 LaTeX Info: Redefining \] on input line 27 36.490 ) 491 (/usr/ share/texlive/texmf-dist/tex/latex/url/url.sty492 LaTeX Info: Redefining \[ on input line 2739. 493 LaTeX Info: Redefining \] on input line 2740. 494 ) 495 (/usr/local/texlive/2016/texmf-dist/tex/latex/url/url.sty 492 496 \Urlmuskip=\muskip11 493 497 Package: url 2013/09/16 ver 3.4 Verb mode for urls, etc. 494 ) (./rapport ESIWACE.aux) 498 ) 499 (./rapport ESIWACE.aux) 495 500 \openout1 = `"rapport ESIWACE.aux"'. 496 501 … … 508 513 LaTeX Font Info: ... okay on input line 16. 509 514 510 (/usr/ share/texlive/texmf-dist/tex/context/base/supp-pdf.mkii515 (/usr/local/texlive/2016/texmf-dist/tex/context/base/mkii/supp-pdf.mkii 511 516 [Loading MPS to PDF converter (version 2006.09.02).] 512 517 \scratchcounter=\count109 … … 521 526 \makeMPintoPDFobject=\count114 522 527 \everyMPtoPDFconversion=\toks26 523 ) (/usr/ share/texlive/texmf-dist/tex/generic/oberdiek/pdftexcmds.sty524 Package: pdftexcmds 201 1/11/29 v0.20Utility functions of pdfTeX for LuaTeX (HO525 ) 526 527 (/usr/ share/texlive/texmf-dist/tex/generic/oberdiek/ifluatex.sty528 Package: ifluatex 201 0/03/01 v1.3Provides the ifluatex switch (HO)528 ) (/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/pdftexcmds.sty 529 Package: pdftexcmds 2016/05/10 v0.21 Utility functions of pdfTeX for LuaTeX (HO 530 ) 531 532 (/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/ifluatex.sty 533 Package: ifluatex 2016/05/16 v1.4 Provides the ifluatex switch (HO) 529 534 Package ifluatex Info: LuaTeX not detected. 530 535 ) 531 (/usr/share/texlive/texmf-dist/tex/generic/oberdiek/ifpdf.sty 532 Package: ifpdf 2011/01/30 v2.3 Provides the ifpdf switch (HO) 533 Package ifpdf Info: pdfTeX in PDF mode is detected. 536 (/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/ifpdf.sty 537 Package: ifpdf 2016/05/14 v3.1 Provides the ifpdf switch 534 538 ) 535 539 Package pdftexcmds Info: LuaTeX not detected. … … 538 542 Package pdftexcmds Info: \pdfdraftmode found. 539 543 ) 540 (/usr/ share/texlive/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty541 Package: epstopdf-base 201 0/02/09 v2.5Base part for package epstopdf542 543 (/usr/ share/texlive/texmf-dist/tex/latex/oberdiek/grfext.sty544 Package: grfext 201 0/08/19 v1.1Manage graphics extensions (HO)545 546 (/usr/ share/texlive/texmf-dist/tex/generic/oberdiek/kvdefinekeys.sty547 Package: kvdefinekeys 201 1/04/07 v1.3Define keys (HO)544 (/usr/local/texlive/2016/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty 545 Package: epstopdf-base 2016/05/15 v2.6 Base part for package epstopdf 546 547 (/usr/local/texlive/2016/texmf-dist/tex/latex/oberdiek/grfext.sty 548 Package: grfext 2016/05/16 v1.2 Manage graphics extensions (HO) 549 550 (/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/kvdefinekeys.sty 551 Package: kvdefinekeys 2016/05/16 v1.4 Define keys (HO) 548 552 )) 549 (/usr/ share/texlive/texmf-dist/tex/latex/oberdiek/kvoptions.sty550 Package: kvoptions 201 1/06/30 v3.11Key value format for package options (HO)551 552 (/usr/ share/texlive/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty553 Package: kvsetkeys 201 2/04/25 v1.16Key value parser (HO)554 555 (/usr/ share/texlive/texmf-dist/tex/generic/oberdiek/etexcmds.sty556 Package: etexcmds 201 1/02/16 v1.5Avoid name clashes with e-TeX commands (HO)553 (/usr/local/texlive/2016/texmf-dist/tex/latex/oberdiek/kvoptions.sty 554 Package: kvoptions 2016/05/16 v3.12 Key value format for package options (HO) 555 556 (/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty 557 Package: kvsetkeys 2016/05/16 v1.17 Key value parser (HO) 558 559 (/usr/local/texlive/2016/texmf-dist/tex/generic/oberdiek/etexcmds.sty 560 Package: etexcmds 2016/05/16 v1.6 Avoid name clashes with e-TeX commands (HO) 557 561 Package etexcmds Info: Could not find \expanded. 558 562 (etexcmds) That can mean that you are not using pdfTeX 1.50 or … … 563 567 (grfext) [.png,.pdf,.jpg,.mps,.jpeg,.jbig2,.jb2,.PNG,.PDF,.JPG,.JPE 564 568 G,.JBIG2,.JB2,.eps] 565 (grfext) \AppendGraphicsExtensions on input line 45 2.566 567 (/usr/ share/texlive/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg569 (grfext) \AppendGraphicsExtensions on input line 456. 570 571 (/usr/local/texlive/2016/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg 568 572 File: epstopdf-sys.cfg 2010/07/13 v1.3 Configuration of (r)epstopdf for TeX Liv 569 573 e … … 584 588 [1 585 589 586 {/var/lib/texmf/fonts/map/pdftex/updmap/pdftex.map} <./Charge1.png> <./Charge2. 587 png>] [2] 588 [3] <LMDZ_perf.png, id=24, 530.73282pt x 255.95625pt> 590 {/usr/local/texlive/2016/texmf-var/fonts/map/pdftex/updmap/pdftex.map} <./Charg 591 e1.png> <./Charge2.png>] <domain.pdf, id=16, 472.31454pt x 142.26149pt> 592 File: domain.pdf Graphic file (type pdf) 593 <use domain.pdf> 594 Package pdftex.def Info: domain.pdf used on input line 59. 595 (pdftex.def) Requested size: 236.1567pt x 71.13055pt. 596 597 <omp.pdf, id=17, 486.07599pt x 210.5466pt> 598 File: omp.pdf Graphic file (type pdf) 599 <use omp.pdf> 600 Package pdftex.def Info: omp.pdf used on input line 67. 601 (pdftex.def) Requested size: 291.64784pt x 126.32893pt. 602 603 604 LaTeX Warning: `!h' float specifier changed to `!ht'. 605 606 [2 <./domain.pdf>] <scheme.png, id=27, 665.48625pt x 517.935pt> 607 File: scheme.png Graphic file (type png) 608 609 <use scheme.png> 610 Package pdftex.def Info: scheme.png used on input line 79. 611 (pdftex.def) Requested size: 266.18977pt x 207.17032pt. 612 [3 <./omp.pdf> <./scheme.png (PNG copy)>] [4] 613 <LMDZ_perf.png, id=39, 530.73282pt x 255.95625pt> 589 614 File: LMDZ_perf.png Graphic file (type png) 590 615 <use LMDZ_perf.png> 591 Package pdftex.def Info: LMDZ_perf.png used on input line 1 22.616 Package pdftex.def Info: LMDZ_perf.png used on input line 144. 592 617 (pdftex.def) Requested size: 318.44214pt x 153.57492pt. 593 594 [4 <./LMDZ_perf.png (PNG copy)>] (./rapport ESIWACE.aux) )618 [5 <./LMDZ_perf.png (PNG copy)>] (./rapport ESIWACE.bbl) [6] (./rapport ESIWAC 619 E.aux) ) 595 620 Here is how much of TeX's memory you used: 596 45 69 strings out of 494953597 6 0237 string characters out of 6180977598 1 37800 words of memory out of 5000000599 7791multiletter control sequences out of 15000+600000621 4595 strings out of 493014 622 61054 string characters out of 6133351 623 142700 words of memory out of 5000000 624 8068 multiletter control sequences out of 15000+600000 600 625 9090 words of font info for 34 fonts, out of 8000000 for 9000 601 1 4hyphenation exceptions out of 8191602 41i,8n,35p, 426b,262s stack positions out of 5000i,500n,10000p,200000b,80000s603 </usr/ share/texlive/t604 exmf-dist/fonts/type1/public/amsfonts/cm/cmbx12.pfb></usr/share/texlive/texmf-d 605 ist/fonts/type1/public/amsfonts/cm/cmmi10.pfb></usr/share/texlive/texmf-dist/fo 606 nts/type1/public/amsfonts/cm/cmmi7.pfb></usr/share/texlive/texmf-dist/fonts/typ 607 e1/public/amsfonts/cm/cmr10.pfb></usr/share/texlive/texmf-dist/fonts/type1/publ 608 ic/amsfonts/cm/cmr12.pfb></usr/share/texlive/texmf-dist/fonts/type1/public/amsf 609 onts/cm/cmr17.pfb></usr/share/texlive/texmf-dist/fonts/type1/public/amsfonts/cm 610 / cmr6.pfb></usr/share/texlive/texmf-dist/fonts/type1/public/amsfonts/cm/cmr7.pf611 b></usr/share/texlive/texmf-dist/fonts/type1/public/amsfonts/cm/cmr8.pfb></usr/ 612 share/texlive/texmf-dist/fonts/type1/public/amsfonts/cm/cmsy10.pfb></usr/share/613 texlive/ texmf-dist/fonts/type1/public/amsfonts/cm/cmti10.pfb></usr/share/texliv614 e /texmf-dist/fonts/type1/public/amsfonts/cm/cmtt10.pfb></usr/share/texlive/texm615 f-dist/fonts/type1/public/amsfonts/cm/cmtt8.pfb>616 Output written on "rapport ESIWACE.pdf" ( 4 pages, 178489bytes).626 1141 hyphenation exceptions out of 8191 627 41i,8n,35p,1270b,264s stack positions out of 5000i,500n,10000p,200000b,80000s 628 </usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx 629 12.pfb></usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi1 630 0.pfb></usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi7. 631 pfb></usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr10.pf 632 b></usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr12.pfb> 633 </usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr17.pfb></ 634 usr/local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr6.pfb></usr 635 /local/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr7.pfb></usr/lo 636 cal/texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmr8.pfb></usr/local 637 /texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmsy10.pfb></usr/local/ 638 texlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmti10.pfb></usr/local/t 639 exlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmtt10.pfb></usr/local/te 640 xlive/2016/texmf-dist/fonts/type1/public/amsfonts/cm/cmtt8.pfb> 641 Output written on "rapport ESIWACE.pdf" (6 pages, 229957 bytes). 617 642 PDF statistics: 618 72PDF objects out of 1000 (max. 8388607)619 49compressed objects within 1 object stream643 90 PDF objects out of 1000 (max. 8388607) 644 62 compressed objects within 1 object stream 620 645 0 named destinations out of 1000 (max. 500000) 621 16words of extra memory for PDF output out of 10000 (max. 10000000)622 646 31 words of extra memory for PDF output out of 10000 (max. 10000000) 647 -
XIOS/dev/branch_openmp/Note/rapport ESIWACE.tex
r1548 r1551 9 9 % Title Page 10 10 11 \title{Develop ping XIOS with multithread : to accelerate the IO of climate models}11 \title{Developing XIOS with multi-thread : to accelerate the I/O of climate models} 12 12 13 13 \author{} … … 20 20 21 21 The simulation models of climate systems, running on a large number of computing resources can produce an important volume of data. At this 22 scale, the I O and the post-treatement of data becomes a bottle-neck for the performance. In order to manage efficiently the data flux23 generated by the simulations, we use XIOS develop ped by the Institut Pierre Simon Laplace and Maison de la simulation.22 scale, the I/O and the post-treatment of data becomes a bottle-neck for the performance. In order to manage efficiently the data flux 23 generated by the simulations, we use XIOS developed by the Institut Pierre Simon Laplace and Maison de la simulation. 24 24 25 XIOS, a lib arary dedicated to intense calculates, allows us to easily and efficiently manage the parallel IO on the storage systems. XIOS25 XIOS, a library dedicated to intense calculates, allows us to easily and efficiently manage the parallel I/O on the storage systems. XIOS 26 26 uses the client/server scheme in which computing resources (server) are reserved exclusively for IO in order to minimize their impact on 27 the performance of the climate models (client). The clients and servers are executed in parallel and communicate asynchron uously. In this28 way, the I O peaks can be smoothed out as data fluxes are send to server constantly throughout the simulation and the time spent on data27 the performance of the climate models (client). The clients and servers are executed in parallel and communicate asynchronously. In this 28 way, the I/O peaks can be smoothed out as data fluxes are send to server constantly throughout the simulation and the time spent on data 29 29 writing on the server side can be overlapped completely by calculates on the client side. 30 30 … … 32 32 \includegraphics[scale=0.4]{Charge1.png} 33 33 \includegraphics[scale=0.4]{Charge2.png} 34 \caption{On the left, each peak of computing power corresponds to the vall ay of memory bandwidth which shows that the computing resources35 are alternating between calculates and I O. ON the right, both curves are smooth which means that the computing resources have a stable36 charge of work, either calculates or I O.}34 \caption{On the left, each peak of computing power corresponds to the valley of memory bandwidth which shows that the computing resources 35 are alternating between calculates and I/O. ON the right, both curves are smooth which means that the computing resources have a stable 36 charge of work, either calculates or I/O.} 37 37 \end{figure} 38 38 39 39 40 40 XIOS works well with many climate simulation codes. For example, LMDZ\footnote{LMDZ is a general circulation model (or global climate model) 41 develop ped since the 70s at the "Laboratoire de Météorologie Dynamique", which includes various variants for the Earth and other planets41 developed since the 70s at the "Laboratoire de Météorologie Dynamique", which includes various variants for the Earth and other planets 42 42 (Mars, Titan, Venus, Exoplanets). The 'Z' in LMDZ stands for "zoom" (and the 'LMD' is for 'Laboratoire de Météorologie Dynamique"). 43 \url{http://lmdz.lmd.jussieu.fr}}, NENO\footnote{Nucleus for European Model ling of the Ocean alias NEMO is a43 \url{http://lmdz.lmd.jussieu.fr}}, NENO\footnote{Nucleus for European Modeling of the Ocean alias NEMO is a 44 44 state-of-the-art modelling framework of ocean related engines. \url{https://www.nemo-ocean.eu}}, ORCHIDEE\footnote{the land surface 45 45 model of the IPSL (Institut Pierre Simon Laplace) Earth System Model. \url{https://orchidee.ipsl.fr}}, and DYNAMICO\footnote{The DYNAMICO 46 46 project develops a new dynamical core for LMD-Z, the atmospheric general circulation model (GCM) part of IPSL-CM Earth System Model. 47 \url{http://www.lmd.polytechnique.fr/~dubos/DYNAMICO/}} all use XIOS as the output back end. M\'et\'eoFrance and MetOffice also choose XIOS48 to manege the I O for their models.47 \url{http://www.lmd.polytechnique.fr/~dubos/DYNAMICO/}} all use XIOS as the output back end. M\'et\'eoFrance and MetOffice also choose XIOS 48 to manege the I/O for their models. 49 49 50 50 51 \section{Developpement of thread-friendly XIOS} 51 \section{Development of thread-friendly XIOS} 52 53 Although XIOS copes well with many models, there is one potential optimization in XIOS which needs to be investigated: making XIOS thread-friendly. 54 55 This topic comes along with the configuration of the climate models. Take LMDZ as example, it is designed with the 2-level parallelization scheme. To be more specific, LMDZ uses the domain decomposition method in which each sub-domain is associated with one MPI process. Inside of the sub-domain, the model also uses OpenMP derivatives to accelerate the computation. We can imagine that the sub-domain be divided into sub-sub-domain and is managed by threads. 56 57 \begin{figure}[h] 58 \centering 59 \includegraphics[scale=0.5]{domain.pdf} 60 \caption{Illustration of the domain decomposition used in LMDZ.} 61 \end{figure} 62 63 As we know, each sub-domain, or in another word, each MPI process is a XIOS client. The data exchange between client and XIOS servers is handled by MPI communications. In order to write an output field, all threads must gather the data to the master thread who acts as MPI process in order to call MPI routines. There are two disadvantages about this method : first, we have to spend time on gathering information to the master thread which not only increases the memory use, but also implies an OpenMP barrier; second, while the master thread calls MPI routine, other threads are in the idle state thus a waster of computing resources. What we want obtain with the thread-friendly XIOS is that all threads can act like MPI processes. They can call directly the MPI routine thus no waste in memory nor in computing resources as shown in Figure \ref{fig:omp}. 64 65 \begin{figure}[h!] 66 \centering 67 \includegraphics[scale=0.6]{omp.pdf} 68 \caption{} 69 \label{fig:omp} 70 \end{figure} 71 72 There are two ways to make XIOS thread-friendly. First of all, change the structure of XIOS which demands a lot of modification is the XIOS library. Knowing that XIOS is about 100 000 lines of code, this method will be very time consuming. What's more, the modification will be local to XIOS. If we want to optimize an other code to be thread-friendly, we have to redo the modifications. The second choice is to add an extra interface to MPI in order to manage the threads. When a thread want to call an MPI routine inside XIOS, it will first pass the interface, in which the communication information will be analyzed before the MPI routine is invoked. With this method, we only need to modify a very small part of XIOS in order to make it work. What is more interesting is that the interface we created can be adjusted to suit other MPI based libraries. 52 73 53 74 54 XIOS is a library dedicated to IO management of climate code. It has a client-server pattern in which clients are in charge of computations 55 and servers manage the reading and writing of files. The communication between clients and servers are handled by MPI. 56 However, some of the climate models (\textit{e.g.} LMDZ) nowadays use an hybrid programming policy. Within a shared memory node, OpenMP 57 directives are used to manage message exchanges. In such configuration, XIOS can not take full advantages of the computing resources to 58 maximize the performance. This is because XIOS can only work with MPI processes. Before each call of XIOS routines, threads of one MPI 59 process must gather their information to the master thread who works as an MPI process. After the call, the master thread distributes the 60 updated information among its slave threads. As result, all slave threads have to wait while the master thread calls the XIOS routines. 61 This introduce extra synchronization into the model and leads to not optimized performance. Aware of this situation, we need to develop a 62 new version of XIOS (EP\_XIOS) which can work with threads, or in other words, can consider threads as they were processes. To do so, we 63 introduce the MPI endpoints. 75 In this project, we choose to implement the interface to handle the threads. To do so, we introduce the MPI\_endpoint which is a concept proposed in the last MPI Forum and several papers has already discussed the importance of such idea and have introduced the framework of the MPI\_endpoint \cite{Dinan:2013}\cite{Sridharan:2014}. The concept of an endpoint is shown by Figure \ref{fig:scheme}. Threads of an MPI process is associated with a unique rank (global endpoint rank) and an endpoint communicator. They also have a local rank (rank inside the MPI process) which is very similar to the \verb|OMP_thread_num| rank. 76 77 \begin{figure}[h!] 78 \begin{center} 79 \includegraphics[scale=0.4]{scheme.png} 80 \end{center} 81 \caption{} 82 \label{fig:scheme} 83 \end{figure} 84 85 %XIOS is a library dedicated to IO management of climate code. It has a client-server pattern in which clients are in charge of computations and servers manage the reading and writing of files. The communication between clients and servers are handled by MPI. However, some of the climate models (\textit{e.g.} LMDZ) nowadays use an hybrid programming policy. Within a shared memory node, OpenMP directives are used to manage message exchanges. In such configuration, XIOS can not take full advantages of the computing resources to maximize the performance. This is because XIOS can only work with MPI processes. Before each call of XIOS routines, threads of one MPI process must gather their information to the master thread who works as an MPI process. After the call, the master thread distributes the updated information among its slave threads. As result, all slave threads have to wait while the master thread calls the XIOS routines. This introduce extra synchronization into the model and leads to not optimized performance. Aware of this situation, we need to develop a new version of XIOS (EP\_XIOS) which can work with threads, or in other words, can consider threads as they were processes. To do so, we introduce the MPI endpoints. 64 86 65 87 66 The MPI endpoints (EP) is a layer on top of an existing MPI Implementation. All MPI function, or in our work the functions used in XIOS, 67 will be reimplemented in order to cope with OpenMP threads. The idea is that, in the MPI endpoints environment, each OpenMP thread will be 88 The MPI\_endpoints interface we implemented lies on top of an existing MPI Implementation. It consists of wrappers to all MPI functions used in XIOS. 89 90 will be re-implemented in order to cope with OpenMP threads. The idea is that, in the MPI endpoints environment, each OpenMP thread will be 68 91 associated with a unique rank and with an endpoint communicator. This rank (EP rank) will replace the role of the classic MPI rank and will 69 92 be used in MPI communications. In order to successfully execute an MPI communication, for example \verb|MPI_Send|, we know already which … … 73 96 74 97 In XIOS, we used the ``probe'' technique to search for arrived messages and then performing the receive action. The principle is 75 that sender processes execute the send operations as usual. However, to minimi se the time spent on waiting incoming messages, the receiver98 that sender processes execute the send operations as usual. However, to minimize the time spent on waiting incoming messages, the receiver 76 99 processe performs in the first place the \verb|MPI_Probe| function to check if a message destinated to it has been published. If yes, the 77 100 process execute in the second place the \verb|MPI_Recv| to receive the message. In this situation, if we introduce the threads, problems … … 135 158 decrease in time of 25\%. Even the 25\% may seems to be small, it is still a gain in performance with existing computing resources. 136 159 160 \section{Performance of EP\_XIOS} 161 162 workfloz\_cmip6 163 light output 164 24*8+2 165 30s - 52s 166 32 days 167 histmth with daily output 168 137 169 \section{Perspectives of EP\_XIOS} 138 170 171 172 \bibliographystyle{plain} 173 \bibliography{reference} 174 139 175 \end{document}
Note: See TracChangeset
for help on using the changeset viewer.