New URL for NEMO forge!   http://forge.nemo-ocean.eu

Since March 2022 along with NEMO 4.2 release, the code development moved to a self-hosted GitLab.
This present forge is now archived and remained online for history.
2020WP/HPC-10_mcastril_HPDAonlineDiagGPU (diff) – NEMO

Changes between Version 1 and Version 2 of 2020WP/HPC-10_mcastril_HPDAonlineDiagGPU


Ignore:
Timestamp:
2020-01-08T10:13:05+01:00 (4 years ago)
Author:
mcastril
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • 2020WP/HPC-10_mcastril_HPDAonlineDiagGPU

    v1 v2  
    1111== Summary 
    1212 
    13 ||=Action       || Name and subject of the action                        || 
    14 ||=PI(S)        || Names                                                 || 
    15 ||=Digest       || Brief description with motivations and main tasks     || 
    16 ||=Dependencies || If any                                                || 
     13||=Action       || HPC-10_mcastril_HPDAonline DiagGPU                    || 
     14||=PI(S)        || Miguel Castrillo                                      || 
     15||=Digest       || High Performance GPU Diagnostics Online - 2nd Phase. After having successfully ported the dia_hsb diagnostic into a toy model, achieving 50x speedup, this task will focus on implementing the rest of the diagnostics and improving the data transfer between CPU and GPU.    || 
     16||=Dependencies || HPC-04_MCastrillo_HPDAonlineDiagGPU (completed)       || 
    1717||=Branch       || source:/NEMO/branches/{YEAR}/dev_r{REV}_{ACTION_NAME} || 
    18 ||=Previewer(s) || Names                                                 || 
    19 ||=Reviewer(s)  || Names                                                 || 
     18||=Previewer(s) || Italo Epicoco                                         || 
     19||=Reviewer(s)  || Italo Epicoco                                         || 
    2020||=Ticket       || #XXXX                                                 || 
    2121 
    2222=== Description 
    2323 
    24 {{{#!box width=25em help 
    25 Describe the goal of development and the methodology, \\ 
    26 add reference documents or publications if relevant. 
    27 }}} 
     24High performance data analytics solutions aiming at tackling the online diagnostics of the NEMO model will be explored as complementary components in the model diagnostics software eco-system. Online techniques leveraging fast (low latency and real-time) data analytics approaches (e.g. on fat nodes) will be evaluated in real cluster environments. In particular, an interface of NEMO to the High Performance Data Analitics (HPDA) framework will be designed and implemented for online diagnostics.  
    2825 
    29 ''...'' 
     26The rationale of this activity is to improve the NEMO computational performance by executing the computations for diagnostics on GPU.  
    3027 
    3128=== Implementation 
    3229 
    33 {{{#!box width=35em help 
    34 Describe flow chart of the changes in the code. \\ 
    35 List the Fortran modules and subroutines to be created/edited/deleted. \\ 
    36 Detailed list of new variables to be defined (including namelists), \\ 
    37 give for each the chosen name and description wrt coding rules. 
    38 }}} 
     30As first step, the portability of NEMO diagnostic calculations to GPUs has been analyzed, exploring how to adapt these regions from the current MPI implementation to the CUDA paradigm. A toy model has been created to perform preliminary tests, that were done using the dia_hsb diagnostic. The code itself is executed 50x faster than in a single CPU but the data transfer to and from GPU is the main bottleneck.  
    3931 
    40 ''...'' 
     32We are working on the asynchronous strategy in order to hide all communications among GPU/CPU. We also plan to increase the efficiency of the overall solution, by mitigating the impact of the offloaded data and extending our approach to the rest of the diagnostics.  
    4133 
    4234=== Documentation updates 
    4335 
    44 {{{#!box width=55em help 
    45 Using previous parts, define the main changes to be done in the NEMO literature  
    46 (manuals, guide, web pages, …). 
    47 }}} 
    48  
    49 ''...'' 
    5036 
    5137== Preview