Changes between Version 11 and Version 12 of Doc/Tools/cpu_Monitoring_and_DMT


Ignore:
Timestamp:
09/29/21 12:01:25 (3 years ago)
Author:
edupont
Comment:

Basic updates to take into account progresses in visualisation tool of the DATA / INODE diagnostic tool

Legend:

Unmodified
Added
Removed
Modified
  • Doc/Tools/cpu_Monitoring_and_DMT

    v11 v12  
    8484Documentation is [https://forge.ipsl.jussieu.fr/igcmg_doc/wiki/Doc/Tools/cpu_Monitoring_and_DMT here] 
    8585 
    86 '''Monitoring :''' 
     86## Monitoring ## 
    8787 
    8888So far, the STORE/WORK/SCRATCH per-project usage monitoring is available on demand. 
     
    101101[[Image(quotas_monitoring_gencmip6.png, 600px)]] 
    102102 
    103 '''Cleaning :''' 
     103## Inodes / Data Diagnostic ## 
    104104 
    105 The cleaning tool consists in a diagnostic application to help the user assess which of their directories have the most data or takes the most inodes. 
     105The Inodes / Data Diagnostic tool consists in a application to help the user assess which of their directories have the most data or takes the most inodes. 
    106106Thanks to the tool, the user can more easily select what experiments they want to delete and download a path list to delete manually on the computing center. 
    107 The tool is still under development. A beta version is available on demand. Ask edupont at ipsl.fr for it. 
     107There are different step at using this tool :  
     108* Data Acquisition from IRENE 
     109* Parsing the raw data logs 
     110* Visualising the parsed log on https://outils.ipsl.fr/conso-calcul/app 
    108111 
    109112 
    110113 
    111 > Step 1 : Data Acquisition from IRENE 
     114### Step 1 : Data Acquisition from IRENE ### 
    112115 
    113116The first step for using the app is to log the output from the ccc_tree command at TGCC. Use the appropriate script to have the log with the proper options.  
     
    118121 
    119122 
    120 > Step 2 : Parse the raw log to get yaml file. 
     123### Step 2 : Parse the raw log to get yaml file. ### 
    121124 
    122125To parse the raw log file, you must use the parser locate on the following path :  
     
    147150 
    148151If everything went correctly, the output file will be written in $PARSER_DIR/../parsed_logs 
    149 It must be moved to the appropriate folder to be accessible to the Visualisation App. 
    150152 
    151 If any error were met, first, check you imput file. If the error continues you can send an email get some help / report a bug. 
     153 
     154The output parsed log must be moved to {{{/projsu/igcmg/DMP_TOOLS/parsed_logs}}}. Keep its name written elsewhere. It will be usefull for visualisation. 
     155 
     156If any error were met, first, check you input file. If the error continues you can send an email get some help / report a bug. 
     157 
     158### Step 3 : Visualising the parsed logs ### 
     159Go to https://outils.ipsl.fr/conso-calcul/app 
     160 
     161Note the name of the parsed log you obtained and copied to {{{/projsu/igcmg/DMP_TOOLS/parsed_logs}}} 
     162 
     163Write that name in the text field : 'Input File Name' on the app page. 
     164 
     165Click on the 'Change Input File' button. 
     166If the file is different, the new data should be loading. 
    152167 
    153168----