Changes between Version 17 and Version 18 of Doc/Tools/cpu_Monitoring_and_DMT

Timestamp:

10/14/21 16:20:02 (3 years ago)

Author:

edupont

Comment:

Updated the Inode v Data parsing (step 2) documentation

Doc/Tools/cpu_Monitoring_and_DMT

@@ -131 +131 @@
 ### Step 2 : Parse the raw log to get yaml file. ###
 
-Once it works, the script to parse the raw logs will be : 
-/projsu/igcmg/DMP_TOOLS/run_parser.sh
+#### Install the conda environment ####
+To parse the raw logs, you first need to install the appropriate conda environment : PARSER_env.
 
+So far you will have to install it locally on your ciclad account. Later, we plan on having on shared conda env that any user will be able to load.
 
-
-To parse the raw log file, you must use the parser locate on the following path : 
-/home/igcmg/Chantier_DMP_Eliott/PARSER/dmp_tools
+To install the conda environment, run the following commands :
 {{{
-PARSER_DIR=/home/igcmg/Chantier_DMP_Eliott/PARSER/dmp_tools
-cd $PARSER_DIR
-}}}
-
-
-
-
-You must have the appropriate conda environment set up. 
-To create it run the following commands : 
-{{{
+PARSER_DIR="/projsu/igcmg/DMP_TOOLS/dmp_tools"
 module load python/3.6-anaconda50
 conda env create -f $PARSER_DIR/environment.yml --name PARSER_env
@@ -155 +145 @@
 }}}
 
+#### Running the parser ####
 
-Once this is done or if you already created the appropriate environment, run :
+First get the name of the file you want to parse. You can refer to the Step 1 to get get the raw_log filename.
 
-{{{
-python $PARSER_env/parser/parser_tgcc/src/run_parser.py -i <name_of_the_input_file.txt>
-}}}
+Then you must run : 
 
-If everything went correctly, the output file will be written in $PARSER_DIR/../parsed_logs
+{{{/projsu/igcmg/DMP_TOOLS/run_parser.sh <input_filename.txt>}}}
+
+With 
+{{{<input_filename.txt>}}}
+the name of the file produced in Step 1.
+
+
+If everything went correctly, the output file will be written in 
+{{{$PARSER_DIR/../parsed_logs}}}