41 | | {{{#!box help |
42 | | [[Include(wiki:Developers/DevProcess#review)]] |
| 60 | |
| 61 | {{{#!Fold title=Preview tag=h2 |
| 62 | Since the preview step must be completed before the PI starts the coding, the previewer(s) answers are expected to be completed within the two weeks after the PI has sent his request. \\ |
| 63 | For each question, an iterative process should take place between PI and previewer(s) in order to reach a "YES" answer for each of the following questions. |
| 64 | |
| 65 | {{{#!TracForm |
| 66 | #!subcontext preview_ |
| 67 | #!submit_label 'Save Preview' |
| 68 | |
| 69 | ||= Questions =||= Answer =||= Comment =|| |
| 70 | || Does the previewer agree with the proposed methodology? || [tf.select:2.1 -id=preform '' Yes No NR] || [tf.textarea:2.1c -id=preform 'Add a comment?' 50 10] || |
| 71 | || Does the previewer agree with the proposed flowchart and list of routines to be changed? || [tf.select:2.2 -id=preform '' Yes No NR] || [tf.textarea:2.2c -id=preform 'Add a comment?' 50 10] || |
| 72 | || Does the previewer agree with the proposed new list of variables, including agreement with coding rules? || [tf.select:2.3 -id=preform '' Yes No NR] || [tf.textarea:2.3c -id=preform 'Add a comment?' 50 10] || |
| 73 | || Does the previewer agree with the proposed summary of updates in reference manual? || [tf.select:2.4 -id=preform '' Yes No NR] || [tf.textarea:2.4c -id=preform 'Add a comment?' 50 10] || |
| 74 | || ... ... ... || [tf.select:2.X -id=preform '' Yes No NR] || [tf.textarea:2.Xc -id=preform 'Add a comment?' 50 10] || |
| 75 | |
| 76 | '''''Updated on [tf.form_updated_on:] by [tf.form_updater:]''''' |
| 77 | |
| 79 | |
| 80 | Once all "YES" have been reached, the PI can start the development into his development branch. |
| 81 | |
| 82 | }}} |
| 83 | |
| 84 | |
| 85 | {{{#!Fold title=Tests tag=h2 |
| 86 | |
| 87 | Once the development is done, the PI should complete this section below and ask the reviewers to start their review in the lower section. |
| 88 | |
| 89 | {{{#!TracForm |
| 90 | #!subcontext tests |
| 91 | #!submit_label 'Save Tests' |
| 92 | |
| 93 | ||= Questions =||= Answer =||= Comment =|| |
| 94 | || Can this change be shown to produce expected impact? (if option activated)? || [tf.select:3.1 -id=piform '' Yes No NR] || [tf.textarea:3.1c -id=piform 'Add a comment?' 50 10] || |
| 95 | || Can this change be shown to have a null impact? (if option not activated) || [tf.select:3.2 -id=piform '' Yes No NR] || [tf.textarea:3.2c -id=piform 'Add a comment?' 50 10] || |
| 96 | || Detailed results of restartability and reproducibility when the option is activated. Please indicate the configuration used for this test || [tf.select:3.3 -id=piform '' Yes No NR] || [tf.textarea:3.3c -id=piform 'Add a comment?' 50 10] || |
| 97 | || Detailed results of SETTE tests (restartability and reproducibility for each of the reference configuration) || [tf.select:3.4 -id=piform '' Yes No NR] || [tf.textarea:3.4c -id=piform 'Add a comment?' 50 10] || |
| 98 | || Results of the required bit comparability tests been run: Are there no differences when activating the development? || [tf.select:3.5 -id=piform '' Yes No NR] || [tf.textarea:3.5c -id=piform 'Add a comment?' 50 10] || |
| 99 | || If some differences appear, is reason for the change valid/understood? || [tf.select:3.6 -id=piform '' Yes No NR] || [tf.textarea:3.6c -id=piform 'Add a comment?' 50 10] || |
| 100 | || If some differences appear, is the !ticket describing in detail the impact this change will have on model configurations? || [tf.select:3.7 -id=piform '' Yes No NR] || [tf.textarea:3.7c -id=piform 'Add a comment?' 50 10] || |
| 101 | || Is this change expected to preserve all diagnostics? || [tf.select:3.8 -id=piform '' Yes No NR] || [tf.textarea:3.8c -id=piform 'Add a comment?' 50 10] || |
| 102 | || If no, is reason for the change valid/understood? || [tf.select:3.9 -id=piform '' Yes No NR] || [tf.textarea:3.9c -id=piform 'Add a comment?' 50 10] || |
| 103 | || Are there significant changes in run time/memory? || [tf.select:3.10 -id=piform '' Yes No NR] || [tf.textarea:3.10c -id=piform 'Add a comment?' 50 10] || |
| 104 | || ... ... ... || [tf.select:3.XX -id=piform '' Yes No NR] || [tf.textarea:3.XXc -id=piform 'Add a comment?' 50 10] || |
| 105 | |
| 106 | '''''Updated on [tf.form_updated_on:] by [tf.form_updater:]''''' |
| 107 | |
| 108 | }}} |
| 109 | |
| 110 | }}} |
| 111 | |
| 112 | |
| 113 | {{{#!Fold title=Review tag=h2 |
| 114 | |
| 115 | {{{#!box critical |
| 116 | A successful review is needed to schedule the merge of this development into the future NEMO release during next Merge Party (usually in November~December). |
| 117 | }}} |
| 118 | |
| 119 | {{{#!TracForm |
| 120 | #!subcontext review |
| 121 | #!submit_label 'Save Review' |
| 122 | |
| 123 | |
| 124 | === Code changes and documentation |
| 125 | |
| 126 | ||= Question =||= Answer =||= Comment =|| |
| 127 | || Is the proposed methodology now implemented? || [tf.select:3.11 -id=revform '' Yes No NR] || [tf.textarea:3.11c -id=revform 'Add a comment?' 50 10] || |
| 128 | || Are the code changes in agreement with the flowchart defined at Preview step? || [tf.select:3.12 -id=revform '' Yes No NR] || [tf.textarea:3.12c -id=revform 'Add a comment?' 50 10] || |
| 129 | || Are the code changes in agreement with list of routines and variables as proposed at Preview step? \\If not, are the discrepancies acceptable? || [tf.select:3.13 -id=revform '' Yes No NR] || [tf.textarea:3.13c -id=revform 'Add a comment?' 50 10] || |
| 130 | || Is the in-line documentation accurate and sufficient? || [tf.select:3.14 -id=revform '' Yes No NR] || [tf.textarea:3.14c -id=revform 'Add a comment?' 50 10] || |
| 131 | || Do the code changes comply with NEMO coding standards? || [tf.select:3.15 -id=revform '' Yes No NR] || [tf.textarea:3.15c -id=revform 'Add a comment?' 50 10] || |
| 132 | || Is the !ticket of development documented with sufficient details for others to understand the impact of the change? || [tf.select:3.16 -id=revform '' Yes No NR] || [tf.textarea:3.16c -id=revform 'Add a comment?' 50 10] || |
| 133 | || Are the reference manual tex files now updated following the proposed summary in preview section? || [tf.select:3.17 -id=revform '' Yes No NR] || [tf.textarea:3.17c -id=revform 'Add a comment?' 50 10] || |
| 134 | || Is there a need for some documentation on the web pages (in addition to in-line and reference manual)? \\If yes, please describe and ask PI. A yes answer must include all documentation available. || [tf.select:3.18 -id=revform '' Yes No NR] || [tf.textarea:3.18c -id=revform 'Add a comment?' 50 10] || |
| 135 | || ... ... ... || [tf.select:3.XX -id=revform '' Yes No NR] || [tf.textarea:3.XXc -id=revform 'Add a comment?' 50 10] || |
| 136 | |
| 137 | |
| 138 | ==== Review Summary |
| 139 | |
| 140 | Is the review fully successful? [tf.select:status -id=revform '' Yes No] |
| 141 | |
| 142 | [tf.textarea:comment -id=revform 'If not, please indicate what is still missing.' 50 10] |
| 143 | |
| 144 | '''''Updated on [tf.form_updated_on:] by [tf.form_updater:]''''' |
| 145 | |
| 146 | |
| 147 | }}} |
| 148 | |
| 149 | Once review is successful, the development must be scheduled for merge during next Merge Party Meeting. |
| 150 | |
| 151 | }}} |