kvalobs:kvoss:system:qc2:flag:regression

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision 		Previous revision
kvalobs:kvoss:system:qc2:flag:regression [2010-01-31 21:49:54]
paule created 		kvalobs:kvoss:system:qc2:flag:regression [2022-05-31 09:29:32] (current)
Line 1: Line 1:
-====== Qc1 regression tests (arising from the introduction of Qc2 flagging) ======+====== Qc1 regression tests ====== 
 + 
 +Qc1 regression tests arising from the introduction of [[https://kvalobs.wiki.met.no/doku.php?id=kvoss:system:qc2:flag:analysis#turn_on_qc2_in_useinfo|Qc2 flagging]] for useinfo. 
 + 
 +===== Strategy ===== 
 + 
 +The kvalobs database data from 200908 (taken from the backups of histkvalobs) was analysed and all the combinations of controlinfo and useinfo were extracted (approximately **2275** in total). The controlinfo values were processed by setUseFlags(const kvControlInfo& cinfo) with the existing Qc2 logic turned on. The following table displays the original controlinfo and useinfo as well as the new useinfo generated by the Qc2 aware setUseFlags. The fourth column indicates if there is a change to the useinfo or not. In approximately 37% of cases the useinfo generated was the same. useinfo(13) and useinfo(14) were overwritten by **XX** in the table since this is the userid set by HQC. AFter substituting XX it was found that the actual number of unique combination is **1076**. 
 + 
 +Questions: 
 +  * Is th a valid regression test? 
 +  * Are the differences a problem or not? 
 +  * i.e. are some differences only due to HQC activity and the Qc2 settings so far are ok? 
 +  * can we commit the updated setUseFlags back into [[https://svn.met.no/viewvc/kvoss/kvalobs/trunk/src/lib/kvalobs/kvDataFlag.cc|kvDataFlag.cc]]? 
 + 
 +The results of the regression test:{{kvalobs:kvoss:system:qc2:flag:useinfo-flag-test-200908.csv.gz|useinfo-flag-test-200908.csv.gz}} 
 + 
 +And here is an extract comprising 100 results picked at **random** from the total set of results (note the table is too big to load as one into the Wiki): 
 + 
 +^Oiginal Controlinfo  ^Original Useinfo  ^Useinfo with Qc2 On  ^Is there a change?^ 
 +|1110100000300011 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1000002000000600 |7138900400000XX1 |7038900000000XX1 |CHANGE |  
 +|1100000000000007 |3031900000000XX0 |3031900000000XX0 |NO-CHANGE |  
 +|1131000000000001 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1030002000000000 |7020200000000XX1 |7020200000000XX1 |NO-CHANGE |  
 +|1500500000000007 |3131900400000XX2 |3031900000000XX2 |CHANGE |  
 +|1111100000000010 |7100000300000XX0 |5000000000000XX0 |CHANGE |  
 +|1211200000100000 |7010700000000XX2 |5010700000000XX2 |CHANGE |  
 +|1113000000000011 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1102400000000007 |3131900400000XX2 |1031900000000XX2 |CHANGE |  
 +|1113100000000000 |7120300400000XX1 |5020300000000XX1 |CHANGE |  
 +|1301100000000000 |7010100000000XX1 |5010100000000XX1 |CHANGE |  
 +|1030001000100007 |3891900000000XX1 |3891900000000XX1 |NO-CHANGE |  
 +|1111200000000002 |3100000300000XX1 |1000000000000XX1 |CHANGE |  
 +|1110000000300001 |3100000300000XX1 |3000000000000XX1 |CHANGE |  
 +|1600600000100000 |7033700000000XX2 |7033700000000XX2 |NO-CHANGE |  
 +|1210100000100011 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1210000000000002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1111300000000002 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1111200000100000 |7110700400000XX1 |5010700000000XX1 |CHANGE |  
 +|1510100000100022 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1000001000006006 |3895900000000XX0 |1895900000000XX0 |CHANGE |  
 +|1410100000100091 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1311000000000012 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1511000000100002 |3100000400000XX1 |1000000000000XX1 |CHANGE |  
 +|1200100000000001 |3100000300000XX1 |3000000000000XX1 |CHANGE |  
 +|1030003000000000 |7899200000000XX1 |7899200000000XX1 |NO-CHANGE |  
 +|1211000000100000 |7010100000000XX1 |5010100000000XX1 |CHANGE |  
 +|1111100000100011 |3100000300000XX0 |1000000000000XX0 |CHANGE |  
 +|1511000000000012 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1211000000000012 |3100000400000XX1 |1000000000000XX1 |CHANGE |  
 +|1010001000000000 |7890900000000XX0 |7894900000000XX0 |-4000000000 |  
 +|1030001000000005 |3892900000000XX1 |3892900000000XX1 |NO-CHANGE |  
 +|1130000000300001 |3000000000000XX2 |3000000000000XX2 |NO-CHANGE |  
 +|1311100000000012 |3100000300000XX1 |1000000000000XX1 |CHANGE |  
 +|1110200000100012 |3100000300000XX1 |3000000000000XX1 |CHANGE |  
 +|1110100000000001 |3000000000000XX0 |3000000000000XX0 |NO-CHANGE |  
 +|1110000000100000 |7100000400000XX0 |7000000000000XX0 |CHANGE |  
 +|1200000000000002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1201100000000000 |7010100000000XX1 |5010100000000XX1 |CHANGE |  
 +|1111000000100000 |7100000400000XX0 |5000000000000XX0 |CHANGE |  
 +|1010601000000007 |3891900000000XX1 |3891900000000XX1 |NO-CHANGE |  
 +|1111200000100012 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1310100000100012 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1111001000000015 |3892900000000XX0 |1892900000000XX0 |CHANGE |  
 +|1111200000100002 |3100000300000XX1 |1000000000000XX1 |CHANGE |  
 +|1102400000000000 |7020700000000XX2 |5020700000000XX2 |CHANGE |  
 +|1113000000000001 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1300100000000002 |3100000400000XX1 |3000000000000XX1 |CHANGE |  
 +|1110300000100002 |3100000400000XX1 |3000000000000XX1 |CHANGE |  
 +|1101000000000000 |7100000300000XX0 |5000000000000XX0 |CHANGE |  
 +|1100300000000001 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|110000200000000A |3138900400000XX0 |3038900000000XX0 |CHANGE |  
 +|1111100000000011 |3100000300000XX0 |1000000000000XX0 |CHANGE |  
 +|1131100000300011 |3000000000000XX2 |1000000000000XX2 |CHANGE |  
 +|1230000000000010 |7020200000000XX2 |7020200000000XX2 |NO-CHANGE |  
 +|1411100000000001 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1010100000000000 |7000000000000XX0 |7000000000000XX0 |NO-CHANGE |  
 +|1210000000100002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|11110000000000B1 |3000000000000XX0 |1000000000000XX0 |CHANGE |  
 +|1200100000000002 |3100000400000XX1 |3000000000000XX1 |CHANGE |  
 +|1300100000000000 |7010100000000XX1 |7010100000000XX1 |NO-CHANGE |  
 +|1100100000000001 |3100000300000XX0 |3000000000000XX0 |CHANGE |  
 +|1103100000000001 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1102000000000100 |7010300000000XX1 |5010300000000XX1 |CHANGE |  
 +|1130000000000007 |3131900400000XX1 |3031900000000XX1 |CHANGE |  
 +|1210000000000012 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1310000000100002 |3100000400000XX1 |3000000000000XX1 |CHANGE |  
 +|1130000000100007 |3131900300000XX1 |3031900000000XX1 |CHANGE |  
 +|1100000000001001 |3000000000000XX0 |1000000000000XX0 |CHANGE |  
 +|1411100000000021 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1210000000300001 |3000000000000XX2 |3000000000000XX2 |NO-CHANGE |  
 +|1110300000000002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1600002000000000 |7138100400000XX1 |7038100000000XX1 |CHANGE |  
 +|1510000000000002 |3100000400000XX1 |3000000000000XX1 |CHANGE |  
 +|1110000000300001 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1410100000000091 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1311000000100001 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1000600000000600 |7133700400000XX2 |7033700000000XX2 |CHANGE |  
 +|1210000000300001 |3000000000000XX2 |3000000000000XX2 |NO-CHANGE |  
 +|1112100000000011 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1311000000000012 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1113100000100000 |7020300000000XX1 |5020300000000XX1 |CHANGE |  
 +|1211000000000021 |3100000400000XX1 |1000000000000XX1 |CHANGE |  
 +|1410000000000012 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1200101000000005 |3892900000000XX1 |3892900000000XX1 |NO-CHANGE |  
 +|1100100000000001 |3000000000000XX0 |3000000000000XX0 |NO-CHANGE |  
 +|1311100000000012 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1600002000000007 |3131900400000XX1 |3031900000000XX1 |CHANGE |  
 +|1000601000000007 |3891900000000XX1 |3891900000000XX1 |NO-CHANGE |  
 +|1111200000100002 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1311100000000012 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 +|1210100000100002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|1600002000000007 |3031900000000XX1 |3031900000000XX1 |NO-CHANGE |  
 +|1100000000002006 |3335900000000XX0 |1335900000000XX0 |CHANGE |  
 +|1001000000000000 |7100000400000XX0 |5000000000000XX0 |CHANGE |  
 +|1110200000100002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE |  
 +|0000002000000000 |9999900000000XX0 |9099900000000XX0 |CHANGE |  
 +|1110300000000000 |7010700000000XX1 |7010700000000XX1 |NO-CHANGE |  
 +|1411100000100022 |3000000000000XX1 |1000000000000XX1 |CHANGE |  
 + 
 +<code>$ ~/DATA/FlagRegression$ awk 'BEGIN {srand()} {printf "%05.0f %s \n",rand()*99999, $0; }' wikitable.txt | sort -n | head -100 | sed 's/^[0-9]*//'</code> 
 + 
 +===== Initialise Useinfo ===== 
 + 
 +This is the same as above except the useinfo is initialised with the original value (before it was not set), still see the problem with useinfo(7)!!!! 
 + 
 +^Oiginal Controlinfo^Original Useinfo^Useinfor with Qc2 On^Useinfo with Qc2 On and Useinfo no reset^Change?^ 
 +|1211100000100002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1101200000000002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1231100000100000|7120200400000XX2|5020200000000XX2|7020200000000XX2|CHANGE|  
 +|1111100000000000|7000000000000XX0|5000000000000XX0|7000000000000XX0|NO-CHANGE|  
 +|1100200000000012|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1113100000100001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1111200000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1101100000000007|3031900000000XX0|1031900000000XX0|3031900000000XX0|NO-CHANGE|  
 +|1101200000000002|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1140000000003000|7220400000000XX1|5220400000000XX1|7220400000000XX1|NO-CHANGE|  
 +|1130000000300000|7120200400000XX2|7020200000000XX2|7020200000000XX2|CHANGE|  
 +|1100100000000001|3100000400000XX0|3000000000000XX0|3000000000000XX0|CHANGE|  
 +|1110300000100002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1201000000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1111000000300001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1130100000100011|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|143000200010000A|3038900000000XX2|3038900000000XX2|3038900000000XX2|NO-CHANGE|  
 +|1130000000000007|3131900300000XX1|3031900000000XX1|3031900000000XX1|CHANGE|  
 +|1110100000100011|3000000000000XX0|3000000000000XX0|3000000000000XX0|NO-CHANGE|  
 +|1500000000100002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1010601000000005|3892900000000XX1|3892900000000XX1|3892900000000XX1|NO-CHANGE|  
 +|1311100000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1211000000100001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1111200000100012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1113000000000001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1140000000006006|3335900000000XX1|1335900000000XX1|3335900000000XX1|NO-CHANGE|  
 +|1010000000001000|7000000000000XX0|5000000000000XX0|7000000000000XX0|NO-CHANGE|  
 +|1110200000100000|7010700000000XX1|7010700000000XX1|7010700000000XX1|NO-CHANGE|  
 +|1111400000000010|7020700000000XX1|5020700000000XX1|7020700000000XX1|NO-CHANGE|  
 +|1111300000000002|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|113030200000000A|3038900000000XX2|3038900000000XX2|3038900000000XX2|NO-CHANGE|  
 +|1100000000000400|7000000000000XX1|7033900000000XX1|7033900000000XX1|CHANGE|  
 +|1202000000000001|3000000000000XX2|1000000000000XX2|3000000000000XX2|NO-CHANGE|  
 +|1300100000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1113300000100000|7020700000000XX2|5020700000000XX2|7020700000000XX2|NO-CHANGE|  
 +|1110100000000001|3100000400000XX0|3000000000000XX0|3000000000000XX0|CHANGE|  
 +|1211100000000012|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1511000000000027|3031900000000XX1|1031900000000XX1|3031900000000XX1|NO-CHANGE|  
 +|1130000000100007|3131900300000XX1|3031900000000XX1|3031900000000XX1|CHANGE|  
 +|0000003000000007|4899900000000XX0|4899900000000XX0|4899900000000XX0|NO-CHANGE|  
 +|1011100000000000|7100000400000XX0|5000000000000XX0|7000000000000XX0|CHANGE|  
 +|1200100000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1010001000000005|3892900000000XX0|3892900000000XX0|3892900000000XX0|NO-CHANGE|  
 +|1600600000000017|3031900000000XX2|3031900000000XX2|3031900000000XX2|NO-CHANGE|  
 +|1600002000000007|3031900000000XX1|3031900000000XX1|3031900000000XX1|NO-CHANGE|  
 +|1101100000000001|3100000400000XX0|1000000000000XX0|3000000000000XX0|CHANGE|  
 +|0000002000000000|9999900000000XX0|9099900000000XX0|9099900000000XX0|CHANGE|  
 +|1111500000100000|7020700000000XX1|5020700000000XX1|7020700000000XX1|NO-CHANGE|  
 +|1300000000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1330100000100012|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE|  
 +|1211100000000011|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1501000000000000|7020100000000XX1|5020100000000XX1|7020100000000XX1|NO-CHANGE|  
 +|1130100000300011|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE|  
 +|1131000000000007|3031900000000XX1|1031900000000XX1|3031900000000XX1|NO-CHANGE|  
 +|1000002000000600|7138900400000XX1|7038900000000XX1|7038900000000XX1|CHANGE|  
 +|160000200000000A|3038900000000XX1|3038900000000XX1|3038900000000XX1|NO-CHANGE|  
 +|1511000000300001|3000000000000XX2|1000000000000XX2|3000000000000XX2|NO-CHANGE|  
 +|1211100000000012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1102100000000001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1130000000300001|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE|  
 +|1101000000000007|3031900000000XX0|1031900000000XX0|3031900000000XX0|NO-CHANGE|  
 +|1411100000000022|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1101100000000001|3100000400000XX0|1000000000000XX0|3000000000000XX0|CHANGE|  
 +|1111300000000012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1111300000100002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1211100000000011|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1510000000000002|3100000400000XX1|3000000000000XX1|3000000000000XX1|CHANGE|  
 +|1400000000000000|7120100300000XX1|7020100000000XX1|7020100000000XX1|CHANGE|  
 +|1210100000100012|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1311100000000012|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1600100000000011|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1200000000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1101200000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1110100000000001|3000000000000XX0|3000000000000XX0|3000000000000XX0|NO-CHANGE|  
 +|1401100000000002|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1130000000000017|3031900000000XX1|3031900000000XX1|3031900000000XX1|NO-CHANGE|  
 +|1130000000300001|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE|  
 +|1111100000100011|3000000000000XX0|1000000000000XX0|3000000000000XX0|NO-CHANGE|  
 +|1111200000100000|7110700400000XX1|5010700000000XX1|7010700000000XX1|CHANGE|  
 +|1500000000000001|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1113100000000000|7120300400000XX1|5020300000000XX1|7020300000000XX1|CHANGE|  
 +|1110100000100000|7000000000000XX0|7000000000000XX0|7000000000000XX0|NO-CHANGE|  
 +|1130000000100000|7020200000000XX1|7020200000000XX1|7020200000000XX1|NO-CHANGE|  
 +|1402000000000000|7020300000000XX2|5020300000000XX2|7020300000000XX2|NO-CHANGE|  
 +|1102100000000007|3031900000000XX1|1031900000000XX1|3031900000000XX1|NO-CHANGE|  
 +|1500500000000007|3031900000000XX2|3031900000000XX2|3031900000000XX2|NO-CHANGE|  
 +|1211100000100002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1110200000100012|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1211000000000012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1100000000000100|7100000400000XX0|7000000000000XX0|7000000000000XX0|CHANGE|  
 +|1510000000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1113000000100000|7020300000000XX1|5020300000000XX1|7020300000000XX1|NO-CHANGE|  
 +|1200100000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1111000000000017|3031900000000XX0|1031900000000XX0|3031900000000XX0|NO-CHANGE|  
 +|1130100000000001|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1110000000300001|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1002000000000001|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE|  
 +|1300100000000000|7010100000000XX1|7010100000000XX1|7010100000000XX1|NO-CHANGE|  
 +|1113100000100001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|  
 +|1001200000000002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| 
  
  • kvalobs/kvoss/system/qc2/flag/regression.1264974594.txt.gz
  • Last modified: 2022-05-31 09:23:18
  • (external edit)