====== Qc1 regression tests ====== Qc1 regression tests arising from the introduction of [[https://kvalobs.wiki.met.no/doku.php?id=kvoss:system:qc2:flag:analysis#turn_on_qc2_in_useinfo|Qc2 flagging]] for useinfo. ===== Strategy ===== The kvalobs database data from 200908 (taken from the backups of histkvalobs) was analysed and all the combinations of controlinfo and useinfo were extracted (approximately **2275** in total). The controlinfo values were processed by setUseFlags(const kvControlInfo& cinfo) with the existing Qc2 logic turned on. The following table displays the original controlinfo and useinfo as well as the new useinfo generated by the Qc2 aware setUseFlags. The fourth column indicates if there is a change to the useinfo or not. In approximately 37% of cases the useinfo generated was the same. useinfo(13) and useinfo(14) were overwritten by **XX** in the table since this is the userid set by HQC. AFter substituting XX it was found that the actual number of unique combination is **1076**. Questions: * Is th a valid regression test? * Are the differences a problem or not? * i.e. are some differences only due to HQC activity and the Qc2 settings so far are ok? * can we commit the updated setUseFlags back into [[https://svn.met.no/viewvc/kvoss/kvalobs/trunk/src/lib/kvalobs/kvDataFlag.cc|kvDataFlag.cc]]? The results of the regression test:{{kvalobs:kvoss:system:qc2:flag:useinfo-flag-test-200908.csv.gz|useinfo-flag-test-200908.csv.gz}} And here is an extract comprising 100 results picked at **random** from the total set of results (note the table is too big to load as one into the Wiki): ^Oiginal Controlinfo ^Original Useinfo ^Useinfo with Qc2 On ^Is there a change?^ |1110100000300011 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1000002000000600 |7138900400000XX1 |7038900000000XX1 |CHANGE | |1100000000000007 |3031900000000XX0 |3031900000000XX0 |NO-CHANGE | |1131000000000001 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1030002000000000 |7020200000000XX1 |7020200000000XX1 |NO-CHANGE | |1500500000000007 |3131900400000XX2 |3031900000000XX2 |CHANGE | |1111100000000010 |7100000300000XX0 |5000000000000XX0 |CHANGE | |1211200000100000 |7010700000000XX2 |5010700000000XX2 |CHANGE | |1113000000000011 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1102400000000007 |3131900400000XX2 |1031900000000XX2 |CHANGE | |1113100000000000 |7120300400000XX1 |5020300000000XX1 |CHANGE | |1301100000000000 |7010100000000XX1 |5010100000000XX1 |CHANGE | |1030001000100007 |3891900000000XX1 |3891900000000XX1 |NO-CHANGE | |1111200000000002 |3100000300000XX1 |1000000000000XX1 |CHANGE | |1110000000300001 |3100000300000XX1 |3000000000000XX1 |CHANGE | |1600600000100000 |7033700000000XX2 |7033700000000XX2 |NO-CHANGE | |1210100000100011 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1210000000000002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1111300000000002 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1111200000100000 |7110700400000XX1 |5010700000000XX1 |CHANGE | |1510100000100022 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1000001000006006 |3895900000000XX0 |1895900000000XX0 |CHANGE | |1410100000100091 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1311000000000012 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1511000000100002 |3100000400000XX1 |1000000000000XX1 |CHANGE | |1200100000000001 |3100000300000XX1 |3000000000000XX1 |CHANGE | |1030003000000000 |7899200000000XX1 |7899200000000XX1 |NO-CHANGE | |1211000000100000 |7010100000000XX1 |5010100000000XX1 |CHANGE | |1111100000100011 |3100000300000XX0 |1000000000000XX0 |CHANGE | |1511000000000012 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1211000000000012 |3100000400000XX1 |1000000000000XX1 |CHANGE | |1010001000000000 |7890900000000XX0 |7894900000000XX0 |-4000000000 | |1030001000000005 |3892900000000XX1 |3892900000000XX1 |NO-CHANGE | |1130000000300001 |3000000000000XX2 |3000000000000XX2 |NO-CHANGE | |1311100000000012 |3100000300000XX1 |1000000000000XX1 |CHANGE | |1110200000100012 |3100000300000XX1 |3000000000000XX1 |CHANGE | |1110100000000001 |3000000000000XX0 |3000000000000XX0 |NO-CHANGE | |1110000000100000 |7100000400000XX0 |7000000000000XX0 |CHANGE | |1200000000000002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1201100000000000 |7010100000000XX1 |5010100000000XX1 |CHANGE | |1111000000100000 |7100000400000XX0 |5000000000000XX0 |CHANGE | |1010601000000007 |3891900000000XX1 |3891900000000XX1 |NO-CHANGE | |1111200000100012 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1310100000100012 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1111001000000015 |3892900000000XX0 |1892900000000XX0 |CHANGE | |1111200000100002 |3100000300000XX1 |1000000000000XX1 |CHANGE | |1102400000000000 |7020700000000XX2 |5020700000000XX2 |CHANGE | |1113000000000001 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1300100000000002 |3100000400000XX1 |3000000000000XX1 |CHANGE | |1110300000100002 |3100000400000XX1 |3000000000000XX1 |CHANGE | |1101000000000000 |7100000300000XX0 |5000000000000XX0 |CHANGE | |1100300000000001 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |110000200000000A |3138900400000XX0 |3038900000000XX0 |CHANGE | |1111100000000011 |3100000300000XX0 |1000000000000XX0 |CHANGE | |1131100000300011 |3000000000000XX2 |1000000000000XX2 |CHANGE | |1230000000000010 |7020200000000XX2 |7020200000000XX2 |NO-CHANGE | |1411100000000001 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1010100000000000 |7000000000000XX0 |7000000000000XX0 |NO-CHANGE | |1210000000100002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |11110000000000B1 |3000000000000XX0 |1000000000000XX0 |CHANGE | |1200100000000002 |3100000400000XX1 |3000000000000XX1 |CHANGE | |1300100000000000 |7010100000000XX1 |7010100000000XX1 |NO-CHANGE | |1100100000000001 |3100000300000XX0 |3000000000000XX0 |CHANGE | |1103100000000001 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1102000000000100 |7010300000000XX1 |5010300000000XX1 |CHANGE | |1130000000000007 |3131900400000XX1 |3031900000000XX1 |CHANGE | |1210000000000012 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1310000000100002 |3100000400000XX1 |3000000000000XX1 |CHANGE | |1130000000100007 |3131900300000XX1 |3031900000000XX1 |CHANGE | |1100000000001001 |3000000000000XX0 |1000000000000XX0 |CHANGE | |1411100000000021 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1210000000300001 |3000000000000XX2 |3000000000000XX2 |NO-CHANGE | |1110300000000002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1600002000000000 |7138100400000XX1 |7038100000000XX1 |CHANGE | |1510000000000002 |3100000400000XX1 |3000000000000XX1 |CHANGE | |1110000000300001 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1410100000000091 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1311000000100001 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1000600000000600 |7133700400000XX2 |7033700000000XX2 |CHANGE | |1210000000300001 |3000000000000XX2 |3000000000000XX2 |NO-CHANGE | |1112100000000011 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1311000000000012 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1113100000100000 |7020300000000XX1 |5020300000000XX1 |CHANGE | |1211000000000021 |3100000400000XX1 |1000000000000XX1 |CHANGE | |1410000000000012 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1200101000000005 |3892900000000XX1 |3892900000000XX1 |NO-CHANGE | |1100100000000001 |3000000000000XX0 |3000000000000XX0 |NO-CHANGE | |1311100000000012 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1600002000000007 |3131900400000XX1 |3031900000000XX1 |CHANGE | |1000601000000007 |3891900000000XX1 |3891900000000XX1 |NO-CHANGE | |1111200000100002 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1311100000000012 |3000000000000XX1 |1000000000000XX1 |CHANGE | |1210100000100002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |1600002000000007 |3031900000000XX1 |3031900000000XX1 |NO-CHANGE | |1100000000002006 |3335900000000XX0 |1335900000000XX0 |CHANGE | |1001000000000000 |7100000400000XX0 |5000000000000XX0 |CHANGE | |1110200000100002 |3000000000000XX1 |3000000000000XX1 |NO-CHANGE | |0000002000000000 |9999900000000XX0 |9099900000000XX0 |CHANGE | |1110300000000000 |7010700000000XX1 |7010700000000XX1 |NO-CHANGE | |1411100000100022 |3000000000000XX1 |1000000000000XX1 |CHANGE | $ ~/DATA/FlagRegression$ awk 'BEGIN {srand()} {printf "%05.0f %s \n",rand()*99999, $0; }' wikitable.txt | sort -n | head -100 | sed 's/^[0-9]*//' ===== Initialise Useinfo ===== This is the same as above except the useinfo is initialised with the original value (before it was not set), still see the problem with useinfo(7)!!!! ^Oiginal Controlinfo^Original Useinfo^Useinfor with Qc2 On^Useinfo with Qc2 On and Useinfo no reset^Change?^ |1211100000100002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1101200000000002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1231100000100000|7120200400000XX2|5020200000000XX2|7020200000000XX2|CHANGE| |1111100000000000|7000000000000XX0|5000000000000XX0|7000000000000XX0|NO-CHANGE| |1100200000000012|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1113100000100001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1111200000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1101100000000007|3031900000000XX0|1031900000000XX0|3031900000000XX0|NO-CHANGE| |1101200000000002|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1140000000003000|7220400000000XX1|5220400000000XX1|7220400000000XX1|NO-CHANGE| |1130000000300000|7120200400000XX2|7020200000000XX2|7020200000000XX2|CHANGE| |1100100000000001|3100000400000XX0|3000000000000XX0|3000000000000XX0|CHANGE| |1110300000100002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1201000000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1111000000300001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1130100000100011|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |143000200010000A|3038900000000XX2|3038900000000XX2|3038900000000XX2|NO-CHANGE| |1130000000000007|3131900300000XX1|3031900000000XX1|3031900000000XX1|CHANGE| |1110100000100011|3000000000000XX0|3000000000000XX0|3000000000000XX0|NO-CHANGE| |1500000000100002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1010601000000005|3892900000000XX1|3892900000000XX1|3892900000000XX1|NO-CHANGE| |1311100000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1211000000100001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1111200000100012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1113000000000001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1140000000006006|3335900000000XX1|1335900000000XX1|3335900000000XX1|NO-CHANGE| |1010000000001000|7000000000000XX0|5000000000000XX0|7000000000000XX0|NO-CHANGE| |1110200000100000|7010700000000XX1|7010700000000XX1|7010700000000XX1|NO-CHANGE| |1111400000000010|7020700000000XX1|5020700000000XX1|7020700000000XX1|NO-CHANGE| |1111300000000002|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |113030200000000A|3038900000000XX2|3038900000000XX2|3038900000000XX2|NO-CHANGE| |1100000000000400|7000000000000XX1|7033900000000XX1|7033900000000XX1|CHANGE| |1202000000000001|3000000000000XX2|1000000000000XX2|3000000000000XX2|NO-CHANGE| |1300100000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1113300000100000|7020700000000XX2|5020700000000XX2|7020700000000XX2|NO-CHANGE| |1110100000000001|3100000400000XX0|3000000000000XX0|3000000000000XX0|CHANGE| |1211100000000012|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1511000000000027|3031900000000XX1|1031900000000XX1|3031900000000XX1|NO-CHANGE| |1130000000100007|3131900300000XX1|3031900000000XX1|3031900000000XX1|CHANGE| |0000003000000007|4899900000000XX0|4899900000000XX0|4899900000000XX0|NO-CHANGE| |1011100000000000|7100000400000XX0|5000000000000XX0|7000000000000XX0|CHANGE| |1200100000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1010001000000005|3892900000000XX0|3892900000000XX0|3892900000000XX0|NO-CHANGE| |1600600000000017|3031900000000XX2|3031900000000XX2|3031900000000XX2|NO-CHANGE| |1600002000000007|3031900000000XX1|3031900000000XX1|3031900000000XX1|NO-CHANGE| |1101100000000001|3100000400000XX0|1000000000000XX0|3000000000000XX0|CHANGE| |0000002000000000|9999900000000XX0|9099900000000XX0|9099900000000XX0|CHANGE| |1111500000100000|7020700000000XX1|5020700000000XX1|7020700000000XX1|NO-CHANGE| |1300000000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1330100000100012|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE| |1211100000000011|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1501000000000000|7020100000000XX1|5020100000000XX1|7020100000000XX1|NO-CHANGE| |1130100000300011|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE| |1131000000000007|3031900000000XX1|1031900000000XX1|3031900000000XX1|NO-CHANGE| |1000002000000600|7138900400000XX1|7038900000000XX1|7038900000000XX1|CHANGE| |160000200000000A|3038900000000XX1|3038900000000XX1|3038900000000XX1|NO-CHANGE| |1511000000300001|3000000000000XX2|1000000000000XX2|3000000000000XX2|NO-CHANGE| |1211100000000012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1102100000000001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1130000000300001|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE| |1101000000000007|3031900000000XX0|1031900000000XX0|3031900000000XX0|NO-CHANGE| |1411100000000022|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1101100000000001|3100000400000XX0|1000000000000XX0|3000000000000XX0|CHANGE| |1111300000000012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1111300000100002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1211100000000011|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1510000000000002|3100000400000XX1|3000000000000XX1|3000000000000XX1|CHANGE| |1400000000000000|7120100300000XX1|7020100000000XX1|7020100000000XX1|CHANGE| |1210100000100012|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1311100000000012|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1600100000000011|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1200000000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1101200000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1110100000000001|3000000000000XX0|3000000000000XX0|3000000000000XX0|NO-CHANGE| |1401100000000002|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1130000000000017|3031900000000XX1|3031900000000XX1|3031900000000XX1|NO-CHANGE| |1130000000300001|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE| |1111100000100011|3000000000000XX0|1000000000000XX0|3000000000000XX0|NO-CHANGE| |1111200000100000|7110700400000XX1|5010700000000XX1|7010700000000XX1|CHANGE| |1500000000000001|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1113100000000000|7120300400000XX1|5020300000000XX1|7020300000000XX1|CHANGE| |1110100000100000|7000000000000XX0|7000000000000XX0|7000000000000XX0|NO-CHANGE| |1130000000100000|7020200000000XX1|7020200000000XX1|7020200000000XX1|NO-CHANGE| |1402000000000000|7020300000000XX2|5020300000000XX2|7020300000000XX2|NO-CHANGE| |1102100000000007|3031900000000XX1|1031900000000XX1|3031900000000XX1|NO-CHANGE| |1500500000000007|3031900000000XX2|3031900000000XX2|3031900000000XX2|NO-CHANGE| |1211100000100002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1110200000100012|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1211000000000012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1100000000000100|7100000400000XX0|7000000000000XX0|7000000000000XX0|CHANGE| |1510000000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1113000000100000|7020300000000XX1|5020300000000XX1|7020300000000XX1|NO-CHANGE| |1200100000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1111000000000017|3031900000000XX0|1031900000000XX0|3031900000000XX0|NO-CHANGE| |1130100000000001|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1110000000300001|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1002000000000001|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1300100000000000|7010100000000XX1|7010100000000XX1|7010100000000XX1|NO-CHANGE| |1113100000100001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1001200000000002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|