Qc1 regression tests
Qc1 regression tests arising from the introduction of Qc2 flagging for useinfo.
Strategy
The kvalobs database data from 200908 (taken from the backups of histkvalobs) was analysed and all the combinations of controlinfo and useinfo were extracted (approximately 2275 in total). The controlinfo values were processed by setUseFlags(const kvControlInfo& cinfo) with the existing Qc2 logic turned on. The following table displays the original controlinfo and useinfo as well as the new useinfo generated by the Qc2 aware setUseFlags. The fourth column indicates if there is a change to the useinfo or not. In approximately 37% of cases the useinfo generated was the same. useinfo(13) and useinfo(14) were overwritten by XX in the table since this is the userid set by HQC. AFter substituting XX it was found that the actual number of unique combination is 1076.
Questions:
- Is th a valid regression test?
- Are the differences a problem or not?
- i.e. are some differences only due to HQC activity and the Qc2 settings so far are ok?
- can we commit the updated setUseFlags back into kvDataFlag.cc?
The results of the regression test:useinfo-flag-test-200908.csv.gz
And here is an extract comprising 100 results picked at random from the total set of results (note the table is too big to load as one into the Wiki):
Oiginal Controlinfo | Original Useinfo | Useinfo with Qc2 On | Is there a change? |
---|---|---|---|
1110100000300011 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1000002000000600 | 7138900400000XX1 | 7038900000000XX1 | CHANGE |
1100000000000007 | 3031900000000XX0 | 3031900000000XX0 | NO-CHANGE |
1131000000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1030002000000000 | 7020200000000XX1 | 7020200000000XX1 | NO-CHANGE |
1500500000000007 | 3131900400000XX2 | 3031900000000XX2 | CHANGE |
1111100000000010 | 7100000300000XX0 | 5000000000000XX0 | CHANGE |
1211200000100000 | 7010700000000XX2 | 5010700000000XX2 | CHANGE |
1113000000000011 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1102400000000007 | 3131900400000XX2 | 1031900000000XX2 | CHANGE |
1113100000000000 | 7120300400000XX1 | 5020300000000XX1 | CHANGE |
1301100000000000 | 7010100000000XX1 | 5010100000000XX1 | CHANGE |
1030001000100007 | 3891900000000XX1 | 3891900000000XX1 | NO-CHANGE |
1111200000000002 | 3100000300000XX1 | 1000000000000XX1 | CHANGE |
1110000000300001 | 3100000300000XX1 | 3000000000000XX1 | CHANGE |
1600600000100000 | 7033700000000XX2 | 7033700000000XX2 | NO-CHANGE |
1210100000100011 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1210000000000002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1111300000000002 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1111200000100000 | 7110700400000XX1 | 5010700000000XX1 | CHANGE |
1510100000100022 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1000001000006006 | 3895900000000XX0 | 1895900000000XX0 | CHANGE |
1410100000100091 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1311000000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1511000000100002 | 3100000400000XX1 | 1000000000000XX1 | CHANGE |
1200100000000001 | 3100000300000XX1 | 3000000000000XX1 | CHANGE |
1030003000000000 | 7899200000000XX1 | 7899200000000XX1 | NO-CHANGE |
1211000000100000 | 7010100000000XX1 | 5010100000000XX1 | CHANGE |
1111100000100011 | 3100000300000XX0 | 1000000000000XX0 | CHANGE |
1511000000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1211000000000012 | 3100000400000XX1 | 1000000000000XX1 | CHANGE |
1010001000000000 | 7890900000000XX0 | 7894900000000XX0 | -4000000000 |
1030001000000005 | 3892900000000XX1 | 3892900000000XX1 | NO-CHANGE |
1130000000300001 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1311100000000012 | 3100000300000XX1 | 1000000000000XX1 | CHANGE |
1110200000100012 | 3100000300000XX1 | 3000000000000XX1 | CHANGE |
1110100000000001 | 3000000000000XX0 | 3000000000000XX0 | NO-CHANGE |
1110000000100000 | 7100000400000XX0 | 7000000000000XX0 | CHANGE |
1200000000000002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1201100000000000 | 7010100000000XX1 | 5010100000000XX1 | CHANGE |
1111000000100000 | 7100000400000XX0 | 5000000000000XX0 | CHANGE |
1010601000000007 | 3891900000000XX1 | 3891900000000XX1 | NO-CHANGE |
1111200000100012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1310100000100012 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1111001000000015 | 3892900000000XX0 | 1892900000000XX0 | CHANGE |
1111200000100002 | 3100000300000XX1 | 1000000000000XX1 | CHANGE |
1102400000000000 | 7020700000000XX2 | 5020700000000XX2 | CHANGE |
1113000000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1300100000000002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
1110300000100002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
1101000000000000 | 7100000300000XX0 | 5000000000000XX0 | CHANGE |
1100300000000001 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
110000200000000A | 3138900400000XX0 | 3038900000000XX0 | CHANGE |
1111100000000011 | 3100000300000XX0 | 1000000000000XX0 | CHANGE |
1131100000300011 | 3000000000000XX2 | 1000000000000XX2 | CHANGE |
1230000000000010 | 7020200000000XX2 | 7020200000000XX2 | NO-CHANGE |
1411100000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1010100000000000 | 7000000000000XX0 | 7000000000000XX0 | NO-CHANGE |
1210000000100002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
11110000000000B1 | 3000000000000XX0 | 1000000000000XX0 | CHANGE |
1200100000000002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
1300100000000000 | 7010100000000XX1 | 7010100000000XX1 | NO-CHANGE |
1100100000000001 | 3100000300000XX0 | 3000000000000XX0 | CHANGE |
1103100000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1102000000000100 | 7010300000000XX1 | 5010300000000XX1 | CHANGE |
1130000000000007 | 3131900400000XX1 | 3031900000000XX1 | CHANGE |
1210000000000012 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1310000000100002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
1130000000100007 | 3131900300000XX1 | 3031900000000XX1 | CHANGE |
1100000000001001 | 3000000000000XX0 | 1000000000000XX0 | CHANGE |
1411100000000021 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1210000000300001 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1110300000000002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1600002000000000 | 7138100400000XX1 | 7038100000000XX1 | CHANGE |
1510000000000002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
1110000000300001 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1410100000000091 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1311000000100001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1000600000000600 | 7133700400000XX2 | 7033700000000XX2 | CHANGE |
1210000000300001 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1112100000000011 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1311000000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1113100000100000 | 7020300000000XX1 | 5020300000000XX1 | CHANGE |
1211000000000021 | 3100000400000XX1 | 1000000000000XX1 | CHANGE |
1410000000000012 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1200101000000005 | 3892900000000XX1 | 3892900000000XX1 | NO-CHANGE |
1100100000000001 | 3000000000000XX0 | 3000000000000XX0 | NO-CHANGE |
1311100000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1600002000000007 | 3131900400000XX1 | 3031900000000XX1 | CHANGE |
1000601000000007 | 3891900000000XX1 | 3891900000000XX1 | NO-CHANGE |
1111200000100002 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1311100000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1210100000100002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1600002000000007 | 3031900000000XX1 | 3031900000000XX1 | NO-CHANGE |
1100000000002006 | 3335900000000XX0 | 1335900000000XX0 | CHANGE |
1001000000000000 | 7100000400000XX0 | 5000000000000XX0 | CHANGE |
1110200000100002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
0000002000000000 | 9999900000000XX0 | 9099900000000XX0 | CHANGE |
1110300000000000 | 7010700000000XX1 | 7010700000000XX1 | NO-CHANGE |
1411100000100022 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
$ ~/DATA/FlagRegression$ awk 'BEGIN {srand()} {printf "%05.0f %s \n",rand()*99999, $0; }' wikitable.txt | sort -n | head -100 | sed 's/^[0-9]*//'
Initialise Useinfo
This is the same as above except the useinfo is initialised with the original value (before it was not set), still see the problem with useinfo(7)!!!!
Oiginal Controlinfo | Original Useinfo | Useinfor with Qc2 On | Useinfo with Qc2 On and Useinfo no reset | Change? |
---|---|---|---|---|
1211100000100002 | 3100000400000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1101200000000002 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1231100000100000 | 7120200400000XX2 | 5020200000000XX2 | 7020200000000XX2 | CHANGE |
1111100000000000 | 7000000000000XX0 | 5000000000000XX0 | 7000000000000XX0 | NO-CHANGE |
1100200000000012 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1113100000100001 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1111200000000002 | 3100000400000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1101100000000007 | 3031900000000XX0 | 1031900000000XX0 | 3031900000000XX0 | NO-CHANGE |
1101200000000002 | 3100000300000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1140000000003000 | 7220400000000XX1 | 5220400000000XX1 | 7220400000000XX1 | NO-CHANGE |
1130000000300000 | 7120200400000XX2 | 7020200000000XX2 | 7020200000000XX2 | CHANGE |
1100100000000001 | 3100000400000XX0 | 3000000000000XX0 | 3000000000000XX0 | CHANGE |
1110300000100002 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1201000000000002 | 3100000400000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1111000000300001 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1130100000100011 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
143000200010000A | 3038900000000XX2 | 3038900000000XX2 | 3038900000000XX2 | NO-CHANGE |
1130000000000007 | 3131900300000XX1 | 3031900000000XX1 | 3031900000000XX1 | CHANGE |
1110100000100011 | 3000000000000XX0 | 3000000000000XX0 | 3000000000000XX0 | NO-CHANGE |
1500000000100002 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1010601000000005 | 3892900000000XX1 | 3892900000000XX1 | 3892900000000XX1 | NO-CHANGE |
1311100000000002 | 3100000400000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1211000000100001 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1111200000100012 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1113000000000001 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1140000000006006 | 3335900000000XX1 | 1335900000000XX1 | 3335900000000XX1 | NO-CHANGE |
1010000000001000 | 7000000000000XX0 | 5000000000000XX0 | 7000000000000XX0 | NO-CHANGE |
1110200000100000 | 7010700000000XX1 | 7010700000000XX1 | 7010700000000XX1 | NO-CHANGE |
1111400000000010 | 7020700000000XX1 | 5020700000000XX1 | 7020700000000XX1 | NO-CHANGE |
1111300000000002 | 3100000300000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
113030200000000A | 3038900000000XX2 | 3038900000000XX2 | 3038900000000XX2 | NO-CHANGE |
1100000000000400 | 7000000000000XX1 | 7033900000000XX1 | 7033900000000XX1 | CHANGE |
1202000000000001 | 3000000000000XX2 | 1000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1300100000000002 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1113300000100000 | 7020700000000XX2 | 5020700000000XX2 | 7020700000000XX2 | NO-CHANGE |
1110100000000001 | 3100000400000XX0 | 3000000000000XX0 | 3000000000000XX0 | CHANGE |
1211100000000012 | 3100000400000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1511000000000027 | 3031900000000XX1 | 1031900000000XX1 | 3031900000000XX1 | NO-CHANGE |
1130000000100007 | 3131900300000XX1 | 3031900000000XX1 | 3031900000000XX1 | CHANGE |
0000003000000007 | 4899900000000XX0 | 4899900000000XX0 | 4899900000000XX0 | NO-CHANGE |
1011100000000000 | 7100000400000XX0 | 5000000000000XX0 | 7000000000000XX0 | CHANGE |
1200100000000002 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1010001000000005 | 3892900000000XX0 | 3892900000000XX0 | 3892900000000XX0 | NO-CHANGE |
1600600000000017 | 3031900000000XX2 | 3031900000000XX2 | 3031900000000XX2 | NO-CHANGE |
1600002000000007 | 3031900000000XX1 | 3031900000000XX1 | 3031900000000XX1 | NO-CHANGE |
1101100000000001 | 3100000400000XX0 | 1000000000000XX0 | 3000000000000XX0 | CHANGE |
0000002000000000 | 9999900000000XX0 | 9099900000000XX0 | 9099900000000XX0 | CHANGE |
1111500000100000 | 7020700000000XX1 | 5020700000000XX1 | 7020700000000XX1 | NO-CHANGE |
1300000000000002 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1330100000100012 | 3000000000000XX2 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1211100000000011 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1501000000000000 | 7020100000000XX1 | 5020100000000XX1 | 7020100000000XX1 | NO-CHANGE |
1130100000300011 | 3000000000000XX2 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1131000000000007 | 3031900000000XX1 | 1031900000000XX1 | 3031900000000XX1 | NO-CHANGE |
1000002000000600 | 7138900400000XX1 | 7038900000000XX1 | 7038900000000XX1 | CHANGE |
160000200000000A | 3038900000000XX1 | 3038900000000XX1 | 3038900000000XX1 | NO-CHANGE |
1511000000300001 | 3000000000000XX2 | 1000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1211100000000012 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1102100000000001 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1130000000300001 | 3000000000000XX2 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1101000000000007 | 3031900000000XX0 | 1031900000000XX0 | 3031900000000XX0 | NO-CHANGE |
1411100000000022 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1101100000000001 | 3100000400000XX0 | 1000000000000XX0 | 3000000000000XX0 | CHANGE |
1111300000000012 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1111300000100002 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1211100000000011 | 3100000400000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1510000000000002 | 3100000400000XX1 | 3000000000000XX1 | 3000000000000XX1 | CHANGE |
1400000000000000 | 7120100300000XX1 | 7020100000000XX1 | 7020100000000XX1 | CHANGE |
1210100000100012 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1311100000000012 | 3100000300000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1600100000000011 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1200000000000002 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1101200000000002 | 3100000400000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1110100000000001 | 3000000000000XX0 | 3000000000000XX0 | 3000000000000XX0 | NO-CHANGE |
1401100000000002 | 3100000300000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1130000000000017 | 3031900000000XX1 | 3031900000000XX1 | 3031900000000XX1 | NO-CHANGE |
1130000000300001 | 3000000000000XX2 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1111100000100011 | 3000000000000XX0 | 1000000000000XX0 | 3000000000000XX0 | NO-CHANGE |
1111200000100000 | 7110700400000XX1 | 5010700000000XX1 | 7010700000000XX1 | CHANGE |
1500000000000001 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1113100000000000 | 7120300400000XX1 | 5020300000000XX1 | 7020300000000XX1 | CHANGE |
1110100000100000 | 7000000000000XX0 | 7000000000000XX0 | 7000000000000XX0 | NO-CHANGE |
1130000000100000 | 7020200000000XX1 | 7020200000000XX1 | 7020200000000XX1 | NO-CHANGE |
1402000000000000 | 7020300000000XX2 | 5020300000000XX2 | 7020300000000XX2 | NO-CHANGE |
1102100000000007 | 3031900000000XX1 | 1031900000000XX1 | 3031900000000XX1 | NO-CHANGE |
1500500000000007 | 3031900000000XX2 | 3031900000000XX2 | 3031900000000XX2 | NO-CHANGE |
1211100000100002 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1110200000100012 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1211000000000012 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1100000000000100 | 7100000400000XX0 | 7000000000000XX0 | 7000000000000XX0 | CHANGE |
1510000000000002 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1113000000100000 | 7020300000000XX1 | 5020300000000XX1 | 7020300000000XX1 | NO-CHANGE |
1200100000000002 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1111000000000017 | 3031900000000XX0 | 1031900000000XX0 | 3031900000000XX0 | NO-CHANGE |
1130100000000001 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1110000000300001 | 3000000000000XX1 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1002000000000001 | 3100000400000XX1 | 1000000000000XX1 | 3000000000000XX1 | CHANGE |
1300100000000000 | 7010100000000XX1 | 7010100000000XX1 | 7010100000000XX1 | NO-CHANGE |
1113100000100001 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1001200000000002 | 3000000000000XX1 | 1000000000000XX1 | 3000000000000XX1 | NO-CHANGE |