This is an old revision of the document!
Qc1 regression tests
Qc1 regression tests arising from the introduction of Qc2 flagging for useinfo.
Strategy
The kvalobs database data from 200908 (taken from the backups of histkvalobs) was analysed and all the combinations of controlinfo and useinfo were extracted (approximately 2275 in total). The controlinfo values were processed by setUseFlags(const kvControlInfo& cinfo) with the existing Qc2 logic turned on. The following table displays the original controlinfo and useinfo as well as the new useinfo generated by the Qc2 aware setUseFlags. The fourth column indicates if there is a change to the useinfo or not. In approximately 37% of cases the useinfo generated was the same. useinfo(13) and useinfo(14) were overwritten by XX in the table since this is the userid set by HQC. AFter substituting XX it was found that the actual number of unique combination is 1076.
Questions:
- Is th a valid regression test?
- Are the differences a problem or not?
- i.e. are some differences only due to HQC activity and the Qc2 settings so far are ok?
- can we commit the updated setUseFlags back into kvDataFlag.cc?
The results of the regression test:useinfo-flag-test-200908.csv.gz
And here is an extract comprising 100 results picked at random from the total set of results (note the table is too big to load as one into the Wiki):
Oiginal Controlinfo | Original Useinfo | Useinfo with Qc2 On | Is there a change? |
---|---|---|---|
1110100000300011 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1000002000000600 | 7138900400000XX1 | 7038900000000XX1 | CHANGE |
1100000000000007 | 3031900000000XX0 | 3031900000000XX0 | NO-CHANGE |
1131000000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1030002000000000 | 7020200000000XX1 | 7020200000000XX1 | NO-CHANGE |
1500500000000007 | 3131900400000XX2 | 3031900000000XX2 | CHANGE |
1111100000000010 | 7100000300000XX0 | 5000000000000XX0 | CHANGE |
1211200000100000 | 7010700000000XX2 | 5010700000000XX2 | CHANGE |
1113000000000011 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1102400000000007 | 3131900400000XX2 | 1031900000000XX2 | CHANGE |
1113100000000000 | 7120300400000XX1 | 5020300000000XX1 | CHANGE |
1301100000000000 | 7010100000000XX1 | 5010100000000XX1 | CHANGE |
1030001000100007 | 3891900000000XX1 | 3891900000000XX1 | NO-CHANGE |
1111200000000002 | 3100000300000XX1 | 1000000000000XX1 | CHANGE |
1110000000300001 | 3100000300000XX1 | 3000000000000XX1 | CHANGE |
1600600000100000 | 7033700000000XX2 | 7033700000000XX2 | NO-CHANGE |
1210100000100011 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1210000000000002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1111300000000002 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1111200000100000 | 7110700400000XX1 | 5010700000000XX1 | CHANGE |
1510100000100022 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1000001000006006 | 3895900000000XX0 | 1895900000000XX0 | CHANGE |
1410100000100091 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1311000000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1511000000100002 | 3100000400000XX1 | 1000000000000XX1 | CHANGE |
1200100000000001 | 3100000300000XX1 | 3000000000000XX1 | CHANGE |
1030003000000000 | 7899200000000XX1 | 7899200000000XX1 | NO-CHANGE |
1211000000100000 | 7010100000000XX1 | 5010100000000XX1 | CHANGE |
1111100000100011 | 3100000300000XX0 | 1000000000000XX0 | CHANGE |
1511000000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1211000000000012 | 3100000400000XX1 | 1000000000000XX1 | CHANGE |
1010001000000000 | 7890900000000XX0 | 7894900000000XX0 | -4000000000 |
1030001000000005 | 3892900000000XX1 | 3892900000000XX1 | NO-CHANGE |
1130000000300001 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1311100000000012 | 3100000300000XX1 | 1000000000000XX1 | CHANGE |
1110200000100012 | 3100000300000XX1 | 3000000000000XX1 | CHANGE |
1110100000000001 | 3000000000000XX0 | 3000000000000XX0 | NO-CHANGE |
1110000000100000 | 7100000400000XX0 | 7000000000000XX0 | CHANGE |
1200000000000002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1201100000000000 | 7010100000000XX1 | 5010100000000XX1 | CHANGE |
1111000000100000 | 7100000400000XX0 | 5000000000000XX0 | CHANGE |
1010601000000007 | 3891900000000XX1 | 3891900000000XX1 | NO-CHANGE |
1111200000100012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1310100000100012 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1111001000000015 | 3892900000000XX0 | 1892900000000XX0 | CHANGE |
1111200000100002 | 3100000300000XX1 | 1000000000000XX1 | CHANGE |
1102400000000000 | 7020700000000XX2 | 5020700000000XX2 | CHANGE |
1113000000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1300100000000002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
1110300000100002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
1101000000000000 | 7100000300000XX0 | 5000000000000XX0 | CHANGE |
1100300000000001 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
110000200000000A | 3138900400000XX0 | 3038900000000XX0 | CHANGE |
1111100000000011 | 3100000300000XX0 | 1000000000000XX0 | CHANGE |
1131100000300011 | 3000000000000XX2 | 1000000000000XX2 | CHANGE |
1230000000000010 | 7020200000000XX2 | 7020200000000XX2 | NO-CHANGE |
1411100000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1010100000000000 | 7000000000000XX0 | 7000000000000XX0 | NO-CHANGE |
1210000000100002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
11110000000000B1 | 3000000000000XX0 | 1000000000000XX0 | CHANGE |
1200100000000002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
1300100000000000 | 7010100000000XX1 | 7010100000000XX1 | NO-CHANGE |
1100100000000001 | 3100000300000XX0 | 3000000000000XX0 | CHANGE |
1103100000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1102000000000100 | 7010300000000XX1 | 5010300000000XX1 | CHANGE |
1130000000000007 | 3131900400000XX1 | 3031900000000XX1 | CHANGE |
1210000000000012 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1310000000100002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
1130000000100007 | 3131900300000XX1 | 3031900000000XX1 | CHANGE |
1100000000001001 | 3000000000000XX0 | 1000000000000XX0 | CHANGE |
1411100000000021 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1210000000300001 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1110300000000002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1600002000000000 | 7138100400000XX1 | 7038100000000XX1 | CHANGE |
1510000000000002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
1110000000300001 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1410100000000091 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1311000000100001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1000600000000600 | 7133700400000XX2 | 7033700000000XX2 | CHANGE |
1210000000300001 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
1112100000000011 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1311000000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1113100000100000 | 7020300000000XX1 | 5020300000000XX1 | CHANGE |
1211000000000021 | 3100000400000XX1 | 1000000000000XX1 | CHANGE |
1410000000000012 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1200101000000005 | 3892900000000XX1 | 3892900000000XX1 | NO-CHANGE |
1100100000000001 | 3000000000000XX0 | 3000000000000XX0 | NO-CHANGE |
1311100000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1600002000000007 | 3131900400000XX1 | 3031900000000XX1 | CHANGE |
1000601000000007 | 3891900000000XX1 | 3891900000000XX1 | NO-CHANGE |
1111200000100002 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1311100000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
1210100000100002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
1600002000000007 | 3031900000000XX1 | 3031900000000XX1 | NO-CHANGE |
1100000000002006 | 3335900000000XX0 | 1335900000000XX0 | CHANGE |
1001000000000000 | 7100000400000XX0 | 5000000000000XX0 | CHANGE |
1110200000100002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
0000002000000000 | 9999900000000XX0 | 9099900000000XX0 | CHANGE |
1110300000000000 | 7010700000000XX1 | 7010700000000XX1 | NO-CHANGE |
1411100000100022 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
$ ~/DATA/FlagRegression$ awk 'BEGIN {srand()} {printf “%05.0f %s \n”,rand()*99999, $0; }' wikitable.txt | sort -n | head -100 | sed 's/^[0-9]* '