This is an old revision of the document!
Qc1 regression tests
Qc1 regression tests arising from the introduction of Qc2 flagging for useinfo.
Strategy
The kvalobs database data from 200908 (taken from the backups of histkvalobs) was analysed and all the combinations of controlinfo and useinfo were extracted (approximately 2275 in total). The controlinfo values were processed by setUseFlags(const kvControlInfo& cinfo) with the existing Qc2 logic turned on. The following table displays the original controlinfo and useinfo as well as the new useinfo generated by the Qc2 aware setUseFlags. The fourth column indicates if there is a change to the useinfo or not. In approximately 37% of cases the useinfo generated was the same. useinfo(13) and useinfo(14) were overwritten by XX in the table since this is the userid set by HQC. AFter substituting XX it was found that the actual number of unique combination is 1076.
Questions:
- Is th a valid regression test?
- Are the differences a problem or not?
- i.e. are some differences only due to HQC activity and the Qc2 settings so far are ok?
- can we commit the updated setUseFlags back into kvDataFlag.cc?
The results of the regression test:useinfo-flag-test-200908.csv.gz
And here is an extract comprising 100 results picked at random from the total set of results (note the table is too big to load as one into the Wiki):
| Oiginal Controlinfo | Original Useinfo | Useinfo with Qc2 On | Is there a change? |
|---|---|---|---|
| 1110100000300011 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1000002000000600 | 7138900400000XX1 | 7038900000000XX1 | CHANGE |
| 1100000000000007 | 3031900000000XX0 | 3031900000000XX0 | NO-CHANGE |
| 1131000000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1030002000000000 | 7020200000000XX1 | 7020200000000XX1 | NO-CHANGE |
| 1500500000000007 | 3131900400000XX2 | 3031900000000XX2 | CHANGE |
| 1111100000000010 | 7100000300000XX0 | 5000000000000XX0 | CHANGE |
| 1211200000100000 | 7010700000000XX2 | 5010700000000XX2 | CHANGE |
| 1113000000000011 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1102400000000007 | 3131900400000XX2 | 1031900000000XX2 | CHANGE |
| 1113100000000000 | 7120300400000XX1 | 5020300000000XX1 | CHANGE |
| 1301100000000000 | 7010100000000XX1 | 5010100000000XX1 | CHANGE |
| 1030001000100007 | 3891900000000XX1 | 3891900000000XX1 | NO-CHANGE |
| 1111200000000002 | 3100000300000XX1 | 1000000000000XX1 | CHANGE |
| 1110000000300001 | 3100000300000XX1 | 3000000000000XX1 | CHANGE |
| 1600600000100000 | 7033700000000XX2 | 7033700000000XX2 | NO-CHANGE |
| 1210100000100011 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1210000000000002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1111300000000002 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1111200000100000 | 7110700400000XX1 | 5010700000000XX1 | CHANGE |
| 1510100000100022 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1000001000006006 | 3895900000000XX0 | 1895900000000XX0 | CHANGE |
| 1410100000100091 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1311000000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1511000000100002 | 3100000400000XX1 | 1000000000000XX1 | CHANGE |
| 1200100000000001 | 3100000300000XX1 | 3000000000000XX1 | CHANGE |
| 1030003000000000 | 7899200000000XX1 | 7899200000000XX1 | NO-CHANGE |
| 1211000000100000 | 7010100000000XX1 | 5010100000000XX1 | CHANGE |
| 1111100000100011 | 3100000300000XX0 | 1000000000000XX0 | CHANGE |
| 1511000000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1211000000000012 | 3100000400000XX1 | 1000000000000XX1 | CHANGE |
| 1010001000000000 | 7890900000000XX0 | 7894900000000XX0 | -4000000000 |
| 1030001000000005 | 3892900000000XX1 | 3892900000000XX1 | NO-CHANGE |
| 1130000000300001 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
| 1311100000000012 | 3100000300000XX1 | 1000000000000XX1 | CHANGE |
| 1110200000100012 | 3100000300000XX1 | 3000000000000XX1 | CHANGE |
| 1110100000000001 | 3000000000000XX0 | 3000000000000XX0 | NO-CHANGE |
| 1110000000100000 | 7100000400000XX0 | 7000000000000XX0 | CHANGE |
| 1200000000000002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1201100000000000 | 7010100000000XX1 | 5010100000000XX1 | CHANGE |
| 1111000000100000 | 7100000400000XX0 | 5000000000000XX0 | CHANGE |
| 1010601000000007 | 3891900000000XX1 | 3891900000000XX1 | NO-CHANGE |
| 1111200000100012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1310100000100012 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1111001000000015 | 3892900000000XX0 | 1892900000000XX0 | CHANGE |
| 1111200000100002 | 3100000300000XX1 | 1000000000000XX1 | CHANGE |
| 1102400000000000 | 7020700000000XX2 | 5020700000000XX2 | CHANGE |
| 1113000000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1300100000000002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
| 1110300000100002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
| 1101000000000000 | 7100000300000XX0 | 5000000000000XX0 | CHANGE |
| 1100300000000001 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 110000200000000A | 3138900400000XX0 | 3038900000000XX0 | CHANGE |
| 1111100000000011 | 3100000300000XX0 | 1000000000000XX0 | CHANGE |
| 1131100000300011 | 3000000000000XX2 | 1000000000000XX2 | CHANGE |
| 1230000000000010 | 7020200000000XX2 | 7020200000000XX2 | NO-CHANGE |
| 1411100000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1010100000000000 | 7000000000000XX0 | 7000000000000XX0 | NO-CHANGE |
| 1210000000100002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 11110000000000B1 | 3000000000000XX0 | 1000000000000XX0 | CHANGE |
| 1200100000000002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
| 1300100000000000 | 7010100000000XX1 | 7010100000000XX1 | NO-CHANGE |
| 1100100000000001 | 3100000300000XX0 | 3000000000000XX0 | CHANGE |
| 1103100000000001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1102000000000100 | 7010300000000XX1 | 5010300000000XX1 | CHANGE |
| 1130000000000007 | 3131900400000XX1 | 3031900000000XX1 | CHANGE |
| 1210000000000012 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1310000000100002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
| 1130000000100007 | 3131900300000XX1 | 3031900000000XX1 | CHANGE |
| 1100000000001001 | 3000000000000XX0 | 1000000000000XX0 | CHANGE |
| 1411100000000021 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1210000000300001 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
| 1110300000000002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1600002000000000 | 7138100400000XX1 | 7038100000000XX1 | CHANGE |
| 1510000000000002 | 3100000400000XX1 | 3000000000000XX1 | CHANGE |
| 1110000000300001 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1410100000000091 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1311000000100001 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1000600000000600 | 7133700400000XX2 | 7033700000000XX2 | CHANGE |
| 1210000000300001 | 3000000000000XX2 | 3000000000000XX2 | NO-CHANGE |
| 1112100000000011 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1311000000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1113100000100000 | 7020300000000XX1 | 5020300000000XX1 | CHANGE |
| 1211000000000021 | 3100000400000XX1 | 1000000000000XX1 | CHANGE |
| 1410000000000012 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1200101000000005 | 3892900000000XX1 | 3892900000000XX1 | NO-CHANGE |
| 1100100000000001 | 3000000000000XX0 | 3000000000000XX0 | NO-CHANGE |
| 1311100000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1600002000000007 | 3131900400000XX1 | 3031900000000XX1 | CHANGE |
| 1000601000000007 | 3891900000000XX1 | 3891900000000XX1 | NO-CHANGE |
| 1111200000100002 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1311100000000012 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
| 1210100000100002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 1600002000000007 | 3031900000000XX1 | 3031900000000XX1 | NO-CHANGE |
| 1100000000002006 | 3335900000000XX0 | 1335900000000XX0 | CHANGE |
| 1001000000000000 | 7100000400000XX0 | 5000000000000XX0 | CHANGE |
| 1110200000100002 | 3000000000000XX1 | 3000000000000XX1 | NO-CHANGE |
| 0000002000000000 | 9999900000000XX0 | 9099900000000XX0 | CHANGE |
| 1110300000000000 | 7010700000000XX1 | 7010700000000XX1 | NO-CHANGE |
| 1411100000100022 | 3000000000000XX1 | 1000000000000XX1 | CHANGE |
$ ~/DATA/FlagRegression$ awk 'BEGIN {srand()} {printf “%05.0f %s \n”,rand()*99999, $0; }' wikitable.txt | sort -n | head -100 | sed 's/^[0-9]*' ^Oiginal Controlinfo^Original Useinfo^Useinfor with Qc2 On^Useinfo with Qc2 On and Useinfo no reset^Change?^ |1211100000100002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1101200000000002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1231100000100000|7120200400000XX2|5020200000000XX2|7020200000000XX2|CHANGE| |1111100000000000|7000000000000XX0|5000000000000XX0|7000000000000XX0|NO-CHANGE| |1100200000000012|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1113100000100001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1111200000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1101100000000007|3031900000000XX0|1031900000000XX0|3031900000000XX0|NO-CHANGE| |1101200000000002|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1140000000003000|7220400000000XX1|5220400000000XX1|7220400000000XX1|NO-CHANGE| |1130000000300000|7120200400000XX2|7020200000000XX2|7020200000000XX2|CHANGE| |1100100000000001|3100000400000XX0|3000000000000XX0|3000000000000XX0|CHANGE| |1110300000100002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1201000000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1111000000300001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1130100000100011|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |143000200010000A|3038900000000XX2|3038900000000XX2|3038900000000XX2|NO-CHANGE| |1130000000000007|3131900300000XX1|3031900000000XX1|3031900000000XX1|CHANGE| |1110100000100011|3000000000000XX0|3000000000000XX0|3000000000000XX0|NO-CHANGE| |1500000000100002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1010601000000005|3892900000000XX1|3892900000000XX1|3892900000000XX1|NO-CHANGE| |1311100000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1211000000100001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1111200000100012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1113000000000001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1140000000006006|3335900000000XX1|1335900000000XX1|3335900000000XX1|NO-CHANGE| |1010000000001000|7000000000000XX0|5000000000000XX0|7000000000000XX0|NO-CHANGE| |1110200000100000|7010700000000XX1|7010700000000XX1|7010700000000XX1|NO-CHANGE| |1111400000000010|7020700000000XX1|5020700000000XX1|7020700000000XX1|NO-CHANGE| |1111300000000002|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |113030200000000A|3038900000000XX2|3038900000000XX2|3038900000000XX2|NO-CHANGE| |1100000000000400|7000000000000XX1|7033900000000XX1|7033900000000XX1|CHANGE| |1202000000000001|3000000000000XX2|1000000000000XX2|3000000000000XX2|NO-CHANGE| |1300100000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1113300000100000|7020700000000XX2|5020700000000XX2|7020700000000XX2|NO-CHANGE| |1110100000000001|3100000400000XX0|3000000000000XX0|3000000000000XX0|CHANGE| |1211100000000012|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1511000000000027|3031900000000XX1|1031900000000XX1|3031900000000XX1|NO-CHANGE| |1130000000100007|3131900300000XX1|3031900000000XX1|3031900000000XX1|CHANGE| |0000003000000007|4899900000000XX0|4899900000000XX0|4899900000000XX0|NO-CHANGE| |1011100000000000|7100000400000XX0|5000000000000XX0|7000000000000XX0|CHANGE| |1200100000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1010001000000005|3892900000000XX0|3892900000000XX0|3892900000000XX0|NO-CHANGE| |1600600000000017|3031900000000XX2|3031900000000XX2|3031900000000XX2|NO-CHANGE| |1600002000000007|3031900000000XX1|3031900000000XX1|3031900000000XX1|NO-CHANGE| |1101100000000001|3100000400000XX0|1000000000000XX0|3000000000000XX0|CHANGE| |0000002000000000|9999900000000XX0|9099900000000XX0|9099900000000XX0|CHANGE| |1111500000100000|7020700000000XX1|5020700000000XX1|7020700000000XX1|NO-CHANGE| |1300000000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1330100000100012|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE| |1211100000000011|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1501000000000000|7020100000000XX1|5020100000000XX1|7020100000000XX1|NO-CHANGE| |1130100000300011|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE| |1131000000000007|3031900000000XX1|1031900000000XX1|3031900000000XX1|NO-CHANGE| |1000002000000600|7138900400000XX1|7038900000000XX1|7038900000000XX1|CHANGE| |160000200000000A|3038900000000XX1|3038900000000XX1|3038900000000XX1|NO-CHANGE| |1511000000300001|3000000000000XX2|1000000000000XX2|3000000000000XX2|NO-CHANGE| |1211100000000012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1102100000000001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1130000000300001|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE| |1101000000000007|3031900000000XX0|1031900000000XX0|3031900000000XX0|NO-CHANGE| |1411100000000022|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1101100000000001|3100000400000XX0|1000000000000XX0|3000000000000XX0|CHANGE| |1111300000000012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1111300000100002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1211100000000011|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1510000000000002|3100000400000XX1|3000000000000XX1|3000000000000XX1|CHANGE| |1400000000000000|7120100300000XX1|7020100000000XX1|7020100000000XX1|CHANGE| |1210100000100012|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1311100000000012|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1600100000000011|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1200000000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1101200000000002|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1110100000000001|3000000000000XX0|3000000000000XX0|3000000000000XX0|NO-CHANGE| |1401100000000002|3100000300000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1130000000000017|3031900000000XX1|3031900000000XX1|3031900000000XX1|NO-CHANGE| |1130000000300001|3000000000000XX2|3000000000000XX2|3000000000000XX2|NO-CHANGE| |1111100000100011|3000000000000XX0|1000000000000XX0|3000000000000XX0|NO-CHANGE| |1111200000100000|7110700400000XX1|5010700000000XX1|7010700000000XX1|CHANGE| |1500000000000001|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1113100000000000|7120300400000XX1|5020300000000XX1|7020300000000XX1|CHANGE| |1110100000100000|7000000000000XX0|7000000000000XX0|7000000000000XX0|NO-CHANGE| |1130000000100000|7020200000000XX1|7020200000000XX1|7020200000000XX1|NO-CHANGE| |1402000000000000|7020300000000XX2|5020300000000XX2|7020300000000XX2|NO-CHANGE| |1102100000000007|3031900000000XX1|1031900000000XX1|3031900000000XX1|NO-CHANGE| |1500500000000007|3031900000000XX2|3031900000000XX2|3031900000000XX2|NO-CHANGE| |1211100000100002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1110200000100012|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1211000000000012|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1100000000000100|7100000400000XX0|7000000000000XX0|7000000000000XX0|CHANGE| |1510000000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1113000000100000|7020300000000XX1|5020300000000XX1|7020300000000XX1|NO-CHANGE| |1200100000000002|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1111000000000017|3031900000000XX0|1031900000000XX0|3031900000000XX0|NO-CHANGE| |1130100000000001|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1110000000300001|3000000000000XX1|3000000000000XX1|3000000000000XX1|NO-CHANGE| |1002000000000001|3100000400000XX1|1000000000000XX1|3000000000000XX1|CHANGE| |1300100000000000|7010100000000XX1|7010100000000XX1|7010100000000XX1|NO-CHANGE| |1113100000100001|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE| |1001200000000002|3000000000000XX1|1000000000000XX1|3000000000000XX1|NO-CHANGE|