Differences

This shows you the differences between two versions of the page.

--- kvalobs:kvoss:system:qc2:flag:analysis [2010-01-17 17:46:49]
paule
+++ kvalobs:kvoss:system:qc2:flag:analysis [2022-05-31 09:29:32] (current)
@@ Line 3: / Line 3: @@
 Note: a number of Qc2 useinfo changes are coded in lib/kvalobs/kvDataFlag.cc but are all commented out and inactive. For development and reflectedin the examples provided below, the Qc2 items are all turned on. Please see [[#Turn on Qc2 in useinfo?|below]] for details.
-===== Exisiting Specification =====
+===== Existing Specification =====
 A general guide to setting values in Qc2 Control Flags is described in the following set of slides from Lars. The current algorithms and proposals for new algorithms are based on this:
@@ Line 9: / Line 9: @@
   * [[https://kvalobs.wiki.met.no/lib/exe/fetch.php?id=kvoss%3Asystem%3Aqc2%3Arequirements&cache=cache&media=kvoss:system:qc2:flags_in_qc2.ppt|Flags in Qc2]]
-==== Redistirbution of Accumulated Values ====
+==== Redistribution of Accumulated Values ====
 ^Controlflag Setting: |fd=7    |
@@ Line 79: / Line 79: @@
   * ftime is not yet included in the requirements for useinfo(3). This needs to be done
-  * In this particular example fhqc=7 "Korrigert manuelt" which must is a bug, since original value is missing (fhqc=5: "Interpolert manuelt" might have been an appropriate setting). So the misleading value useinfo(3)=1: "Original verdi er manuelt korrigert" is because of this mistake in fhqc.
+  * In this particular example fhqc=7 "Korrigert manuelt" which must be a bug, since original value is missing (fhqc=5: "Interpolert manuelt" might have been an appropriate setting). So the misleading value useinfo(3)=1: "Original verdi er manuelt korrigert" is because of this mistake in fhqc.
   * Currently for the operational configuration the condition set is "DO NOT OVERWRITE A VALUE ALREADY CORRECTED BY HQC". For development/testing this condition is sometimes relaxed.
@@ Line 86: / Line 86: @@
   * Reasons for "no" include: that elsewhere setting up the criteria for useinfo(3) will be that much harder - it is no longer enough to check controlinfo, we also need to know which control was performed last (we would have useino(3) = 4 or 2 depending on HQC was performed before or after QC2).
+  * Reasons for "yes": QC2 is objective and may be preferred to the subjective HQC, to get uniform results. At least some of the algorithms could be set up to overwrite the HQC results. Redistribution of accumulated precipitation is one of the candidates - at least for "old" data in Histkvalobs.
 **Scheduling**
@@ Line 114: / Line 116: @@
 fnum [0-6] are set by [[https://kvalobs.wiki.met.no/doku.php?id=kvalobs:qc14|Qc1-4]] based on comparison with numerical model values. Qc1-4 will run before the Qc2-SpaceCheck.
-Open issues:
+**Open issues:**
   - Once the SpaceCheck algorithm is validated and demonstrated to be effective shall the SpaceCheck result always take precedence over Qc1-4?
   - Is there need to preserve the results of both Qc1-4 and Qc2-SpaceCheck
   - Do we need to include logic to compare the results of Qc1-4 and Qc2-SpaceCheck before making final flag settings?
+==== Assessment of Variability ====
+Another type of Space Check is to determine the variabilty in the nearest neighbour field. If the variability is high then spatial algorithms are either not applied or the confidence parameters are lowered to mark any given result or check (e.g. use ftime=2 rather than ftime=1).
+==== Comparison with other fields ====
+Future Qc2 checks will involve comparison with radar, satellite data etc. How will this eventuality be flagged? For weather analysis fw is available (although possibly now proposed for other uses as well) and for climatological controls (e.g. comparison with expected monthly statistics) fclim is available.
 ==== Correction generated by Time (and/or Space) Interpolation ====
@@ Line 128: / Line 138: @@
 General assumption is that only actually replace a missing value (be it a single point or a set of points) if there is good confidence in the corrected estimates, e.g. the time interpolation and spatial interpolation agree.
+ftime=2 and ftime=3 are also available for use as defined in the kvalobs original specification.
-==== Temporal Discontinuity Check / Dip Tests and Similar ====
+==== Outlier detection ====
-:!: FIXME more to come FIXME :!:
+The Space Check and Time Interpolation methods may also identify outliers, e.g. Dip test. The existing specification for controlinfo(3), fs can capture such events from Qc2 checks.
+==== Other Algorithms ====
+TBD
 ==== General use of fw to log Qc2 corrections ====
@@ Line 222: / Line 237: @@
 </code>
+===== Some empirical tests =====
+Generate a sample Qc2 controlinfo value and observe what codes the above generates for useinfo. (Please suggest additional test cases)
+^Qc2 Flag or Specific Algorithm ^Controlinfo ^Resulting useinfo ^
+|RR24 Redistribution |[1000001000007000] |[5896900000000000]|
+|RR24 Redistribution |[1140001000007000] |[5896900000000001]|
+|ftime from TAN TAX interpolation |[1000600100000000] |[5033700000000001]|
+|ftime |[1000600200000000] |[5033700000000001]|
+|ftime |[1000600300000000] |[5033700000000001]|
+|fnum |[1100700000000000] |[7000000000000001]|
+|fnum |[1100800000000000] |[7000000000000001]|
+|fnum |[1100900000000000] |[7000000000000001]|
+|fnum |[1100A00000000000] |[7000000000000001]|
+|fclim |[1111000000010000] |[5000000000000000]|
+|fclim |[1111000000020000] |[5010500000000001]|
+|fclim |[1111000000030000] |[5033500000000001]|
+|fw |[1111000010000000] |[5000000000000000]|
+|fw |[1111000020000000] |[5010500000000001]|
+|fw |[1111000030000000] |[5033500000000001]|
+|fw |[1111000040000000] |[5000000000000001]|
+|fw |[1111000050000000] |[5000000000000001]|
+|fw |[1111000080000000] |[5000000000000001]|
+|control (no Qc2) |[1111000000000000] |[5000000000000000]|
+|control (no Qc2) |[1111000000000000] |[5000000000000000]|
+|control (no Qc2) |[1000001000000000] |[9899900000000000]|
+Furthermore, here is an example of [[kvoss::system::qc2::flag::regression|Qc1 Regression tests]].
@@ Line 228: / Line 270: @@
 ===== Open Issues =====
-  - Shall src/lib/kvalobs/Qc2_kvDataFlag.cc be updated to include the Qc2 elements. This is part of the standard Qc1 software and this change would therefore require regression testing. Who is reposnsible for this decision and to carry out the Qc1 regression testing?
+  - Shall src/lib/kvalobs/Qc2_kvDataFlag.cc be updated to include the Qc2 elements. This is part of the standard Qc1 software and this change would therefore require regression testing. Who is reposnsible for this decision and to carry out the Qc1 regression testing? (//may be these results of some preliminary [[kvoss:system:qc2:flag:regression|regression tests]] are sufficient?// :-) Please comment! :-)
   - Use fw to record general information on Qc2 controls or keep reserved for weather analysis? See Slide 3 of  [[https://kvalobs.wiki.met.no/lib/exe/fetch.php?id=kvoss%3Asystem%3Aqc2%3Arequirements&cache=cache&media=kvoss:system:qc2:flags_in_qc2.ppt| Flags in Qc2]].
+  - Given this overview of Qc2 control flagging is the specification for the corresponding useinfo in place ... what still needs to be done?
-N.B. [[https://kvalobs.wiki.met.no/doku.php?id=kvalobs:kvalobs-flagg#kontrollflaggene|controlflags]]