Differences

This shows you the differences between two versions of the page.

--- kvalobs:kvoss:system:qc2:requirements:algorithms:diptest03 [2011-04-16 15:33:24]
paule
+++ kvalobs:kvoss:system:qc2:requirements:algorithms:diptest03 [2022-05-31 09:29:32] (current)
@@ Line 1: / Line 1: @@
-====== Dip test - QC2d-1 - Revision 03 (Final Version ???)======
+====== QC2d-1: Dip test ======
-{{:kvoss:system:qc2:requirements:algorithms:dip.png|}}
+{{kvalobs:kvoss:system:qc2:requirements:algorithms:dip.png|}}
    * fs=2 for A(t),
@@ Line 7: / Line 7: @@
    * fs=1 for A(t-2)
-<code>
+A dip is detected if <m>|A(t)-A(t-2)| < |A(t-1)-A(t-2)|</m> and <m>|A(t)-A(t-2)| < delta</m>
- If
+where <m>delta</m> is specified in the algorithm configuration.
-    | A(t) - A(t-2) | < | A(t-1) - A(t-2) |
+<m>A(t-1)</m> then receives a corrected value by interpolation.
- and
-    | A(t) - A(t-2) | < DELTA
-</code>
-where DELTA is dependent on the parameter
+The neighboring points at t-2 and t may not have missing original values and have
+to match the flags specified in **linear_before_*flags** and **linear_after_*flags**,
+respectively.
-<code>
+If there are 2 additional usable data points before and 1 usable additional data point after t-1,
-   set fs=9 for A(t-1)
+[[Akima splines]] are used for the interpolation and cfailed receives a message
-   set fs=6 for A(t)
+**QC2d-1-A**. To be usable, the original value may not be missing (-32767) and has
-</code>
+to match the flag specification **akima_*flags** in the configuration if it is not
+an immediate neighbor of t-1, and .
-A(t-1) receives a corrected value by interpolation. The interpolation method can be linear or by [[Akima splines]].
+If akima interpolation is not possible, linear interpolation is used and cfailed receives
+a message **QC2d-1-L**.
+==== Configuration ====
-====== Strategy ======
+Beyond the standard configuration options detailed in the [[kvoss:system:qc2:user|user guide]],
+the following options are available for DipTest.
+  * candidate_cflags (default: fs=2&fhqc=0) and candidate_uflags (default: /no constraint/) specify the flags expected for A(t-1). Dips that do not match these flags will not be detected.
+  * akima_cflags (default: /no constraint/) and akima_uflags (default: U2=0) specify the requirements for additional points for akima interpolation
+  * linear_before_cflags (default: fs=1) and linear_before_uflags (default: /no constraint/) specify flag requirements for A(t-2)
+  * linear_after_cflags (default: fs=2&fhqc=0) and linear_after_uflags (default: /no constraint/) specify flag requirements for A(t)
+  * dip_flagchange (default: fs=9) specifies the flag modification for t-1 if an interpolation is performed
+  * afterdip_flagchange (default: fs=4) specifies the flag modification for t if an interpolation is performed
+  * ParValFilename specifies either (no default, must be specified, see below for examples)
+    * a filename containing a list of parameter-delta pairs
+    * or a list of parameter-value pairs when starting with **list:**
+=== ParValFilename ===
-====== Parameters ======
+If using a file to specify parameter-delta pairs, the file must be formatted like this:
+   9.0
+   60.0
+  10.0
+  10.0
+  12.5
-Relevant parameters are all those subject to the step check (QC1-3a):
+If using a list to specify parameter-delta pairs, the parameter must be given like this:
-^ paramid ^ parameter ^ δ(X) ^
+  ParValFilename= list: 172 12.0, 174 12.0, 175 12.0, 176 12.0, 177 12.0, 211 7.5
-|  **1**   | AA |  |
-|  **2**   | BI|  |
-|  **81**  | FF| 10 or 12,5  m/s TBC |
-|  **85**  | FM|  |
-|  **86**  | FX|  |
-|  **87**  | FX_1|  |
-|  **88**  | FX_6|  |
-|  **89**  | FX_12|  |
-|  **90**  | FG_1|  |
-|  **91**  | FG_6|  |
-|  **92**  | FG_12|  |
-|  **93**  | FX_X|  |
-|  **94**  | FG_X|  |
-|  **104**  | RA|  |
-|  **105**  | RR_01|  |
-|  **113**  | SS_1|  |
-|  **123**  | RT_1|  |
-|  **172**  | PH|  |
-|  **174**  | POM|  |
-|  **175**  | PON|  |
-|  **176**  | POX|  |
-|  **177**  | PP|  |
-|  **197**  | QE|  |
-|  **198**  | QL|  |
-|  **199**  | QLX|  |
-|  **200**  | QO|  |
-|  **201**  | QOX|  |
-|  **211**  | TA| 7,5 °C TBC|
-|  **212**  | TAM|  |
-|  **213**  | TAN|  |
-|  **215**  | TAX|  |
-|  **221**  | TG|  |
-|  **222**  | TGM|  |
-|  **223**  | TGN|  |
-|  **225**  | TGX|  |
-|  **227**  | TJM|  |
-|  **262**  | UU| 30% TBC|
-|  **264**  | UN|  |
-|  **265**  | UX|  |
-===== Dip test flags =====
+==== Parameters ====
-|Flag value|Definition|useinfo(2) consequence|
-|**fs=4**|Kontrollert. Mistanke om feil detektert i QC1-3. Ingen tilsvarende feil i QC2d-1. Ingen korreksjon.|**Friskmeldt.**|
-|fs=5|Kontrollert. Ingen mistanke om feil detektert i QC1-3. Mistanke om feil detektert i QC2d-1.Ingen korreksjon.|Originalverdi noe mistenkelig.|
-|**fs=9**|Kontrollert. Observert endring høyere enn testverdi. Korrigert automatisk.|**Originalverdi sikkert feilaktig.**|
-===== Previous met.no dip tests =====
+Relevant parameters are all those subject to the step check (QC1-3a). The implementation is only tested for hourly measurements.
+==== Previous met.no dip tests ====
 The report 24/93 KLIMA "Theoretical analysis of the dip-test in quality control of geophysical observations" by Petter Øgland describes a diptest run independent from a previous step test.
@@ Line 88: / Line 65: @@
    δ(UU) = 30%  versus the Kvalobs step(UU) = 30%
    δ(FF) = 30 m/s versus the Kvalobs step(FF) = 10 or 12.5 m/s
-   δ(TA) = 10.5 °C versus the Kvalobs step(TA) = 7,5 °C
+   δ(TA) = 10.5 °C versus the Kvalobs step(TA) = 7.5 °C
+For wind and temperature the Kvalobs dip test will flag more often than Øgland's formula. For humidity Øgland's formula will flag for errors without corresponding flag from the Kvalobs dip test. This occurs in a "skew" dip when the step test criterion is met in one of the two cases.
-For wind and temperature the Kvalobs dip test will flag more often than by Øgland's formula. For humidity will Øgland's formula gives error flags without corresponding flag from the Kvalobs dip test. This occurs in a "skew" dip when the step test criterion is met in one of the two cases.