Both sides previous revision
Previous revision
Next revision
|
Previous revision
|
kvalobs:kvoss:system:qc2:test:algorithms:diptest [2011-04-12 21:43:44] paule |
kvalobs:kvoss:system:qc2:test:algorithms:diptest [2022-05-31 09:29:32] (current) |
Output of various tests. The latest is always posted at the top of the page. | Output of various tests. The latest is always posted at the top of the page. |
| |
* ... | {{kvalobs:kvoss:system:qc2:requirements:algorithms:dip.png|}} |
* ... | |
* ... | |
* ... | |
* Also see the application of [[https://kvalobs.wiki.met.no/doku.php?id=kvoss:system:qc2:test:algorithms:akima#using_akima_in_the_diptest_algorithm|Akima to the Diptest]] | * Also see the application of [[https://kvalobs.wiki.met.no/doku.php?id=kvoss:system:qc2:test:algorithms:akima#using_akima_in_the_diptest_algorithm|Akima to the Diptest]] |
| |
====== Simulated Test Data after Flag 9.7 Updates ====== | ====== Simulated Test Data after Flag 9.7 Updates ====== |
| |
| **Review** |
| |
| The last results of testing this algorithm are provided below (subsections labeled "Results"). These outcomes were reviewed April 27-28 at met.no. The following conclusions were reached, that may be considered as part of the overall recommendation, and related conditions, to now put the algorithm into operations. |
| |
| * The results of the DipTest with regards the flags set at the final step and the interpolation performed are in general OK but the applicability of the DipTest to all of the parameters originally proposed should be checked. |
| * For example, review of the results sets suggests that paramid=104 should not be checked and should be removed from the paramid listing. (Difficult to correctly handle the periods where the bucket is manually emptied in the time series). |
| * For some examples the flagging apears not to be correctly set prior to the DipTest (e.g. useinfo not set according to teh controlinfo), but in the end the result after the DipTest is OK. This may be a bug in a QC1 control or just because data from 2008 (rewritten here to be 2018) was used for the test. |
| |
| **Results** |
| |
The following data was taken from 2008 and then modified to create and emphasise some dips. Controlflags may also have been modified to ensure that the DipTest ran - this simulation is just to get some more DipTest results to look at, but simulating data may result in impossible flag settings etc ... so please be wary. | The following data was taken from 2008 and then modified to create and emphasise some dips. Controlflags may also have been modified to ensure that the DipTest ran - this simulation is just to get some more DipTest results to look at, but simulating data may result in impossible flag settings etc ... so please be wary. |
The main change in the flag document is: | The main change in the flag document is: |
| |
<table class="diff"> | ^Previous ^ Version 9.7 ^ |
<tr> | |useinfo(2) settes til 2 hvis fagg=3 eller %%((%%fr=4 eller fr=5) og fcombi !=1,2) eller (fcc=3, fcc=4, fcc=6, fcc=7, fcp=3, fcp=4, fcp=6, fcp=7, fs=3, fw=4, fw=5, fpos=3, fstat=2 eller fd=3) | useinfo(2) settes til 2 hvis fagg=3 eller %%((%%fr=4 eller fr=5) og fcombi !=1,2) eller (fcc=3, fcc=4, fcc=6, fcc=7, fcp=3, fcp=4, fcp=6, fcp=7, fs=3, fw=4, fw=5, fpos=3, fstat=2 eller fd=3) | |
<th colspan="2" > | | useinfo(2) settes til 1 hvis fagg=2, fr=2, fr=3, fcc=2, fcp=2, fs=2**, fs=4, fs=5**, fs=7, fw=2, fw=3, fclim=2 eller fcombi=2 | useinfo(2) settes til 1 hvis fagg=2, fr=2, fr=3, fcc=2, fcp=2, fs=2, fs=7, fw=2, fw=3, fclim=2 eller fcombi=2 | |
<a class="wikilink1" href="/doku.php?id=kvalobs:kvalobs-flagg&rev=1295869257">kvalobs:kvalobs-flagg [2011/01/24 11:40]</a><br /><span class="user">pals</span> </th> | |useinfo(2) settes til 0 hvis fagg=1, fr=1, fcc=1, fcp=1, fs=1, fw=1, fpos=1, fstat=1, fclim=1, fd=1 eller fcombi=1 | useinfo(2) settes til 0 hvis fagg=1, fr=1, fcc=1, fcp=1, fs=1**, fs=4**, fw=1, fpos=1, fstat=1, fclim=1, fd=1 eller fcombi=1. | |
<th colspan="2" > | |
<a class="wikilink1" href="/doku.php?id=kvalobs:kvalobs-flagg">kvalobs:kvalobs-flagg [2011/03/18 08:26]</a> (current)<br /><span class="user">pals</span> </th> | |
| |
</tr> | |
<tr><td class="diff-blockheader" colspan="2">Line 1:</td> | |
<td class="diff-blockheader" colspan="2">Line 1:</td></tr> | |
<tr><td>-</td><td class="diff-deletedline">======Flagg i KVALOBS (versjon 9.<strong>6</strong>)======</td><td>+</td><td class="diff-addedline">======Flagg i KVALOBS (versjon 9.<strong>7</strong>)======</td></tr> | |
<tr><td> </td><td class="diff-context"></td><td> </td><td class="diff-context"></td></tr> | |
| |
<tr><td> </td><td class="diff-context">=====Bakgrunn=====</td><td> </td><td class="diff-context">=====Bakgrunn=====</td></tr> | |
<tr><td class="diff-blockheader" colspan="2">Line 169:</td> | |
<td class="diff-blockheader" colspan="2">Line 169:</td></tr> | |
<tr><td> </td><td class="diff-context">| |fs=0|Ikke kontrollert|</td><td> </td><td class="diff-context">| |fs=0|Ikke kontrollert|</td></tr> | |
<tr><td> </td><td class="diff-context">|QC1-3|fs=1|Kontrollert. Funnet i orden|</td><td> </td><td class="diff-context">|QC1-3|fs=1|Kontrollert. Funnet i orden|</td></tr> | |
| |
<tr><td>-</td><td class="diff-deletedline">|QC1-3|fs=2|Kontrollert. Observert endring høyere enn (minste) testverdi<strong>. Ingen korreksjon</strong>| </td><td>+</td><td class="diff-addedline">|QC1-3|fs=2|Kontrollert. Observert endring høyere enn (minste) testverdi| </td></tr> | |
<tr><td>-</td><td class="diff-deletedline">|QC1-3|fs=3|Kontrollert. Ingen endring i måleverdi over x tidsskritt<strong>. Ingen korreksjon</strong>| </td><td>+</td><td class="diff-addedline">|QC1-3|fs=3|Kontrollert. Ingen endring i måleverdi over x tidsskritt| </td></tr> | |
<tr><td>-</td><td class="diff-deletedline">|QC2d-1|fs=4|Kontrollert. Mistanke om feil detektert i QC1-3<strong>. Ingen tilsvarende feil </strong>i <strong>QC2d1</strong>-1<strong>. Ingen korreksjon</strong>| </td><td>+</td><td class="diff-addedline">|QC2d-1|fs=4|Kontrollert. Mistanke om feil detektert i QC1-3<strong>, mistanken opphevet av dipptest </strong>i <strong>QC2d</strong>-1| </td></tr> | |
| |
<tr><td>-</td><td class="diff-deletedline">|<strong>QC2d-1</strong>|fs=5|<strong>Kontrollert. Ingen mistanke om feil detektert i QC1-3. Mistanke om feil detektert i QC2d-1. Ingen korreksjon</strong>|</td><td>+</td><td class="diff-addedline">| |fs=5|<strong>< reservert ></strong>|</td></tr> | |
<tr><td> </td><td class="diff-context">| |fs=6|< reservert >|</td><td> </td><td class="diff-context">| |fs=6|< reservert >|</td></tr> | |
| |
<tr><td>-</td><td class="diff-deletedline">| |fs=7|Kontrollert. Observert drift i instrumentet<strong>. Ingen korreksjon</strong>| </td><td>+</td><td class="diff-addedline">| |fs=7|Kontrollert. Observert drift i instrumentet| </td></tr> | |
<tr><td>-</td><td class="diff-deletedline">|QC1-3|**fs=8**|**<strong>Kontrollert. </strong>Observert endring høyere enn høyeste testverdi. Forkastet**| </td><td>+</td><td class="diff-addedline">|QC1-3|**fs=8**|**Observert endring høyere enn høyeste testverdi. Forkastet**| </td></tr> | |
<tr><td>-</td><td class="diff-deletedline">|QC2d-1|**fs=9**|**<strong>Kontrollert. </strong>Observert endring høyere enn testverdi. Korrigert automatisk**| </td><td>+</td><td class="diff-addedline">|QC2d-1|**fs=9**|**Observert endring høyere enn testverdi. Korrigert automatisk**| </td></tr> | |
| |
<tr><td>-</td><td class="diff-deletedline">|QC2d-1|**fs=A**|**<strong>Kontrollert. </strong>Ingen endring i måleverdi over x tidsskritt. Korrigert automatisk**|</td><td>+</td><td class="diff-addedline">|QC2d-1|**fs=A**|**Ingen endring i måleverdi over x tidsskritt. Korrigert automatisk**|</td></tr> | |
<tr><td> </td><td class="diff-context"></td><td> </td><td class="diff-context"></td></tr> | |
<tr><td> </td><td class="diff-context"></td><td> </td><td class="diff-context"></td></tr> | |
<tr><td class="diff-blockheader" colspan="2">Line 462:</td> | |
<td class="diff-blockheader" colspan="2">Line 462:</td></tr> | |
| |
<tr><td> </td><td class="diff-context">useinfo(2) settes til 2 hvis\\ fagg=3 eller %%((%%fr=4 eller fr=5) og fcombi !=1,2) eller (fcc=3, fcc=4, fcc=6, fcc=7, fcp=3, fcp=4, fcp=6, fcp=7, fs=3, fw=4, fw=5, fpos=3, fstat=2 eller fd=3).</td><td> </td><td class="diff-context">useinfo(2) settes til 2 hvis\\ fagg=3 eller %%((%%fr=4 eller fr=5) og fcombi !=1,2) eller (fcc=3, fcc=4, fcc=6, fcc=7, fcp=3, fcp=4, fcp=6, fcp=7, fs=3, fw=4, fw=5, fpos=3, fstat=2 eller fd=3).</td></tr> | |
<tr><td> </td><td class="diff-context"></td><td> </td><td class="diff-context"></td></tr> | |
<tr><td>-</td><td class="diff-deletedline">useinfo(2) settes til 1 hvis\\ fagg=2, fr=2, fr=3, fcc=2, fcp=2, fs=2<strong>, fs=4, fs=5</strong>, fs=7, fw=2, fw=3, fclim=2 eller fcombi=2.</td><td>+</td><td class="diff-addedline">useinfo(2) settes til 1 hvis\\ fagg=2, fr=2, fr=3, fcc=2, fcp=2, fs=2, fs=7, fw=2, fw=3, fclim=2 eller fcombi=2.</td></tr> | |
| |
<tr><td> </td><td class="diff-context"></td><td> </td><td class="diff-context"></td></tr> | exact diff here: https://kvalobs.wiki.met.no/doku.php?id=kvalobs:kvalobs-flagg&rev=1295869257&do=diff |
<tr><td>-</td><td class="diff-deletedline">useinfo(2) settes til 0 hvis\\ fagg=1, fr=1, fcc=1, fcp=1, fs=1, fw=1, fpos=1, fstat=1, fclim=1, fd=1 eller fcombi=1.</td><td>+</td><td class="diff-addedline">useinfo(2) settes til 0 hvis\\ fagg=1, fr=1, fcc=1, fcp=1, fs=1<strong>, fs=4</strong>, fw=1, fpos=1, fstat=1, fclim=1, fd=1 eller fcombi=1.</td></tr> | |
<tr><td> </td><td class="diff-context"></td><td> </td><td class="diff-context"></td></tr> | |
<tr><td> </td><td class="diff-context">Ellers settes useinfo(2) til initialverdien 9.</td><td> </td><td class="diff-context">Ellers settes useinfo(2) til initialverdien 9.</td></tr> | |
| |
<tr><td class="diff-blockheader" colspan="2">Line 722:</td> | https://kvalobs.wiki.met.no/doku.php?do=revisions&id=kvalobs%3Akvalobs-flagg |
<td class="diff-blockheader" colspan="2">Line 722:</td></tr> | |
<tr><td> </td><td class="diff-context">Versjon 9.6: Ny betydning av fpre=7 (som tidligere ikke var i praktisk bruk, settes nå av dekoder)</td><td> </td><td class="diff-context">Versjon 9.6: Ny betydning av fpre=7 (som tidligere ikke var i praktisk bruk, settes nå av dekoder)</td></tr> | |
<tr><td> </td><td class="diff-context"></td><td> </td><td class="diff-context"></td></tr> | |
<tr><td>-</td><td class="diff-deletedline">Sist oppdatert av Pål Sannes <strong>24</strong>. <strong>januar </strong>2011</td><td>+</td><td class="diff-addedline"><strong>Versjon 9.7: Ny betydning av fs=4 og fs=5 (sistnevnte er nå reservert verdi). Konsekvens for setting av useinfo(2) </strong></td></tr> | |
| |
<tr><td colspan="2"> </td><td>+</td><td class="diff-addedline"><strong> </strong></td></tr> | The example below illustrates useinfo(2) being reset to 0 when fs is set to 4. |
<tr><td colspan="2"> </td><td>+</td><td class="diff-addedline">Sist oppdatert av Pål Sannes <strong>18</strong>. <strong>mars </strong>2011</td></tr> | |
</table> | |
| |
<code> | <code> |