Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
kvalobs:kvalobs:qc11 [2020-01-30 13:29:40]
terjeer [Grenseverdier for RANGE_CHECK: Grenseverdier ( terskelverdier ) for QC1-1 - grenseverdisjekk (v.1.4)]
— (current)
Line 1: Line 1:
- 
-====== QC1-1 ====== 
-  
- 
- 
-===== General description ===== 
-  
- 
-The KVALOBS range control applies climatological test values, i.e. each station is attributed a set of values with upper and lower limits for each month. 
- 
-Every station has a set of range limit values comprising six values for each month. The values are:  
- 
-  *Upper physical limit value  
-  *Highest test threshold value  
-  *High test threshold value  
-  *Low test threshold value  
-  *Lowest test threshold value  
-  *Lower physical limit value  
-There are two kinds of observation. One is the physical parameters like for example wind speed measured in m/s. The other is code parameters, for example total cloudiness with valid integer values between 0 and 9. The climatological threshold values for the code parameters will be identical to upper and lower limit on valid codes.\\  The physical parameters will have their range limit values set in the following manner:\\  The upper and lower physical limit value will be identical to the limit values inherited from the current control system applied to messages from automatic stations.\\  The highest and lowest test threshold value is initially set to the highest and lowest value measured during the latest 10 years period. The high test threshold value is set equal to the highest test threshold value minus 10 per cent of the difference between the highest and lowest test threshold value. The low test threshold value is set equal to the lowest test threshold value plus 10 per cent of the difference between the highest and lowest test threshold value.\\   
- 
-**The exception from these rules are the parameter groups: temperature, air pressure and wind speed, and relative humidity and wind direction with fixed limit values, 0 - 100% and 0 - 360 degrees respectively for the two latest parameters (see below).** 
- 
-The range limit values are stored in the Kvalobs SVN archive. Because the physical limits are the same for all stations and months, these limit values are stored in a separate file with parameterid and associated limit values only. The other limit values are tabulated with seven columns as shown below. The detailed file contains column headers and rows as exemplified below:  
- 
-|Stationid|parameterid|month|highest|high|lowest|low| 
-|18700|173|1|1032.6|1023.4|940.2|949.4| 
- 
-The input to the Kvalobs database is a table with the same structure as the above. The table contains limit values for all stations (except automatic stations) in operation during the last 10 years. In total there is 914 stations. Only the physical parameters at each station is included in the table. The table then consists of some 100 000 rows. 
- 
-New stations established reasonably close to an exisiting one will have applied the same limit values as the existing station. In other cases interpolation of limit values from near by stations will be used. The interpolation will be relatively simple taking into account the distance to existing stations and eventually the difference in elevation. When there is no existing station sufficiently close model data and for marine stations Hindcast data will be applied. The latter also applies to stations which are not included in the calculation described above because of deficient quality control as for example automatic stations. 
- 
-== Equipment specific control configuration == 
- 
-  * [[QC1-1 on AWS snow depth]] 
- 
-  * [[QC1-1 on Geonor bucket content]] 
- 
-== Detailed QC1-1 rational == 
- 
-  * {{http://metklim.met.no/_media/klima/homog/spec/spes_qc1-1_v14_wiki.doc|QC1-1 on temperature, air pressure and wind speed (rødmerket tekst viser siste endringer i dokumentet). Se ev hele dokumentet nedenfor.}} 
- 
-  * [[QC1-1 on relative humidity]] 
- 
- 
-====== station_param & checks ====== 
- 
-==== station_param ==== 
-<code> 
-kvalobs=# select count(*) from station_param where qcx ~ 'QC1-1' and stationid=0; 
- count  
-------- 
-   361 
-(1 row) 
- 
-kvalobs=# select count(*) from station_param where qcx ~ 'QC1-1' and stationid<>0; 
- count   
--------- 
- 565522 
-(1 row) 
- 
-select count(*) from station_param where qcx ~ 'QC1-1'; 
-count   
--------- 
- 565883 
-(1 row) 
-</code> 
- 
-==== checks ==== 
-<code> 
-kvalobs=# select count(*) from checks where qcx ~ 'QC1-1' and stationid=0; 
- count  
-------- 
-   358 
-(1 row) 
- 
-kvalobs=# select count(*) from checks where qcx ~ 'QC1-1' and stationid<>0; 
- count  
-------- 
-     0 
-(1 row) 
- 
-kvalobs=> select distinct checkname from checks where qcx ~ 'QC1-1' and NOT checkname='RANGE_CHECK' order by checkname; 
-         checkname          
---------------------------- 
- humidity_range 
- logger_t 
- qsi_range 
- Range-Check-110-Adapt-Acc 
- range_check_direction 
- Range-Check-EE-Codevalues 
- range_clock 
-(7 rows) 
- 
-kvalobs=> select paramid,count(distinct qcx) from station_param where qcx in (select qcx from checks where qcx ~ 'QC1-1') group by paramid having count(distinct qcx)>1; 
- paramid | count  
----------+------- 
-(0 rows) 
- 
-</code> 
- 
-==== Result ==== 
-From the last select above: There does not exist parameters with more than one qcx 
-  
-& 
- 
-2 different algorithms can not have the same qcx, that is different qcx implies different algorithms  
- 
-=> There does not exist parameters with more than one algorithm. 
- 
-===== RANGE_CHECK is the main algorithm ===== 
-== Source code: == 
-https://gitlab.met.no/obs/kvalobs/kvoss_intern/blob/master/kvmeta/algorithms/RANGE_CHECK.pl 
- 
-== Flag document: == 
-https://wiki.met.no/kvalobs/kvalobs/kvalobs-flagg#grenseverdikontroll_range 
- 
- 
- 
-===== The other algorithms with metadata===== 
-  ./kvmeta_analysis.sh "select distinct checkname from checks where qcx ~ 'QC1-1' and checkname <> 'RANGE_CHECK' order by checkname" 
-   
-All the metadata including the algorithms are under https://gitlab.met.no/obs/kvalobs/kvoss_intern/tree/master/kvmeta 
-or under the directory $METADIR on a computer. 
- 
-The script kvmeta_analysis.sh is found here: https://gitlab.met.no/obs/kvalobs/kvoss_intern/blob/master/kvmeta_analysis/kvmeta_analysis.sh 
- 
-==== humidity_range ==== 
-algorithms/humidity_range.pl 
-== QC1-1-263h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-263h_checks.pl 
-station_param/station_param_manual/QC1_rest/263h_station_param.pl 
-</code> 
- 
-== QC1-1-262h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-262h_checks.pl 
-station_param/station_param_manual/QC1_rest/262h_station_param.pl 
-</code> 
- 
-== QC1-1-264h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-264h_checks.pl 
-station_param/station_param_manual/QC1_rest/264h_station_param.pl 
-</code> 
- 
-== QC1-1-265h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-265h_checks.pl 
-station_param/station_param_manual/QC1_rest/265h_station_param.pl 
-</code> 
- 
-==== logger_t ==== 
-algorithms/logger_t.pl 
-== QC1-1-1x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-1x_checks.pl 
-station_param/station_param_manual/QC1_rest/1x_station_param.pl 
-</code> 
- 
-== QC1-1-106x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-106x_checks.pl 
-station_param/station_param_manual/QC1_rest/106x_station_param.pl 
-</code> 
- 
-== QC1-1-61x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-61x_checks.pl 
-station_param/station_param_manual/QC1_rest/61x_station_param.pl 
-station_param/station_param_manual/QC1_rest/61x_s1_station_param.pl 
-</code> 
- 
-== QC1-1-81x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-81x_checks.pl 
-station_param/station_param_manual/QC1_rest/81x_s1_station_param.pl 
-station_param/station_param_manual/QC1_rest/81x_station_param.pl 
-</code> 
- 
-== QC1-1-112x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-112x_checks.pl 
-station_param/station_param_manual/QC1_rest/112x_station_param.pl 
-</code> 
- 
-== QC1-1-81x_s1 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-81x_s1_checks.pl 
-station_param/station_param_manual/QC1_rest/81x_s1_station_param.pl 
-</code> 
- 
-== QC1-1-15x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-15x_checks.pl 
-station_param/station_param_manual/QC1_rest/15x_station_param.pl 
-</code> 
- 
-== QC1-1-175x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-175x_checks.pl 
-station_param/station_param_manual/QC1_rest/175x_station_param.pl 
-</code> 
- 
-== QC1-1-213x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-213x_checks.pl 
-station_param/station_param_manual/QC1_rest/213x_s1_station_param.pl 
-station_param/station_param_manual/QC1_rest/213x_station_param.pl 
-</code> 
- 
-== QC1-1-211x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-211x_checks.pl 
-station_param/station_param_manual/QC1_rest/211x_station_param.pl 
-station_param/station_param_manual/QC1_rest/211x_s1_station_param.pl 
-</code> 
- 
-== QC1-1-176x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-176x_checks.pl 
-station_param/station_param_manual/QC1_rest/176x_station_param.pl 
-</code> 
- 
-== QC1-1-107x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-107x_checks.pl 
-station_param/station_param_manual/QC1_rest/107x_station_param.pl 
-</code> 
- 
-== QC1-1-73x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-73x_checks.pl 
-station_param/station_param_manual/QC1_rest/73x_station_param.pl 
-</code> 
- 
-== QC1-1-56x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-56x_checks.pl 
-station_param/station_param_manual/QC1_rest/56x_station_param.pl 
-</code> 
- 
-== QC1-1-110x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-110x_checks.pl 
-station_param/station_param_manual/QC1_rest/110x_station_param.pl 
-</code> 
- 
-== QC1-1-217x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-217x_checks.pl 
-station_param/station_param_manual/QC1_rest/217x_station_param.pl 
-</code> 
- 
-== QC1-1-49x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-49x_checks.pl 
-station_param/station_param_manual/QC1_rest/49x_station_param.pl 
-</code> 
- 
-== QC1-1-84x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-84x_checks.pl 
-station_param/station_param_manual/QC1_rest/84x_station_param.pl 
-</code> 
- 
-== QC1-1-109x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-109x_checks.pl 
-station_param/station_param_manual/QC1_rest/109x_station_param.pl 
-</code> 
- 
-== QC1-1-172x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-172x_checks.pl 
-station_param/station_param_manual/QC1_rest/172x_station_param.pl 
-</code> 
- 
-== QC1-1-61x_s1 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-61x_s1_checks.pl 
-station_param/station_param_manual/QC1_rest/61x_s1_station_param.pl 
-</code> 
- 
-== QC1-1-211x_s1 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-211x_s1_checks.pl 
-station_param/station_param_manual/QC1_rest/211x_s1_station_param.pl 
-</code> 
- 
-== QC1-1-215x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-215x_checks.pl 
-station_param/station_param_manual/QC1_rest/215x_station_param.pl 
-</code> 
- 
-== QC1-1-87x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-87x_checks.pl 
-station_param/station_param_manual/QC1_rest/87x_station_param.pl 
-</code> 
- 
-== QC1-1-271x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-271x_checks.pl 
-station_param/station_param_manual/QC1_rest/271x_station_param.pl 
-</code> 
- 
-== QC1-1-214x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-214x_checks.pl 
-station_param/station_param_manual/QC1_rest/214x_station_param.pl 
-</code> 
- 
-== QC1-1-173x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-173x_checks.pl 
-station_param/station_param_manual/QC1_rest/173x_station_param.pl 
-</code> 
- 
-== QC1-1-216x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-216x_checks.pl 
-station_param/station_param_manual/QC1_rest/216x_station_param.pl 
-</code> 
- 
-== QC1-1-90x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-90x_checks.pl 
-station_param/station_param_manual/QC1_rest/90x_station_param.pl 
-</code> 
- 
-== QC1-1-262x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-262x_checks.pl 
-station_param/station_param_manual/QC1_rest/262x_station_param.pl 
-</code> 
- 
-== QC1-1-178x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-178x_checks.pl 
-station_param/station_param_manual/QC1_rest/178x_station_param.pl 
-</code> 
- 
-== QC1-1-104x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-104x_checks.pl 
-station_param/station_param_manual/QC1_rest/104x_station_param.pl 
-</code> 
- 
-== QC1-1-213x_s1 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-213x_s1_checks.pl 
-station_param/station_param_manual/QC1_rest/213x_s1_station_param.pl 
-</code> 
- 
-== QC1-1-123x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-123x_checks.pl 
-station_param/station_param_manual/QC1_rest/123x_station_param.pl 
-</code> 
- 
-== QC1-1-108x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-108x_checks.pl 
-station_param/station_param_manual/QC1_rest/108x_station_param.pl 
-</code> 
- 
-== QC1-1-177x == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-177x_checks.pl 
-station_param/station_param_manual/QC1_rest/177x_station_param.pl 
-</code> 
- 
-==== qsi_range ==== 
-algorithms/qsi_range.pl 
-== QC1-1-208h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-208h_checks.pl 
-station_param/station_param_manual/QC1_rest/208h_station_param.pl 
-</code> 
- 
-== QC1-1-2074h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-2074h_checks.pl 
-station_param/station_param_manual/QC1_rest/2074h_station_param.pl 
-</code> 
- 
-== QC1-1-2070h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-2070h_checks.pl 
-station_param/station_param_manual/QC1_rest/2070h_station_param.pl 
-</code> 
- 
-== QC1-1-2071h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-2071h_checks.pl 
-station_param/station_param_manual/QC1_rest/2071h_station_param.pl 
-</code> 
- 
-== QC1-1-2073h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-2073h_checks.pl 
-station_param/station_param_manual/QC1_rest/2073h_station_param.pl 
-</code> 
- 
-== QC1-1-2072h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-2072h_checks.pl 
-station_param/station_param_manual/QC1_rest/2072h_station_param.pl 
-</code> 
- 
-== QC1-1-2075h == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-2075h_checks.pl 
-station_param/station_param_manual/QC1_rest/2075h_station_param.pl 
-</code> 
- 
-==== Range-Check-110-Adapt-Acc ==== 
-algorithms/Range-Check-110-Adapt-Acc.pl 
-== QC1-1-110b == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-110b_checks 
-station_param/station_param_manual/QC1_rest/110b_station_param 
-</code> 
- 
-== QC1-1-110a == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-110a_checks 
-station_param/station_param_manual/QC1_rest/110a_station_param 
-</code> 
- 
-== QC1-1-110c == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-110c_checks 
-station_param/station_param_manual/QC1_rest/110c_station_param 
-</code> 
- 
-==== range_check_direction ==== 
-algorithms/range_check_direction.pl 
-== QC1-1-64 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-64_checks 
-station_param/station_param_manual/QC1_rest/64_station_param 
-</code> 
- 
-== QC1-1-73 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-73_checks 
-station_param/station_param_manual/QC1_rest/73x_station_param.pl 
-station_param/station_param_manual/QC1_rest/73_station_param 
-</code> 
- 
-== QC1-1-75 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-75_checks 
-station_param/station_param_manual/QC1_rest/75_station_param 
-</code> 
- 
-== QC1-1-77 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-77_checks 
-station_param/station_param_manual/QC1_rest/77_station_param 
-</code> 
- 
-== QC1-1-63 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-63_checks 
-station_param/station_param_manual/QC1_rest/63_station_param 
-</code> 
- 
-== QC1-1-79 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-79_checks 
-station_param/station_param_manual/QC1_rest/79_station_param 
-</code> 
- 
-== QC1-1-76 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-76_checks 
-station_param/station_param_manual/QC1_rest/76_station_param 
-</code> 
- 
-== QC1-1-78 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-78_checks 
-station_param/station_param_manual/QC1_rest/78_station_param 
-</code> 
- 
-== QC1-1-61 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-61_checks 
-station_param/station_param_manual/QC1_rest/61x_station_param.pl 
-station_param/station_param_manual/QC1_rest/61x_s1_station_param.pl 
-station_param/station_param_manual/QC1_rest/61_station_param 
-</code> 
- 
-== QC1-1-62 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-62_checks 
-station_param/station_param_manual/QC1_rest/62_station_param 
-</code> 
- 
-== QC1-1-67 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-67_checks 
-station_param/station_param_manual/QC1_rest/67_station_param 
-</code> 
- 
-== QC1-1-80 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-80_checks 
-station_param/station_param_manual/QC1_rest/80_station_param 
-</code> 
- 
-== QC1-1-74 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-74_checks 
-station_param/station_param_manual/QC1_rest/74_station_param 
-</code> 
- 
-==== Range-Check-EE-Codevalues ==== 
-algorithms/Range-Check-EE-Codevalues.pl 
-== QC1-1-129a == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-129a_checks 
-station_param/station_param_manual/QC1_rest/129a_station_param 
-</code> 
- 
-==== range_clock ==== 
-algorithms/range_clock.pl 
-== QC1-1-1028 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-1028_checks.pl 
-</code> 
- 
-== QC1-1-1027 == 
-<code> 
-checks/checks_manual/QC1_rest/QC1-1-1027_checks.pl 
-</code> 
- 
- 
-===== Flag document: ===== 
-https://wiki.met.no/kvalobs/kvalobs/kvalobs-flagg#grenseverdikontroll_range 
- 
-===== Grenseverdikontrollen før metakvalobs ===== 
-[[.:kvalobs:qc11_range_check_pre_metakvalobs|Grenseverdikontrollen før metakvalobs]]  
- 
  
  • kvalobs/kvalobs/qc11.1580390980.txt.gz
  • Last modified: 2022-05-31 09:23:18
  • (external edit)