kvalobs:kvoss:system:qc2:test:algorithms:singlemissingpoint

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
kvalobs:kvoss:system:qc2:test:algorithms:singlemissingpoint [2010-07-19 23:37:33]
paule 		kvalobs:kvoss:system:qc2:test:algorithms:singlemissingpoint [2022-05-31 09:29:32] (current)
Line 94: Line 94:
  
  
-{{:kvoss:system:qc2:test:algorithms:useinfocontrol211.dat.xy.dat.jpg|}}+{{kvalobs:kvoss:system:qc2:test:algorithms:useinfocontrol211.jpg|}}
  
 NB The above is on canned test data (same as below) now need to run on real setup. NB The above is on canned test data (same as below) now need to run on real setup.
 +
  
 ====== Tests On Other Parameters ====== ====== Tests On Other Parameters ======
Line 102: Line 103:
 All the following used "AlgoCode=10" except for paramid=212 that used "AlgoCode=9". **Ref:** Algorithm summary: https://kvalobs.wiki.met.no/doku.php?id=kvoss:system:qc2:user:algorithms All the following used "AlgoCode=10" except for paramid=212 that used "AlgoCode=9". **Ref:** Algorithm summary: https://kvalobs.wiki.met.no/doku.php?id=kvoss:system:qc2:user:algorithms
  
-{{:kvoss:system:qc2:test:algorithms:112.dat.xy.dat.jpg?200x200|112}} +{{kvalobs:kvoss:system:qc2:test:algorithms:112.dat.xy.dat.jpg?200x200|112}} 
-{{:kvoss:system:qc2:test:algorithms:173.dat.xy.dat.jpg?200x200|173}} +{{kvalobs:kvoss:system:qc2:test:algorithms:173.dat.xy.dat.jpg?200x200|173}} 
-{{:kvoss:system:qc2:test:algorithms:211.dat.xy.dat.jpg?200x200|211}} +{{kvalobs:kvoss:system:qc2:test:algorithms:211.dat.xy.dat.jpg?200x200|211}} 
-{{:kvoss:system:qc2:test:algorithms:212.dat.xy.dat.jpg?200x200|212}} +{{kvalobs:kvoss:system:qc2:test:algorithms:212.dat.xy.dat.jpg?200x200|212}} 
-{{:kvoss:system:qc2:test:algorithms:213.dat.xy.dat.jpg?200x200|213}} +{{kvalobs:kvoss:system:qc2:test:algorithms:213.dat.xy.dat.jpg?200x200|213}} 
-{{:kvoss:system:qc2:test:algorithms:215.dat.xy.dat.jpg?200x200|215}} +{{kvalobs:kvoss:system:qc2:test:algorithms:215.dat.xy.dat.jpg?200x200|215}} 
-{{:kvoss:system:qc2:test:algorithms:262.dat.xy.dat.jpg?200x200|262}}+{{kvalobs:kvoss:system:qc2:test:algorithms:262.dat.xy.dat.jpg?200x200|262}}
  
 The above results were obtained using the following test data The above results were obtained using the following test data
  
-^ {{:kvoss:system:qc2:test:algorithms:multiparamtersinglemissingpointtest.dat.gz|}} ^+^ {{kvalobs:kvoss:system:qc2:test:algorithms:multiparamtersinglemissingpointtest.dat.gz|}} ^
  
 Tests may be conducted thus: Tests may be conducted thus:
Line 133: Line 134:
 Test data has been taken from March 2008. On each day for all stations the "original" hourly temperature has been set to a missing value -32767 for the times 05:00, 11:00, 17:00 and 23:00 UT and the original value is kept for reference. The results of the algorithm are then compared to the original data: Test data has been taken from March 2008. On each day for all stations the "original" hourly temperature has been set to a missing value -32767 for the times 05:00, 11:00, 17:00 and 23:00 UT and the original value is kept for reference. The results of the algorithm are then compared to the original data:
  
-{{:kvoss:system:qc2:test:algorithms:3036-oldmethod.dat.xy.dat.jpg|}} +{{kvalobs:kvoss:system:qc2:test:algorithms:3036-oldmethod.dat.xy.dat.jpg|}} 
-{{:kvoss:system:qc2:test:algorithms:zoom.jpg?100x100|ZOOM}}+{{kvalobs:kvoss:system:qc2:test:algorithms:zoom.jpg?100x100|ZOOM}}
  
 Good results are obtained. Note the points at -99.9 arise due to this value being present in the original data record (and they are not a result of the algorithm). Good results are obtained. Note the points at -99.9 arise due to this value being present in the original data record (and they are not a result of the algorithm).
Line 147: Line 148:
 Running the new algorithm on the same data as above, the algorithm first tries to do a Max and Min average. If this is not possible a linear interpolation is performed across the gap. First results: Running the new algorithm on the same data as above, the algorithm first tries to do a Max and Min average. If this is not possible a linear interpolation is performed across the gap. First results:
  
-{{:kvoss:system:qc2:test:algorithms:3036-genmethod.dat.xy.dat.jpg|}} +{{kvalobs:kvoss:system:qc2:test:algorithms:3036-genmethod.dat.xy.dat.jpg|}} 
-{{:kvoss:system:qc2:test:algorithms:zoom2.jpg?100x100|ZOOM}}+{{kvalobs:kvoss:system:qc2:test:algorithms:zoom2.jpg?100x100|ZOOM}}
  
 It is clear that in the above graph there are additional points that also show good agreement with the original values. There are also many original values that are unphysical (e.g. high temperatures in March and filtering on flags has also to be applid so that these cases are not included). Examples of high temperatures in the database: It is clear that in the above graph there are additional points that also show good agreement with the original values. There are also many original values that are unphysical (e.g. high temperatures in March and filtering on flags has also to be applid so that these cases are not included). Examples of high temperatures in the database:
Line 160: Line 161:
 Ok, lets filter out results where control(4)=6 ... fnum=6. This gives the following improved result, but the algorithm still appears to act on some temperatures that are too high and should not be corrected by interpolating between the times before and after, that are also too high!?! Ok, lets filter out results where control(4)=6 ... fnum=6. This gives the following improved result, but the algorithm still appears to act on some temperatures that are too high and should not be corrected by interpolating between the times before and after, that are also too high!?!
  
-{{:kvoss:system:qc2:test:algorithms:3036-genmethod_4.dat.xy.dat.jpg|}}+{{kvalobs:kvoss:system:qc2:test:algorithms:3036-genmethod_4.dat.xy.dat.jpg|}}
  
 Configuration File Used: Configuration File Used:
Line 239: Line 240:
 Applying this algorithm and controls: Applying this algorithm and controls:
  
-{{:kvoss:system:qc2:test:algorithms:missinglinear.jpg|}} +{{kvalobs:kvoss:system:qc2:test:algorithms:missinglinear.jpg|}} 
-{{:kvoss:system:qc2:test:algorithms:missinglinearzoom.jpg?100x100|}}+{{kvalobs:kvoss:system:qc2:test:algorithms:missinglinearzoom.jpg?100x100|}}
  
 <code> <code>
Line 248: Line 249:
 Applying the filter: do not include fhqclevel=0, gives: Applying the filter: do not include fhqclevel=0, gives:
  
-{{:kvoss:system:qc2:test:algorithms:fullmissinglinear.dat.xy.dat.jpg|}}+{{kvalobs:kvoss:system:qc2:test:algorithms:fullmissinglinear.dat.xy.dat.jpg|}}
  
 The corresponding configuration file to produce the above result: The corresponding configuration file to produce the above result:
  • kvalobs/kvoss/system/qc2/test/algorithms/singlemissingpoint.1279582653.txt.gz
  • Last modified: 2022-05-31 09:23:19
  • (external edit)