kvalobs:kvoss:system:qc2:test:algorithms:akima

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
kvalobs:kvoss:system:qc2:test:algorithms:akima [2011-03-26 18:24:00]
paule 		kvalobs:kvoss:system:qc2:test:algorithms:akima [2022-05-31 09:29:32] (current)
Line 5: Line 5:
 The following graphs illustrate comparisons between an Akima Interpolation and Linear Interpolation for single missing points. The title gives the time of the missing value, which is located at Hours=3 on each graph. The linear interpolation is the square on the straight line segment. The real data are displayed as blue squares. The curve is the Akima Spline and the corrected value that would be provided by the Akima Interpolation is indicated by the triangle. The following graphs illustrate comparisons between an Akima Interpolation and Linear Interpolation for single missing points. The title gives the time of the missing value, which is located at Hours=3 on each graph. The linear interpolation is the square on the straight line segment. The real data are displayed as blue squares. The curve is the Akima Spline and the corrected value that would be provided by the Akima Interpolation is indicated by the triangle.
  
-{{:kvoss:system:qc2:test:algorithms:o2.dat.jpg|}} +{{kvalobs:kvoss:system:qc2:test:algorithms:o2.dat.jpg|}} 
-{{:kvoss:system:qc2:test:algorithms:o3.dat.jpg|}} +{{kvalobs:kvoss:system:qc2:test:algorithms:o3.dat.jpg|}} 
-{{:kvoss:system:qc2:test:algorithms:o4.dat.jpg|}} +{{kvalobs:kvoss:system:qc2:test:algorithms:o4.dat.jpg|}} 
-{{:kvoss:system:qc2:test:algorithms:o5.dat.jpg|}}+{{kvalobs:kvoss:system:qc2:test:algorithms:o5.dat.jpg|}}
  
 ====== StationID = 59800; Start Time=20080706-06 ====== ====== StationID = 59800; Start Time=20080706-06 ======
Line 25: Line 25:
 ^Curve: |The Akima Fit | ^Curve: |The Akima Fit |
  
-{{:kvoss:system:qc2:test:algorithms:ALL.jpg?300x300|}} +{{kvalobs:kvoss:system:qc2:test:algorithms:ALL.jpg?300x300|}} 
-{{:kvoss:system:qc2:test:algorithms:8_12.jpg?300x300|}} +{{kvalobs:kvoss:system:qc2:test:algorithms:8_12.jpg?300x300|}} 
-{{:kvoss:system:qc2:test:algorithms:3_5.jpg?300x300|}} +{{kvalobs:kvoss:system:qc2:test:algorithms:3_5.jpg?300x300|}} 
-{{:kvoss:system:qc2:test:algorithms:2_3.jpg?300x300|}} +{{kvalobs:kvoss:system:qc2:test:algorithms:2_3.jpg?300x300|}} 
-{{:kvoss:system:qc2:test:algorithms:3_2.jpg?300x300|}}+{{kvalobs:kvoss:system:qc2:test:algorithms:3_2.jpg?300x300|}}
  
  
Line 35: Line 35:
  
    * Actual original = 10.1 Degrees Celsius    * Actual original = 10.1 Degrees Celsius
-   * {{:kvoss:system:qc2:test:algorithms:18700-a_all.jpg|}} +   * {{kvalobs:kvoss:system:qc2:test:algorithms:18700-a_all.jpg|}} 
-   * {{:kvoss:system:qc2:test:algorithms:18700-a.jpg|}} +   * {{kvalobs:kvoss:system:qc2:test:algorithms:18700-a.jpg|}} 
-   * {{:kvoss:system:qc2:test:algorithms:18700-a_8_2.jpg|}}+   * {{kvalobs:kvoss:system:qc2:test:algorithms:18700-a_8_2.jpg|}}
    * Square below is the linear interpolation:    * Square below is the linear interpolation:
-   * {{:kvoss:system:qc2:test:algorithms:18700-a_3_2_l.jpg|}}+   * {{kvalobs:kvoss:system:qc2:test:algorithms:18700-a_3_2_l.jpg|}}
  
 ====== StationID = 18700; Start Time=20080706-06; Example 2 ====== ====== StationID = 18700; Start Time=20080706-06; Example 2 ======
  
-   * {{:kvoss:system:qc2:test:algorithms:18700-b_all.jpg|}} +   * {{kvalobs:kvoss:system:qc2:test:algorithms:18700-b_all.jpg|}} 
-   * {{:kvoss:system:qc2:test:algorithms:18700-b_4_4.jpg|}} +   * {{kvalobs:kvoss:system:qc2:test:algorithms:18700-b_4_4.jpg|}} 
-   * {{:kvoss:system:qc2:test:algorithms:18700-b_2_3.jpg|}}+   * {{kvalobs:kvoss:system:qc2:test:algorithms:18700-b_2_3.jpg|}}
  
  
Line 83: Line 83:
 </code> </code>
  
-Some results from dev-vm101+====== Some results from dev-vm101 ====== 
  
 <code> <code>
Line 92: Line 93:
      90800 | 2011-03-23 14:00:00 |     33.4 |      90 | 2011-03-23 13:56:05       |    330 | 0      |     0 |      33.4 | 0114000000000000 | 5010300000000001 | QC1-3a-90,QC2d-1      90800 | 2011-03-23 14:00:00 |     33.4 |      90 | 2011-03-23 13:56:05       |    330 | 0      |     0 |      33.4 | 0114000000000000 | 5010300000000001 | QC1-3a-90,QC2d-1
 (3 rows) (3 rows)
 +</code>
  
 +Note: in this first case for StationID=90800 Linear Interpolation is used because there is a missing neighbour and therefore not enough points for Akima Interpolation:
 +
 +<code>
 + stationid |       obstime       | original | paramid |           tbtime           | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |      cfailed       
 +-----------+---------------------+----------+---------+----------------------------+--------+--------+-------+-----------+------------------+------------------+--------------------
 +     90800 | 2011-03-23 08:00:00 |     22.5 |      90 | 2011-03-23 07:56:01.165423 |    330 | 0      |     0 |      22.5 | 0111000000000000 | 7000000000000000 | 
 +     90800 | 2011-03-23 09:00:00 |     25.5 |      90 | 2011-03-23 08:56:04.61153  |    330 | 0      |     0 |      25.5 | 0111000000000000 | 7000000000000000 | 
 +     90800 | 2011-03-23 10:00:00 |       27 |      90 | 2011-03-23 09:56:06.744562 |    330 | 0      |     0 |        27 | 0111000000000000 | 7000000000000000 | 
 +     90800 | 2011-03-23 11:00:00 |   -32767 |      90 | 2011-03-23 17:19:33        |    330 | 0      |     0 |    -32767 | 0000003000000000 | 9999900000000000 | 
 +     90800 | 2011-03-23 12:00:00 |     29.4 |      90 | 2011-03-23 11:56:04.26427  |    330 | 0      |     0 |      29.4 | 0101000000000000 | 7000000000000000 | 
 +     90800 | 2011-03-23 13:00:00 |     16.1 |      90 | 2011-03-23 12:56:07        |    330 | 0      |     0 |      31.4 | 0119000000000000 | 5033300000000001 | QC1-3a-90,QC2d-1-L
 +     90800 | 2011-03-23 14:00:00 |     33.4 |      90 | 2011-03-23 13:56:05        |    330 | 0      |     0 |      33.4 | 0114000000000000 | 5010300000000001 | QC1-3a-90,QC2d-1
 +     90800 | 2011-03-23 15:00:00 |     33.3 |      90 | 2011-03-23 14:56:06.771527 |    330 | 0      |     0 |      33.3 | 0111000000000000 | 7000000000000000 | 
 +     90800 | 2011-03-23 16:00:00 |     30.1 |      90 | 2011-03-23 15:56:02.758994 |    330 | 0      |     0 |      30.1 | 0111000000000000 | 7000000000000000 | 
 +     90800 | 2011-03-23 17:00:00 |     26.1 |      90 | 2011-03-23 16:56:06.907794 |    330 | 0      |     0 |      26.1 | 0111000000000000 | 7000000000000000 | 
 +     90800 | 2011-03-23 18:00:00 |     23.4 |      90 | 2011-03-23 17:57:09.594429 |    330 | 0      |     0 |      23.4 | 0111000000000000 | 7000000000000000 | 
 +(11 rows)
 +</code>
 +
 +Next an Akima interpolation is applied but note that the Linear value is also recorded in CFAILED for reference (NB only for testing).
 +
 +<code>
  stationid |       obstime       | original | paramid |           tbtime           | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |                cfailed                  stationid |       obstime       | original | paramid |           tbtime           | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |                cfailed                
 -----------+---------------------+----------+---------+----------------------------+--------+--------+-------+-----------+------------------+------------------+--------------------------------------- -----------+---------------------+----------+---------+----------------------------+--------+--------+-------+-----------+------------------+------------------+---------------------------------------
Line 109: Line 133:
      25830 | 2011-03-23 18:00:00 |      1.6 |      81 | 2011-03-23 17:50:50        |    330 | 0      |     0 |       1.6 | 0114100000000000 | 5010300000000001 | QC1-3a-81,QC1-4-81,QC1-3a-81,QC1-4-81,QC2d-1      25830 | 2011-03-23 18:00:00 |      1.6 |      81 | 2011-03-23 17:50:50        |    330 | 0      |     0 |       1.6 | 0114100000000000 | 5010300000000001 | QC1-3a-81,QC1-4-81,QC1-3a-81,QC1-4-81,QC2d-1
 (3 rows) (3 rows)
 +</code>
  
 +The case is even more interesting. Qc1 identifies a Dip at Hour=17:00 where the value is 11.8. If one ignores the points at Hours 16 and 18 then 11.8 doe snot look like a Dip.
 +
 +{{kvalobs:kvoss:system:qc2:test:algorithms:o6.dat.jpg|}}
 +
 +<code>
  stationid |       obstime       | original | paramid |           tbtime           | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |                 cfailed                   stationid |       obstime       | original | paramid |           tbtime           | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |                 cfailed                 
 -----------+---------------------+----------+---------+----------------------------+--------+--------+-------+-----------+------------------+------------------+----------------------------------------- -----------+---------------------+----------+---------+----------------------------+--------+--------+-------+-----------+------------------+------------------+-----------------------------------------
Line 136: Line 166:
      85450 | 2011-03-25 03:00:00 |     32.5 |      90 | 2011-03-25 02:54:06        |    311 | 0      |     0 |      10.9 | 0409000000000000 | 5033300000000002 | QC1-1-90,QC1-3a-90,QC2d-1-A,Linear=11      85450 | 2011-03-25 03:00:00 |     32.5 |      90 | 2011-03-25 02:54:06        |    311 | 0      |     0 |      10.9 | 0409000000000000 | 5033300000000002 | QC1-1-90,QC1-3a-90,QC2d-1-A,Linear=11
      85450 | 2011-03-25 04:00:00 |     16.8 |      90 | 2011-03-25 03:54:15        |    311 | 0      |     0 |      16.8 | 0404000000000000 | 5020300000000002 | QC1-3a-90,QC2d-1      85450 | 2011-03-25 04:00:00 |     16.8 |      90 | 2011-03-25 03:54:15        |    311 | 0      |     0 |      16.8 | 0404000000000000 | 5020300000000002 | QC1-3a-90,QC2d-1
-(3 rows) 
- 
- stationid |       obstime       | original | paramid |           tbtime           | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |      cfailed        
------------+---------------------+----------+---------+----------------------------+--------+--------+-------+-----------+------------------+------------------+-------------------- 
-     94500 | 2011-03-25 13:00:00 |     16.6 |      90 | 2011-03-25 12:52:42.714296 |    330 | 0      |     0 |      16.6 | 0111000000000000 | 7000000000000000 |  
-     94500 | 2011-03-25 14:00:00 |       36 |      90 | 2011-03-25 13:52:39        |    330 | 0      |     0 |      16.7 | 0119000000000000 | 5033300000000001 | QC1-3a-90,QC2d-1-L 
-     94500 | 2011-03-25 15:00:00 |     16.8 |      90 | 2011-03-25 14:52:38        |    330 | 0      |     0 |      16.8 | 0114000000000000 | 5010300000000001 | QC1-3a-90,QC2d-1 
 (3 rows) (3 rows)
  
Line 151: Line 174:
      79600 | 2011-03-25 23:00:00 |      4.6 |      90 | 2011-03-25 22:53:21        |    311 | 0      |     0 |       4.6 | 0404000000000000 | 5020300000000002 | QC1-3a-90,QC2d-1      79600 | 2011-03-25 23:00:00 |      4.6 |      90 | 2011-03-25 22:53:21        |    311 | 0      |     0 |       4.6 | 0404000000000000 | 5020300000000002 | QC1-3a-90,QC2d-1
 (3 rows) (3 rows)
 +</code>
 +
 +Finally ... another example where linear is adopted rather than Akima.
 +
 +
 +<code>
 + stationid |       obstime       | original | paramid |           tbtime           | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |      cfailed       
 +-----------+---------------------+----------+---------+----------------------------+--------+--------+-------+-----------+------------------+------------------+--------------------
 +     94500 | 2011-03-25 09:00:00 |     15.8 |      90 | 2011-03-25 08:52:39.871496 |    330 | 0      |     0 |      15.8 | 0111000000000000 | 7000000000000000 | 
 +     94500 | 2011-03-25 10:00:00 |     15.6 |      90 | 2011-03-25 09:52:37.959374 |    330 | 0      |     0 |      15.6 | 0111000000000000 | 7000000000000000 | 
 +     94500 | 2011-03-25 11:00:00 |   -32767 |      90 | 2011-03-25 11:40:48        |    330 | 0      |     0 |    -32767 | 0000003000000000 | 9999900000000000 | 
 +     94500 | 2011-03-25 12:00:00 |     15.6 |      90 | 2011-03-25 11:52:40.90737  |    330 | 0      |     0 |      15.6 | 0110000000000000 | 7000000000000000 | 
 +     94500 | 2011-03-25 13:00:00 |     16.6 |      90 | 2011-03-25 12:52:42.714296 |    330 | 0      |     0 |      16.6 | 0111000000000000 | 7000000000000000 | 
 +     94500 | 2011-03-25 14:00:00 |       36 |      90 | 2011-03-25 13:52:39        |    330 | 0      |     0 |      16.7 | 0119000000000000 | 5033300000000001 | QC1-3a-90,QC2d-1-L
 +     94500 | 2011-03-25 15:00:00 |     16.8 |      90 | 2011-03-25 14:52:38        |    330 | 0      |     0 |      16.8 | 0114000000000000 | 5010300000000001 | QC1-3a-90,QC2d-1
 +     94500 | 2011-03-25 16:00:00 |     18.5 |      90 | 2011-03-25 15:52:34.325543 |    330 | 0      |     0 |      18.5 | 0111000000000000 | 7000000000000000 | 
 +     94500 | 2011-03-25 17:00:00 |     18.5 |      90 | 2011-03-25 16:52:40.451525 |    330 | 0      |     0 |      18.5 | 0111000000000000 | 7000000000000000 | 
 +     94500 | 2011-03-25 18:00:00 |     18.4 |      90 | 2011-03-25 17:52:40.31381  |    330 | 0      |     0 |      18.4 | 0111000000000000 | 7000000000000000 | 
 +     94500 | 2011-03-25 19:00:00 |     17.4 |      90 | 2011-03-25 18:52:41.345007 |    330 | 0      |     0 |      17.4 | 0111000000000000 | 7000000000000000 | 
  
 </code> </code>
  • kvalobs/kvoss/system/qc2/test/algorithms/akima.1301163840.txt.gz
  • Last modified: 2022-05-31 09:23:19
  • (external edit)