kvalobs:kvoss:system:qc2:user:version:kvqc2d-1.2.0

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision 		Previous revision
kvalobs:kvoss:system:qc2:user:version:kvqc2d-1.2.0 [2011-07-31 22:16:46]
paule created 		kvalobs:kvoss:system:qc2:user:version:kvqc2d-1.2.0 [2022-05-31 09:29:32] (current)
Line 8: Line 8:
    * Long time series interpolation    * Long time series interpolation
    * Pluviometer checks (currently runs 2 minute aggregate check as a demonstration)    * Pluviometer checks (currently runs 2 minute aggregate check as a demonstration)
-   * Interface station_param added+   * Interface to station_param added
  
 Bug Fixes Bug Fixes
-   * Akima interpolation in the Dip Test checks that interpolated value is not less than the physical minimum (need to add this to Long Interpolation too)+   * Akima interpolation in the Dip Test checks that interpolated value is not less than the physical minimum (need to add this to Long Interpolation too) - BUG1320
    * Better control for write flags in Redistribution algorithm    * Better control for write flags in Redistribution algorithm
 +   * Ensure the redistributed sum is equal to the original accumulated sum - BUG1325
        
-**This version is deployed only on dev-vm101 since the new algorithms require testing and some further modification ... but the framework is there**+**This version is deployed only on dev-vm101 since the new algorithms require testing and some further modification** 
 + 
 +===== Plumatic Results/Tests ===== 
 + 
 + 
 +Code for the plumatic controls is held in the three files - [[https://svn.met.no/viewvc/kvoss/kvqc2d/trunk/src/algorithms/ProcessPlumatic.cc?view=log|ProcessPlumatic.cc]], [[https://svn.met.no/viewvc/kvoss/kvqc2d/trunk/src/algorithms/Plumatic.cc?view=log|Plumatic.cc]] and [[https://svn.met.no/viewvc/kvoss/kvqc2d/trunk/src/algorithms/Plumatic.h?view=log|Plumatic.h]], 
 +kvqc2d-1.2.0 includes an early snapshot of the code where the main components and the code structure are available (read data, construct a continuous time series with zeros for missing rows, perform some algorithms on the data, write results back) but needs expanding with all details and functions (but  the basic engine to manage the plumatic checks is available). 
 + 
 +For example, kvqc2d-1.2.0 runs a 2 minute aggregating window on the data and identifies aggregations > 0.85. The first minute of a 2 minute interval where the aggregation is above the limit is indicated in the example (please see PLX below) - according to the specification, all of the data in such a window shall be flagged. The next steps are relatively simple to complete: update code to set the flags as defined in the configuration file and update the code for different sized aggregation windows ... but now is a good point to check the details with users before going further. 
 + 
 + 
 +<code> 
 + stationid |       obstime       | original | paramid |       tbtime        | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |      cfailed       
 +-----------+---------------------+----------+---------+---------------------+--------+--------+-------+-----------+------------------+------------------+------------------- 
 +     27270 | 2008-05-02 02:13:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1100000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-02 02:28:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-02 02:40:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-15 19:07:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1100000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-15 19:26:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-15 19:30:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-15 19:32:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-15 19:46:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:34:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1100000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:38:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:39:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:40:00 |      0.2 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.2 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:41:00 |      0.3 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.3 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:42:00 |      0.3 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.3 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:43:00 |      0.5 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.5 | 1101000000000000 | 7000000000000000 | PLX 
 +     27270 | 2008-05-16 15:44:00 |      0.8 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.8 | 1101000000000000 | 7000000000000000 | PLX 
 +     27270 | 2008-05-16 15:45:00 |      0.7 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.7 | 1101000000000000 | 7000000000000000 | PLX 
 +     27270 | 2008-05-16 15:46:00 |      0.3 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.3 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:47:00 |      0.5 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.5 | 1101000000000000 | 7000000000000000 | PLX 
 +     27270 | 2008-05-16 15:48:00 |      0.9 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.9 | 1101000000000000 | 7000000000000000 | PLX 
 +     27270 | 2008-05-16 15:49:00 |      0.7 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.7 | 1101000000000000 | 7000000000000000 | PLX 
 +     27270 | 2008-05-16 15:50:00 |      0.7 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.7 | 1101000000000000 | 7000000000000000 | PLX 
 +     27270 | 2008-05-16 15:51:00 |      0.4 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.4 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:52:00 |      0.3 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.3 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:53:00 |      0.4 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.4 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:54:00 |      0.3 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.3 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:55:00 |      0.2 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.2 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:57:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 15:58:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 16:00:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 16:01:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 16:03:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 16:05:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 20:11:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1100000000000000 | 7000000000000000 |  
 +     27270 | 2008-05-16 20:13:00 |      0.1 |     105 | 2008-08-14 11:23:12 |    404 | 0      |     0 |       0.1 | 1101000000000000 | 7000000000000000 |  
 +</code> 
 + 
 +   * [[kvoss:system:qc2:requirements:algorithms:plumatic]] : link to the specification and other working notes 
 + 
 +===== Longer Gap Interpolation ===== 
 + 
 +Information on this algorithm / latest discussion is available here: 
 + 
 +   * [[kvoss:system:qc2:requirements:algorithms:gapinterpolate]]
  • kvalobs/kvoss/system/qc2/user/version/kvqc2d-1.2.0.1312150606.txt.gz
  • Last modified: 2022-05-31 09:23:19
  • (external edit)