kvqc2d Version: 1.2.0
Source: https://svn.met.no/viewvc/kvoss/kvqc2d/branches/kvqc2d-1.2.0/
Significant Changes
First examples of
- Long time series interpolation
- Pluviometer checks (currently runs 2 minute aggregate check as a demonstration)
- Interface to station_param added
Bug Fixes
- Akima interpolation in the Dip Test checks that interpolated value is not less than the physical minimum (need to add this to Long Interpolation too) - BUG1320
- Better control for write flags in Redistribution algorithm
- Ensure the redistributed sum is equal to the original accumulated sum - BUG1325
This version is deployed only on dev-vm101 since the new algorithms require testing and some further modification
Plumatic Results/Tests
Code for the plumatic controls is held in the three files - ProcessPlumatic.cc, Plumatic.cc and Plumatic.h, kvqc2d-1.2.0 includes an early snapshot of the code where the main components and the code structure are available (read data, construct a continuous time series with zeros for missing rows, perform some algorithms on the data, write results back) but needs expanding with all details and functions (but the basic engine to manage the plumatic checks is available).
For example, kvqc2d-1.2.0 runs a 2 minute aggregating window on the data and identifies aggregations > 0.85. The first minute of a 2 minute interval where the aggregation is above the limit is indicated in the example (please see PLX below) - according to the specification, all of the data in such a window shall be flagged. The next steps are relatively simple to complete: update code to set the flags as defined in the configuration file and update the code for different sized aggregation windows … but now is a good point to check the details with users before going further.
stationid | obstime | original | paramid | tbtime | typeid | sensor | level | corrected | controlinfo | useinfo | cfailed
-----------+---------------------+----------+---------+---------------------+--------+--------+-------+-----------+------------------+------------------+-------------------
27270 | 2008-05-02 02:13:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1100000000000000 | 7000000000000000 |
27270 | 2008-05-02 02:28:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-02 02:40:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-15 19:07:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1100000000000000 | 7000000000000000 |
27270 | 2008-05-15 19:26:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-15 19:30:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-15 19:32:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-15 19:46:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:34:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1100000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:38:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:39:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:40:00 | 0.2 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.2 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:41:00 | 0.3 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.3 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:42:00 | 0.3 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.3 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:43:00 | 0.5 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.5 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:44:00 | 0.8 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.8 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:45:00 | 0.7 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.7 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:46:00 | 0.3 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.3 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:47:00 | 0.5 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.5 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:48:00 | 0.9 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.9 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:49:00 | 0.7 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.7 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:50:00 | 0.7 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.7 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:51:00 | 0.4 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.4 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:52:00 | 0.3 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.3 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:53:00 | 0.4 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.4 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:54:00 | 0.3 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.3 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:55:00 | 0.2 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.2 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:57:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:58:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 16:00:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 16:01:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 16:03:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 16:05:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 20:11:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1100000000000000 | 7000000000000000 |
27270 | 2008-05-16 20:13:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
- plumatic : link to the specification and other working notes
Longer Gap Interpolation
Information on this algorithm / latest discussion is available here: