This is an old revision of the document!
kvqc2d Version: 1.2.0
Source: https://svn.met.no/viewvc/kvoss/kvqc2d/branches/kvqc2d-1.2.0/
Significant Changes
First examples of
- Long time series interpolation
- Pluviometer checks (currently runs 2 minute aggregate check as a demonstration)
- Interface to station_param added
Bug Fixes
- Akima interpolation in the Dip Test checks that interpolated value is not less than the physical minimum (need to add this to Long Interpolation too)
- Better control for write flags in Redistribution algorithm
This version is deployed only on dev-vm101 since the new algorithms require testing and some further modification
Plumatic Results/Tests
Development code for the plumatic controls is held in the three files - ProcessPlumatic.cc, Plumatic.cc and Plumatic.h, kvqc2d-1.2.0 includes an early snapshot of the code where the main components and the code structure are available (read data, construct a continuous time series with zeros for missing rows, perform some algorithms on the data, write results back) but needs expanding with all details and functions.
For example, kvqc2d-1.2.0 runs a 2 minute aggregating window on the data and identifies aggregations > 0.85. The first minute of a 2 minute interval where the aggregation is above the limit is flagged. For now the flagging is just a label in CFAILED (please see PLX below). It is straightforward to change this to a flag setting ( … ) and also to update the code for different sized aggregation windows, but now is a good point to check the details with users before going further.
stationid | obstime | original | paramid | tbtime | typeid | sensor | level | corrected | controlinfo | useinfo | cfailed
-----------+---------------------+----------+---------+---------------------+--------+--------+-------+-----------+------------------+------------------+-------------------
27270 | 2008-05-02 02:13:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1100000000000000 | 7000000000000000 |
27270 | 2008-05-02 02:28:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-02 02:40:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-15 19:07:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1100000000000000 | 7000000000000000 |
27270 | 2008-05-15 19:26:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-15 19:30:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-15 19:32:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-15 19:46:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:34:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1100000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:38:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:39:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:40:00 | 0.2 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.2 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:41:00 | 0.3 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.3 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:42:00 | 0.3 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.3 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:43:00 | 0.5 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.5 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:44:00 | 0.8 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.8 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:45:00 | 0.7 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.7 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:46:00 | 0.3 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.3 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:47:00 | 0.5 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.5 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:48:00 | 0.9 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.9 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:49:00 | 0.7 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.7 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:50:00 | 0.7 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.7 | 1101000000000000 | 7000000000000000 | PLX
27270 | 2008-05-16 15:51:00 | 0.4 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.4 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:52:00 | 0.3 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.3 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:53:00 | 0.4 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.4 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:54:00 | 0.3 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.3 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:55:00 | 0.2 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.2 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:57:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 15:58:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 16:00:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 16:01:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 16:03:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 16:05:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
27270 | 2008-05-16 20:11:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1100000000000000 | 7000000000000000 |
27270 | 2008-05-16 20:13:00 | 0.1 | 105 | 2008-08-14 11:23:12 | 404 | 0 | 0 | 0.1 | 1101000000000000 | 7000000000000000 |
- plumatic : link to the specification and other working notes
Longer Gap Interpolation
Information on this algorithm / latest discussion is available here: