kvalobs:kvoss:system:qc2:test:downstream

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
kvalobs:kvoss:system:qc2:test:downstream [2010-11-25 19:57:22]
paule 		kvalobs:kvoss:system:qc2:test:downstream [2022-05-31 09:29:32] (current)
Line 200: Line 200:
  stationid |       obstime       |     original      | paramid |       tbtime        | typeid | sensor | level |     corrected     |   controlinfo    |     useinfo      |      cfailed         stationid |       obstime       |     original      | paramid |       tbtime        | typeid | sensor | level |     corrected     |   controlinfo    |     useinfo      |      cfailed       
 -----------+---------------------+-------------------+---------+---------------------+--------+--------+-------+-------------------+------------------+------------------+-------------------- -----------+---------------------+-------------------+---------+---------------------+--------+--------+-------+-------------------+------------------+------------------+--------------------
-     17850 | 2010-11-25 09:00:00 |            -32767 |     104 | 2010-11-25 09:30:15 |    330 | 0      |     0 |  449.200012207031 | 0000001100000000 | 6892900000000000 | QC2d-2 +     17850 | 2010-11-25 09:00:00 |            -32767 |     211 | 2010-11-25 09:30:10 |    330 | 0      |     0 | -6.40000009536743 | 0000601100000000 | 5894700000000001 | QC1-4-211:1,QC2d-2 
-     17850 | 2010-11-25 09:00:00 |            -32767 |     213 | 2010-11-25 09:30:15 |    330 | 0      |     0 | -6.69999980926514 | 0000001100000000 | 6892900000000000 | QC2d-2+</code> 
 + 
 +====== Listen to operations ====== 
 + 
 +  * Update "$HOME/etc/kvdatalistener.conf" to listen to murky: 
 + 
 +<code> 
 +kvserver=kvalobs 
 +#kvserver=kvtest-dev-vm101 
 +</code> 
 + 
 +  * Run a check on murky (trigger from config file (file time set back afterwards)). 
 + 
 +Qc2 Output: 
 + 
 +<code> 
 +kvalobs@murky:/var/log/kvalobs$ tail -f Qc2.log 
 + 
 +--------------- Case 10: Single Linear 
 +20101125201217: INFO  
 +--------------- Single Linear 
 +20101125201218: INFO  
 +--------------- ProcessUnitT Writing Data 63.5 76905 2010-11-25 16:0:0 
 +20101125201218: INFO  
 +--------------- ProcessUnitT Writing Data 68 76906 2010-11-25 16:0:0 
 +20101125201219: INFO  
 +--------------- ProcessUnitT Writing Data 57.5 76906 2010-11-25 12:0:0 
 +20101125201219: INFO  
 +--------------- ProcessUnitT Writing Data 59.5 76905 2010-11-25 12:0:0 
 +20101125201220: INFO  
 +--------------- ProcessUnitT Writing Data 69.5 17090 2010-11-25 10:0:0 
 +20101125201220: INFO  
 +--------------- ProcessUnitT Writing Data 64.3 17850 2010-11-25 9:0:0 
 + 
 +kvalobs@murky:/var/log/kvalobs$  
 + 
 +</code> 
 + 
 + 
 +And the data arrives on dev-vm101: 
 + 
 +<code> 
 +kvalobs=# select * from rcvtest_data where paramid=262; 
 + stationid |       obstime       | original | paramid |       tbtime        | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |      cfailed        
 +-----------+---------------------+----------+---------+---------------------+--------+--------+-------+-----------+------------------+------------------+-------------------- 
 +     76905 | 2010-11-25 16:00:00 |   -32767 |     262 | 2010-11-25 17:30:11 |     11 | 0      |     0 |      63.5 | 0000601100000000 | 5894700000000001 | QC1-4-262:1,QC2d-2 
 +     76906 | 2010-11-25 16:00:00 |   -32767 |     262 | 2010-11-25 17:30:11 |     11 | 0      |     0 |        68 | 0000601100000000 | 5894700000000001 | QC1-4-262:1,QC2d-2 
 +     76906 | 2010-11-25 12:00:00 |   -32767 |     262 | 2010-11-25 13:30:10 |     11 | 0      |     0 |      57.5 | 0000601100000000 | 5894700000000001 | QC1-4-262:1,QC2d-2 
 +     76905 | 2010-11-25 12:00:00 |   -32767 |     262 | 2010-11-25 13:30:10 |     11 | 0      |     0 |      59.5 | 0000601100000000 | 5894700000000001 | QC1-4-262:1,QC2d-2 
 +     17090 | 2010-11-25 10:00:00 |   -32767 |     262 | 2010-11-25 10:45:56 |    502 | 0      |     0 |      69.5 | 0000601100000000 | 5894700000000001 | QC1-4-262:1,QC2d-2 
 +(5 rows) 
 + 
 +kvalobs=# \q 
 +kvalobs@dev-vm101:~$  
 +</code> 
 + 
 + 
 +Double check that at least one of the rows is in rcvtest_data but not in the dev-vm101 data table! 
 + 
 +<code> 
 +kvalobs=# select * from rcvtest_data where paramid=262 and cfailed like '%QC2%' and obstime>'yesterday' and stationid=17090; 
 + stationid |       obstime       | original | paramid |       tbtime        | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |      cfailed        
 +-----------+---------------------+----------+---------+---------------------+--------+--------+-------+-----------+------------------+------------------+-------------------- 
 +     17090 | 2010-11-25 10:00:00 |   -32767 |     262 | 2010-11-25 10:45:56 |    502 | 0      |     0 |      69.5 | 0000601100000000 | 5894700000000001 | QC1-4-262:1,QC2d-2 
 +(1 row) 
 + 
 +kvalobs=# select * from data where paramid=262 and cfailed like '%QC2%' and obstime>'yesterday' and stationid=17090; 
 + stationid | obstime | original | paramid | tbtime | typeid | sensor | level | corrected | controlinfo | useinfo | cfailed  
 +-----------+---------+----------+---------+--------+--------+--------+-------+-----------+-------------+---------+--------- 
 +(0 rows) 
 +</code> 
 + 
 +and did come from murky: 
 + 
 +<code> 
 +kvalobs@murky:/etc/kvalobs/Qc2Config$ psql kvalobs 
 +Welcome to psql 8.3.3, the PostgreSQL interactive terminal. 
 + 
 +Type:  \copyright for distribution terms 
 +       \h for help with SQL commands 
 +       \? for help with psql commands 
 +       \g or terminate with semicolon to execute query 
 +       \q to quit 
 + 
 +kvalobs=#  select * from data where paramid=262 and cfailed like '%QC2%' and obstime>'yesterday' and stationid=17090 and obstime='2010-11-25 10:00:00'; 
 + stationid |       obstime       | original | paramid |       tbtime        | typeid | sensor | level | corrected |   controlinfo    |     useinfo      |      cfailed        
 +-----------+---------------------+----------+---------+---------------------+--------+--------+-------+-----------+------------------+------------------+-------------------- 
 +     17090 | 2010-11-25 10:00:00 |   -32767 |     262 | 2010-11-25 10:45:56 |    502 | 0      |     0 |      69.5 | 0000601100000000 | 5894700000000001 | QC1-4-262:1,QC2d-2 
 +(1 row)
 </code> </code>
  
Line 282: Line 370:
 This looks like it worked ... i.e. it did not come from murky! But we fiddled with HQC at the end of the day and did this trigger the transfer? This looks like it worked ... i.e. it did not come from murky! But we fiddled with HQC at the end of the day and did this trigger the transfer?
  
-====== Yes it works! ======+====== Yes it works - but only when kv2kl is restarted ... ! ======
  
 The following contains a mixture of output (note before and after comman bug fix too!) The following contains a mixture of output (note before and after comman bug fix too!)
  • kvalobs/kvoss/system/qc2/test/downstream.1290715042.txt.gz
  • Last modified: 2022-05-31 09:23:18
  • (external edit)