This is an old revision of the document!


…. in preparation … FIXME

kvqc2d Version: 1.1.2

Source: https://svn.met.no/viewvc/kvoss/kvqc2d/branches/kvqc2d-1.1.2/

Significant Changes

  • Release of DipTest (including new strategy with corresponding configuration files)
  • Algorithm Called by Name

In addition, it is proposed to manage the weekly run of the Redistribution algorithm with a cron.

Algorithms in this release:

Algorithm(+) Description
SingleLinear As in previous release kvqc2d_1.1.0: specification
Redistribute As in previous release kvqc2d_1.1.0: https://kvalobs.wiki.met.no/doku.php?id=kvoss:system:qc2:requirements:algorithms:rarr_24
DipTest New algorithm: https://kvalobs.wiki.met.no/doku.php?id=kvoss:system:qc2:requirements:algorithms:diptest03

(+) This is the name to specify in the configuration file.

Example Configuration Files

For this release all the configuration files need to be re-installed since the use of AlgoCode=“a number” is now replaced with Algorithm=“the algorithm name”. The changes are illustrated in the example configuration files below.

The new configuration files are held in subversion in the directory https://svn.met.no/viewvc/kvoss/kvqc2d/branches/kvqc2d-1.1.2/src/Reference/

This includes a tar file of all of the required contents for easier deployment

To install new configuration files and setup the associated cronjob:

# after logging into the operational machine as the kvalobs user

$ cd /etc/kvalobs/Qc2Config
$ rm ./*.cfg
$ rm ./*.hold
$ wget https://svn.met.no/kvoss/kvqc2d/branches/kvqc2d-1.1.2/src/Reference/cfg.tar.gz
$ tar xvzf cfg.tar.gz
$ rm cfg.tar.gz

# The configuration files are now in place.

---------------------------------------------

# In order to set up the crontab for the weekly redistribution run

$ chmod +x Redistribution_14days_off_cron.sh
$ chmod +x Redistribution_14days_on_cron.sh

# next edit the crontab and insert the following two lines
# i.e. as user kvalobs:

$ crontab -e

# insert the following lines:

# 23 0 * * 3 /etc/kvalobs/Qc2Config/Redistribution_14days_on_cron.sh
# 23 0 * * 4 /etc/kvalobs/Qc2Config/Redistribution_14days_off_cron.sh

Example Configuration Files

SingleLinear_v32

*NB* Different/simpler checks applied to the neighbours (CF version 1.0.5)

# AlgCode 10 corresponds to https://svn.met.no/kvoss/kvQc2/branches/kvqc2-1.0.1/src/algorithms/SingleLinear.cc
# Performs simple linear interpolation for a single point replacement.
# If the result is outside an available max min range, the nearest of the
# max or min values are used.
AlgoCode=10
# Time to run the algorithm
RunAtHour=16
RunAtMinute=47
# Check data from the last three days
Last_NDays=40

#[Specific Data Type and Paramters ids etc.]
ParamId=211
# MaxParamId=215   # Optional  !!!! The Max and Min options are no longer required (to be modified).
# MinParamId=213   # Optional
# Only write back the result if not previously controlled
W_fhqc=0

#Flag to set if value is corrected
S_ftime=1
change_fmis=3->1
change_fmis=0->4
change_fmis=2->4

#If there is already a 1 in place then we do not want run the algorithm again!
U_2=0
Redistribution
# Algorithm configuration for redistribution of accumulated precipitation
AlgoCode=1
InterpCode=2
RunAtHour=23
RunAtMinute=35
Last_NDays=14

#[Time Range] The time window for when to apply the algorithm
#Start_YYYY=2010
#Start_MM=10 
#Start_DD=8
#Start_hh=6
#Start_mm=0
#Start_ss=0

#End_YYYY=2010 
#End_MM=10
#End_DD=11
#End_hh=6
#End_mm=0
#End_ss=0


Start_hh=6
End_hh=6   # NB 24 hour values are at 06:00 UTC

#[Time Step]
Step_DD=1

#[Specific Data Type and Paramters ids etc.]
ParamId=110
TypeIds=302
TypeIds=402

#
# Only write data it it has not been analysed by HQC
W_fhqc=0

# Added for a special test run
# CfailedString="any text"


# Condition for running the algorithm
A_fd=2

# Flags to set on successful completion
S_fd=7
change_fmis=3->1
change_fmis=0->4

#Only interpolate the following data
I_fd=1

InterpolationDistance=50.0

Notes

  • This algorithm will redistribute data flagged with fd=2 (A_fd) and use neighbours with fd=1 for interpolation (I_fd) and set fd=7 (S_fd) for the new corrected data. But fhqc must be 0 for data to be written back.
  • To re-run the algorithm on the same data again set A_fd=7 and keep W_fhqc=0, i.e. do not re-write any decision by HQC.

The schedule for the algorithm is as follows:

  • 06:35 perform a run looking at the last 4 days - the last 4 days is selected since from the first run on murky (see above) about 30 redistributions were made of which 15 were over 3 days and 10 over 4 days.
  • 01:20 Wednesday Night/Thursday Morning run to check the last 14 days (Note: Could we run every night for the last two weeks to pick up any changes?)
This website uses cookies. By using the website, you agree with storing cookies on your computer. Also you acknowledge that you have read and understand our Privacy Policy. If you do not agree leave the website.More information about cookies
  • kvalobs/kvoss/system/qc2/user/version/kvqc2d-1.1.2.1304883666.txt.gz
  • Last modified: 2022-05-31 09:23:19
  • (external edit)