This is an old revision of the document!


kvqc2d Version: 1.1.2

Source: https://svn.met.no/viewvc/kvoss/kvqc2d/branches/kvqc2d-1.1.2/

Significant Changes

  • Release of DipTest (including new strategy with corresponding configuration files)
  • Algorithm Called by Name

In addition, it is proposed to manage the weekly run of the Redistribution algorithm with a cron.

Algorithms in this release:

Algorithm(+) Description
SingleLinear As in previous release kvqc2d_1.1.0: specification
Redistribute As in previous release kvqc2d_1.1.0: https://kvalobs.wiki.met.no/doku.php?id=kvoss:system:qc2:requirements:algorithms:rarr_24
DipTest New algorithm: https://kvalobs.wiki.met.no/doku.php?id=kvoss:system:qc2:requirements:algorithms:diptest03

(+) This is the name to specify in the configuration file.

Example Configuration Files

For this release all the configuration files need to be re-installed since the use of AlgoCode=“a number” is now replaced with Algorithm=“the algorithm name”. The changes are illustrated in the example configuration files below.

The new configuration files are held in subversion in the directory https://svn.met.no/viewvc/kvoss/kvqc2d/branches/kvqc2d-1.1.2/src/Reference/

This includes a tar file of all of the required contents for easier deployment

To install new configuration files and setup the associated cronjob:

# after logging into the operational machine as the kvalobs user

$ cd /etc/kvalobs/Qc2Config
$ rm ./*.cfg
$ rm ./*.hold
$ wget https://svn.met.no/kvoss/kvqc2d/branches/kvqc2d-1.1.2/src/Reference/cfg.tar.gz
$ tar xvzf cfg.tar.gz
$ rm cfg.tar.gz

# The configuration files are now in place.

---------------------------------------------

# In order to set up the crontab for the weekly redistribution run

$ chmod +x Redistribution_14days_off_cron.sh
$ chmod +x Redistribution_14days_on_cron.sh

# next edit the crontab and insert the following two lines
# i.e. as user kvalobs:

$ crontab -e

# insert the following lines:

23 0 * * 3 /etc/kvalobs/Qc2Config/Redistribution_14days_on_cron.sh
23 0 * * 4 /etc/kvalobs/Qc2Config/Redistribution_14days_off_cron.sh

Notes: the new scripts in cron renames “Redistribution_14days.hold” to “Redistribution_14days.cfg” every Wednesday and the sets it back to “Redistribution_14days.hold” 24 hours later.

The Redistribution algorithm will then run automatically to the following schedule:

  • typically daily run at 06:35 looking at the last 4 days
  • 01:20 Wednesday Night/Thursday Morning run to check the last 14 days

Example Configuration Files

SingleLinear_v32

*NB* Different/simpler checks applied to the neighbours (CF version 1.0.5)

# Performs simple linear interpolation for a single point replacement.
Algorithm=SingleLinear
RunAtHour=6
RunAtMinute=50   
Last_NDays=1

#[Specific Data Type and Paramters ids etc.]
ParamId=104
# Only write back the result if not prviously controlled
W_fhqc=0

#Flag to set if value is corrected
S_ftime=1
change_fmis=3->1
change_fmis=0->4
change_fmis=2->4
#Flag to check if the algorithm shall be applied ...
U_2=0		
Redistribution
# Algorithm configuration for redistribution of accumulated precipitation
Algorithm=Redistribute
InterpCode=2
RunAtHour=6
RunAtMinute=35
Last_NDays=4

#[Time Range] The time window for when to apply the algorithm
#Start_YYYY=2010
#Start_MM=10 
#Start_DD=8
#Start_hh=6
#Start_mm=0
#Start_ss=0

#End_YYYY=2010 
#End_MM=10
#End_DD=11
#End_hh=6
#End_mm=0
#End_ss=0


Start_hh=6
End_hh=6   # NB 24 hour values are at 06:00 UTC

#[Time Step]
Step_DD=1

#[Specific Data Type and Paramters ids etc.]
ParamId=110
TypeIds=302
TypeIds=402

#
# Only write data it it has not been analysed by HQC
# W_fhqc=9  # 9 set here because of the test data being used ...
W_fhqc=0

# Condition for running the algorithm
A_fd=2

# Flags to set on successful completion
S_fd=7
change_fmis=3->1
change_fmis=0->4

#Only interpolate the following data
I_fd=1

InterpolationDistance=50.0
DipTest

The DipTest configuration comprises two files:

DipTest.cfg

# DIP-TEST
Algorithm=DipTest
RunAtHour=5 
RunAtMinute=5

#[Time Range]
Last_NDays=1

#[Specific Data Type and Paramters ids etc.]
ParValFilename="/etc/kvalobs/Qc2Config/DipTestParameters.txt"

# Only write data it it has not been analysed by HQC
# W_fhqc=9  # 9 set here because of the test data being used ...
W_fhqc=0

#Flag required for neighbour to be used for an interpolation
U_2=0

That works through the parameters and corresponding delta values specified in DipTestParameters.txt as below:

1   9.0
2   60.0
81   10.0
85   10.0
86   12.5
87   10.0
88   12.5
89   15.0
90   12.5
91   12.5
92   15.0
93   15.0
94   15.0
104   100
105   3.0
113   15.0
123   60.0
172   12.0
174   12.0
175   12.0
176   12.0
177   12.0
197   1000.0
198   500.0
199   500.0
200   1000.0
211   7.5
212   7.5
213   7.5
215   7.5
221   15.0
222   15.0
This website uses cookies. By using the website, you agree with storing cookies on your computer. Also you acknowledge that you have read and understand our Privacy Policy. If you do not agree leave the website.More information about cookies
  • kvalobs/kvoss/system/qc2/user/version/kvqc2d-1.1.2.1304884629.txt.gz
  • Last modified: 2022-05-31 09:23:19
  • (external edit)