Qc2 Acceptance Test File
This document describes the set of tests prepared to support the acceptance of Qc2 software prior to its deployment on the operational system.
These tests are not be run on the operational system. The tests are designed for use on a test database that is, for example, posted on a virtual machine. Test data is generated in the database for the running of the tests as well as other modification to the test database as required.
Status meeting slides prior to customer testing cycle.
Alert
Various test data files and configuration files are stored in the wiki for easy discovery. The wiki often converts filenames to a default lower case. The documentation may say “ALG001.cfg” and downloading the corresponding file one may end up with “alg001.cfg”. Please correct the case as required when running each test. In contrast the subversion repository keeps the case intact.
Prerequisites
The Test environment is in place. For example:
- Dedicated virtual machine is set up with the kvalobs database installed (internal link): kvalobs installation
The software is the installed either by:
- Built from the the latest trunk distribution (or a specific tag) for Qc2
- Installed from a debian package for Qc2 [in progress]
- NB Qc1 is assumed to be already installed and the base kvalobs and metlibs libraries are available (e.g. kvcpp, puTools)
It is recommended to carry out the acceptance tests on a new virtual machine (therefore all problems found from scratch) or as part of an installation on dev-vm101 (or the latest test machine).
The test cases below are derived from work on dev-vm116 where the installation follows strategy (1) from the above list.
Test Cases
The following test cases are available. Following the linked Short Name will redirect to the full test case.
Qc1 Regression tests are indicated but not included here.
For all errors discovered in running each test please open an anomaly report in BUGZILLA (TBC: Is Bugzilla ready for Qc2?)
| Test Case Short Name | Description | Comments |
|---|---|---|
| Qc2-INS | Installation of Qc2 | For operations Qc2 shall be installed from a debian package (under development). This test case currentlt describes the build from the subversion repository sources. |
| Qc1-REG | Qc1 Regression tests | Perform regression tests for Qc1 to ensure that the old kvalobs system still behaves as expected. (Not documented here, please refer to Qc1 tests documentation) |
| Qc2-OPE | Basic Qc2 operations | - |
| Qc2-OPE-RUN | Start and Stop | - |
| Qc2-OPE-CFG | Parse configuration files | - |
| Qc2-OPE-LOG | Write and review log files | - |
| Qc2-OPE-MOD | Setup in basic operational mode | - |
| Qc2-FLG | Qc2 Flag Test Cases | - |
| Qc2-FLG-E2E | Run Qc2 and observe the flag changes. | - |
| Qc2-PRF | Qc2 Performance Test Case | - |
| Qc2-PRF-SYS | Run Qc2 in a demanding stressed mode with concurrent Qc1 and monitor the system performance (CPU, memorage usage etc.). | - |
| Qc2-ALG | Qc2 Algorithm Test Cases | - |
| Qc2-ALG-001 | Redistribution of accumulated preciptation | Test shall include switching between different interpolation methods … |
| Qc2-ALG-004 | Correction of single point missing hourly temperature | - |
| Qc2-XXX-YYY | … | … |
NB The number suffix in Qc2-ALG-004 refers to the Algorithm Code.