Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
fimex:start [2012-11-27 13:00:37] heikok |
fimex:start [2022-05-31 09:29:32] (current) |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | {{ | + | {{ |
| ====== FIMEX ====== | ====== FIMEX ====== | ||
| Line 11: | Line 11: | ||
| ===== News ===== | ===== News ===== | ||
| - | | + | Please see [[https:// |
| - | * read multiple grib-files | + | |
| - | * allow writing of latlon grib-files from north to south | + | The following NEWS are not updated any more since May 2019: |
| - | * allow duplicated coordinates | + | |
| - | * remove duplicated coordinates for felt-files in latlon | + | * please see [[https:// |
| - | * allow different names for latlong (e.g. longlat) projections | + | * 2018-11-01 [[https:// |
| - | * remove long deprecated FeltCDMReader2.h | + | * please see [[https:// |
| - | * allow change of dimensions without variables in ncml | + | * 2018-02-07 [[https:// |
| - | * allow variable name-change and attribute-change in one step in ncml | + | * please see [[https:// |
| - | * 2012-11-07 {{:fimex:fimex-0.40.tar.gz|fimex-0.40}} | + | * 2017-10-25 [[https://github.com/ |
| - | * splitting of vertical axes in grib-files | + | * please see [[https:// |
| - | * support for ensemble products in grib-files | + | * 2017-09-05 [[https:// |
| - | * 2012-10-30 {{:fimex: | + | * vertical transformation / interpolation supports ensemble dimensions |
| - | * vertical-interpolation invalidating data below ocean floor | + | * function to convert specific humidity to relative humidity |
| - | * vertical interpolation fixing axis (positive down) of depth | + | * support for oblique mercator and geostationary projections |
| - | * 2012-10-15 {{:fimex:fimex-0.39.1.tar.gz|fimex-0.39.1}} | + | * cmake build, support for building with eccodes |
| - | * backport to boost-1.32 | + | * 2017-05-12 {{ : |
| - | * avoid problems with older gcc or icc when using constant class members | + | * more bugfixes logging |
| - | * improve performance of scaling | + | * 2017-04-05 {{ : |
| - | * 2012-09-08 {{: | + | * bugfix logging |
| - | * merging of grids with different resolution (A. Bürger) | + | * 2017-03-20 {{: |
| - | * allow quality-flags and land-masks from external sources (A. Bürger) | + | * bugfix |
| - | * successfully build on MacOS X/gcc | + | * 2017-03-20 {{: |
| - | * successfully tested with felt-archive files | + | * bugfix in fortran interface |
| - | * 2012-08-11 {{: | + | * bugfixes elsewhere |
| - | * compatibility with boost filesystem V3 / boost 1.50 | + | * logging reorganization |
| - | * adapting to gcc-4.6 / Ubuntu 12.04 | + | * faster implementation of extractor |
| - | * 2012-07-19 {{: | + | * 2016-11-25 {{: |
| - | * 2x improved output-performance to netcdf3 files | + | * '' |
| - | * support for ocean_s_coordinate_g1 and *_g2 | + | * new data type CDM_STRINGS corresponding to NetCDF NC_STRING |
| - | * adding IndexedData for convenience | + | * added grib2 codes to config |
| - | * introducing DataPtr typedef instead | + | * grib output append |
| - | * adding fiConfigOverview.pl script to simplify configuration | + | * 2016-09-27 |
| - | * 2012-07-05 {{: | + | * bugfixes in CDMPressureConversions |
| - | * fixing netcdf-files with 0-terminated strings | + | * bugfixes |
| - | * felt: using undefined-values for undefined levels | + | * 2016-06-16 |
| - | * build on Ubuntu 12.04 | + | * no code changes |
| - | * 2012-05-09 {{: | + | * bugfixes for parallel build |
| - | * enabling build with nc-config and netcdf-4.1.2 to 4.2 without hdf5 | + | * 2016-05-23 |
| - | * enabling build with proj-4.8 | + | * bugfixes: |
| - | * adding latlon projection in gribwriter | + | * CDMInterpolator-> |
| - | * fixing bug in gribreader with special options | + | * problems with get_var_longitude/latitude |
| - | * enabling name and standard_name selection of variables in grib_writer | + | * 2016-04-28 {{: |
| - | * fixing WRF earth radius | + | * performance improvements: |
| - | * 2012-04-11 {{: | + | * implement CDMInterpolator-> |
| - | * using towgs84 parameter of CF-1.7-proposal | + | * vectorize mifi_nanf2bad |
| - | * setting felt earth-figure to simple earth | + | * 2016-04-19 {{: |
| - | * allow overruling of felt-earth-figure | + | * new high-level fortran90 fimex2d API |
| - | * 2012-03-29 {{: | + | * supporting |
| - | * preliminary WRF convention support | + | * enabling parallel grib reading when grib_api build with --enable-pthreads |
| - | * 2012-03-27 {{: | + | * parallelizing FillWriter/ |
| - | * fix colon-separated variable-indicators for felt | + | * lazy error-handling |
| - | * fix axes in vector-interpolation | + | * supporting WRF-output without Times-axis |
| - | * disabling colon delimiter in wdb-sourcestrings | + | * 2016-02-15 |
| - | * performance-improvements/memory reduction | + | * Repository changed to github: |
| - | * adding de-accumulation processor | + | * 2016-01-19 {{: |
| - | * synchronize default fill-value with netcdf | + | * bugfix: extraction |
| - | * fine-tuning usage of surface-variables from felt | + | * 2015-12-21 {{: |
| - | * allowing to force earth-figure in grib-files | + | * improved merge options |
| - | * template interpolation supports several coordinate systems | + | * both inputs fully configurable |
| - | * adding alpha-version of vector to latlon rotation | + | * outer variables may be kept even when no inner exist |
| - | * 2012-03-02 {{: | + | * improved documentation with real world example |
| - | * interpolation to simple list of lat/lon values (e.g. multiple profiles) | + | * adding extract.pickDimension for striding |
| - | * avoid numerical effect in linear interpolation | + | * support for ensembles/ |
| - | * fix race-condition in timeInterpolator | + | * improve performance |
| - | * fix axes of lambert felt-files | + | * fix bug when reading grib-files with < |
| - | * update of examples | + | * no longer reading repeatedly level-data |
| - | * 2012-02-20 {{: | + | * fiGrbmlCat: Fast merger |
| - | * allow to read ASIMOF-grib files | + | * packages with debug-symbols |
| - | * allow writing | + | * avoid too small chunks in netcdf4 |
| - | * fix forward/ | + | * micro-performance optimization |
| - | * 2012-02-14 Fimex Workshop at met.no | + | * 2015-10-26 {{: |
| - | * {{: | + | * grib-indexing with explicit ensemble data and earth figure |
| - | * {{: | + | * using etmerc instead of tmerc for transverse mercator, with proj 4.8.0 |
| - | * [[https:// | + | * better check for simpleSpatial data |
| - | * [[https://dokit.met.no/formatstandard/oversett_felt_cf/ | + | * fixing missing value handling for grib-precision scaling |
| - | * 2012-02-07 {{: | + | * improve MPI-handling |
| - | * enable reading of felt-files in lambert-projection | + | * output.config for fillWriter, allowing special selection of slices |
| - | * improving performance: vectorization | + | * ignore unused dimensions/ |
| - | * deprecating IOCDMReader in favour of CDMReaderFactory | + | * detecting axes mismatch for vector-reprojections |
| - | * 2012-01-04 {{: | + | * 2015-08-28 {{: |
| - | * grib-reader | + | * fixing bug //sometimes no data when interpolating |
| - | * supporting several types of levels for same parameter | + | * 2015-08-25 {{: |
| - | * supporting several horizontal CS for different parameters | + | * **autoremoving unused dimensions when writing netcdf-files**((This change is not backward-compatible and might break commands used after fimex relying on all dimensions |
| - | * grib-writer | + | * require '-c fimex.cfg' to read fimex.cfg files |
| - | * fixing date-settings | + | * avoid double points on cross-sections corners |
| - | * using second-order packing if possible | + | * precision-scaling on grib-data to float-format uses rounding at 1/ |
| - | | + | * allow pressure |
| - | | + | * use subsetting of input data when interpolating to lon-lat points |
| - | * using nanoflann instead | + | * giving about 20x faster response |
| - | * supporting degree-based projections in coord_kdtree | + | * reducing data-transmission to <0.1% on opendap sources |
| - | * configurable radius for coord_kdtree | + | * enabling extractor |
| - | * improved index-access, 1.1*speedup | + | * adding FIMEX_CHUNK_CACHE_SLOTS env-variable for better cache-control |
| - | * bilinear: better border handling, 1.3*speedup | + | * 2015-05-11 {{: |
| - | * vertical: support for depth | + | * fixing problems with metgm-files |
| - | * using WGS84 coordinates | + | * fix bug when changing both scaling |
| - | * extract-reduceToBoundigBox supporting bb around | + | * avoid fetching multiple levels |
| - | * parallelization | + | * 2015-04-23 {{: |
| - | * nn, bilinear, cubic and vector interpolation | + | * adding fiXYcontents script, listing content as horizontal 2d-fields |
| - | * make get*Data* operations thread-safe | + | * new vertical interpolation methods (different extrapolations) |
| - | * make (Time-)Units thread-safe | + | * linear_const_extra, |
| - | * parallelization of NetCDF-writer and NullCDMWriter | + | * using linear_weak_extra for time-interpolation (only 1 timestep extrapolation) |
| - | * upgrade to libtool 2.4.2 (including openmp support) | + | * adding FIMEX_CHUNK_CACHE_SIZE to remove chunk-cache in constraint environments (e.g. webservers) |
| - | * adding ThreadPool.h for runtime configuration of threads | + | * increase precision of units-conversion |
| - | * forcing boost-filesystem api to be compatible with newer boost-versions | + | * fix debian-packages |
| - | * remove isinf - not part of C++03 | + | * grib: fix stepUnits when different |
| - | * 2011-12-01 {{: | + | * grib: handling clusters as ensembles |
| - | * shared connections to wdb databases | + | * changing loop-order when writing netcdf (time, |
| - | * spatial_vector extension in ncml | + | * 2015-02-27 {{: |
| - | * backport of tests to boost 1.34 | + | * convert pressure to altitude using hypsometric formula |
| - | * stabilizing interpolation to netcdf-template | + | * compressed grbml.gz files with fiIndexGribs |
| - | * fixing char-data writing to netcdf | + | * fix limited resolution problems |
| - | * 2011-11-21 {{: | + | * configurable |
| - | * backport | + | * bugfix in RFimex-0.05: closing filehandles |
| - | * enabling build without netcdf | + | * bugfix in interpolator: |
| - | * dropping ensemble_member dimension when only data-version differs in parameter | + | * 2015-01-20 {{: |
| - | * 2011-11-17 {{: | + | * making getDataSlice calls fork-safe |
| - | * fixing vector-projection interpolation of wind-fields | + | * adding example on how to efficiently parallelize multi-field reading with fork |
| - | | + | * possibility to parallelize fimex with MPI and MPI-IO |
| - | | + | * adding forward_undef_* interpolations, |
| - | * adding forgotten functions | + | * improving performance by a factor 8 when reading large grbml files |
| - | * deprecating data.asConstTYPE() methods | + | * avoid segfault when grbml points to non-existing grb-file |
| - | * 2011-11-03 {{:fimex:fimex-0.33.tar.gz|fimex-0.33}} | + | * fix height/ |
| - | * backport to boost-1.34 and gcc 4.2.4 | + | * 2014-12-16 {{: |
| - | * improving build-system, abort when required options are missing | + | * fix correction |
| - | * adding | + | * 2014-12-11 {{: |
| - | * supporting unsigned | + | * creation of one grib-index file for many grib-files |
| - | * removing dependency | + | * new filetype grbml (grib-index file) as reader |
| - | * adding interpolation to netcdf-template | + | * translation |
| - | * projection improvements | + | * read grib-asimov (hirlam) header |
| - | * using DSN syntax to connect to wdb | + | * interpolation with forward_* method now possible if only projection, but not coordinates present |
| - | * allowing CDMFileReaderFactory to read config-files from memory and URLs | + | * fix relative interpolation axis for lat-lon input |
| - | * support ensemble members in felt | + | * height above ground and height above mean-sea level now clearly distinct, use ' |
| - | * adding vcoord | + | * post-processor for interpolation, |
| - | * allowing global parameter restrictions | + | * process: addVerticalVelocity, |
| - | * 2011-09-22 {{: | + | * fixing standard_name of cloud-water |
| - | * switching to metgm-library >=0.93.2, allowing lower memory consumption through slicing | + | * glob: notation |
| - | * faster reindexing in metgm-writer | + | * fix vertical levels for grib ' |
| - | * allowing own fillValue in cdmQualityReader | + | * monotonous longitude axis, even when outside |
| - | * consistent handling of datum (through towgs84-parameters) | + | * fix geographical extraction when multiple coordinate-systems exist in one file |
| - | * allowing different scan-mode in felt-reader | + | * improvements in error messages, filenames on missing/ |
| - | * allowing continuous felt-files (felt-type = 1) | + | * 2014-10-07 {{: |
| - | * using WGS84-ellipsoid world for all data from felt | + | * fix grib-missing-long on 64bit platforms for asimov-files |
| - | * 2011-08-29 {{: | + | * more tests on vector-rotation, |
| - | * fixing global attributes in wdb | + | * fix name of atmosphere_sigma_coordinate |
| - | * improving error-messages in metgm | + | * allow record-dimensions to switch to normal dimensions and vv in NcML |
| - | * improving ncml-output | + | * avoid crashes when data missing |
| - | * configurable | + | * 2014-08-26 {{: |
| - | * 2011-08-22 {{: | + | * ncml-fixes: allow record-dims to change to normal dimensions |
| - | * vertical interpolation to pressure and height from pressure, height, sigma, lnP and sigma_hybrid | + | * interpolator: |
| - | * data-transformations for vertical-levels: | + | * 2014-07-07 {{: |
| - | * logarithmic | + | * many tests for vector-rotation |
| - | * wdb using wdbml setup-format (same as wdb-netcdf-java) | + | * fix bug for flipping vector with some special projections |
| - | * metgm-improved, pre-production | + | * remove some llvm-warnings |
| - | * remove deprecated FeltCDMReader | + | * allow scalar felt-axes |
| - | * 2011-06-16 {{: | + | * 2014-06-24 {{: |
| - | * much improved and production ready [[http:// | + | * improved accuracy of vector-rotation to latlon |
| - | * beta version | + | * Pure north wind, rotated to lcc and back to latlon, scale up to -20% (brightviolet) / 20% (brightred) distortion |
| - | * support | + | * updating build to multi-arch environments (ubuntu 14.04, debian 7) |
| - | * faster build-process / better portability (ported to AIX) | + | * extraKey-selection |
| - | * mercator and lambert projection support in grib-reader | + | * allow absolute/ |
| - | * better handling of netcdf-files | + | * use packingType from gribWriterConfig.xml |
| - | * fixing some memory leaks | + | * fix extract.reduceTime for several time-axes |
| - | * 2011-05-09 {{: | + | * avoid uninitialized ptr in fortran / icc |
| - | * improving ncml-support: | + | * fix cross-sections with more than 2 points |
| - | * improving CDMFileReaderFactory to be better usable | + | * 2014-05-13 {{: |
| - | * better handling | + | * join several levelNo |
| - | * allow slices of scalar | + | * rotation of directions (angles) |
| - | * fix scan-mode | + | * performance improvements |
| - | * refactoring CDMInterpolator | + | * fixes when reading |
| - | * adding fill2d preprocess method | + | |
| - | * improved/ | + | * circular handling of longitude-axes in interpolation |
| - | * 2011-03-22 {{: | + | * fixing interpolation exceptions when coordinates axes are not correctly defined |
| - | * generic usage of udunits2 without udunits1-wrapper | + | * 2014-02-11 {{: |
| - | * felt-reader to allow reading time-independant | + | * adding |
| - | * NC_BYTE variables don't change to NC_CHAR | + | * avoiding singularities in interpolation |
| - | * support +R proj4 parameter | + | * adding variable_type and dimension_size in Fortran |
| - | * grib-reader: use DxInMetres instead of xDirectionInMetres | + | * improving WRF-convention support (rot lat/lon, auxiliary axes) |
| - | * adding all CF1.4 projections: | + | * using CF after horizontal transformation of WRF-files |
| - | * AlbersConical | + | * bugfixes |
| - | * AzimuthalEquidistant | + | * fixing |
| - | * LambertAzimuthal | + | * adding qualityExtract2 command-line option, convenient for land-masking after interpolation |
| - | * LambertCylindrical | + | * 2013-12-16 {{: |
| - | * Orthograhpic | + | * extending f90-interface, including --enable-fortran target |
| - | * VerticalPerspective | + | * extending c-interface |
| - | * improve exception-handling | + | * slightly improving parallelization |
| - | * 2011-02-14 {{: | + | * fix setting of netcdf-compression per variable |
| - | * bugfix in NcmlCDMReader, | + | * improve scanning of grib-files |
| - | * 2011-02-11 {{: | + | * re-implement merging of files to allow for new target-grid |
| - | * improved detection of coordinate-systems with variable-less dimensions | + | * improve reading of WRF-files; better coordinate-support |
| - | * compilation improvements | + | * fix latlon-interpolation with staggered grids |
| - | * alpha version of WDB-reader | + | * add support for logarithmic units |
| - | * enabling setting of unlimited dimension in ncml | + | * fix mercator-axes from grib-files |
| - | * bug-fix in handling of netcdf4 | + | |
| - | * reducing memory consumpting when reading (with unlimited dimension) for opendap | + | |
| - | * 2010-12-03 {{: | + | |
| - | * workaround for compiler-bug in gcc < 4 | + | |
| - | * upgrading build-infrastructure | + | |
| - | * 2010-11-18 | + | |
| - | * reduce memory consumption | + | |
| - | * allow extraction | + | |
| - | * fimex usable as OpENDAP client | + | |
| - | * adding a data-subsetter script | + | |
| - | * fixing edge-cases, fetching of 0-size data | + | |
| - | * back-porting to boost 1.32 | + | |
| - | * adding standard_parallel for lcc projection | + | |
| - | * 2010-09-13 {{: | + | |
| - | * grib-support included | + | |
| - | * adding forecast-reference-time from felt and grib-files | + | |
| - | * use grib-steps to determine valid time | + | |
| - | * using gstmerc istead | + | |
| - | * fine grained library dependencies | + | |
| - | * bugfix | + | |
| - | | + | |
| - | * allowing | + | |
| - | * reading units-initialization only once | + | |
| - | * requiring SSE2 on all i386 machines in debian-packages | + | |
| - | * 2010-06-10 {{: | + | |
| - | * support for transverse mercator and UTM projection | + | |
| - | * support for several standard ellipsoids, e.g. WGS85, NAD83 | + | |
| - | * support for other time-units than epoch-seconds from felt-files | + | |
| - | * including examples in fimex-bin debian package | + | |
| - | * best-effort time selection when writing grib-fields without known time | + | |
| - | * fixing typo in rotated latitude longitude projection | + | |
| - | * fixing | + | |
| - | * 2010-05-07 {{: | + | |
| - | * allow data-slicing along any dimension | + | |
| - | * adding abstract coordinate-systems | + | |
| - | * adding abstract projections | + | |
| - | * better coordinate-system support for CF-1.0 | + | |
| - | * adding mercator projection | + | |
| - | * allow for units compatible to m in CDMInterpolator | + | |
| - | * simplified | + | |
| - | * 2010-03-09 {{: | + | |
| - | * porting to Visual C++ | + | |
| - | * fixing bugs in lambert-projection | + | |
| Older news can be found in the [[archive]]. | Older news can be found in the [[archive]]. | ||