Differences

This shows you the differences between two versions of the page.

--- fimex:faq [2014-09-08 11:45:36]
heikok
+++ fimex:faq [2022-05-31 09:29:32] (current)
@@ Line 9: / Line 9: @@
-===== How can I change the units of an variable? =====
+===== How can I change the units of a variable? =====
 If the original variable e.g. ''t2m'' has units-attribute Celsius and you want to have a new netcdf-file with unit Kelvin, you should use the ''--output.config=cdmWriterConfig.xml'' and define there the new units for the that variable and make sure you defined the datatype of that variable, too.
@@ Line 148: / Line 148: @@
 </code>
+=== OpENDAP and slicing ===
+OpENDAP servers are often limited on how much data can be read at per request, e.g. thredds allows only 500MB binary data / 50MB ascii data per request before failing with an error like
+<code>
+syntax error, unexpected WORD_STRING, expecting WORD_WORD
+context: Error { code = 403; message = "Request too big=19011.0 Mbytes, max=500.0"^;};
+terminate called after throwing an instance of 'MetNoFimex::CDMException'
+  what():  CDMException: NetCDF: Malformed or inaccessible DAP DATADDS
+Aborted
+</code>
-===== Why takes linking with ''g++ -g''  ages? =====
+Fimex tries to subdevide requests into one unlimited slice per variable. Unfortunately, OpENDAP often does not know about 'unlimited' dimension and one has to add that manually to fimex, e.g. for an unlimited time dimension: ''--input.config=unlimitedTime.ncml'' with contents like:
+<code>
+<?xml version="1.0" encoding="UTF-8"?>
+<netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2"
+        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
+		xsi:schemaLocation="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2 http://www.unidata.ucar.edu/schemas/netcdf/ncml-2.2.xsd">
+<dimension name="time" isUnlimited="true" />
+</netcdf>
+</code>
-This happens with older versions of gcc, seen with 3.3 on debian sarge.
-Use ''-gstabs'' or ''-ggdb'' instead of ''-g''. For debugging, this is better suited to c++ code and works with the GNU utils and most other debugger, too. (But unfortunately  not with /valgrind/.
+==== Authentication ====
+In theory, it should be possible to specify username and password
+  - in ''$HOME/.dodsrc'' and ''$HOME/.netrc'' (see below for an example)
+  - as part of the URL for example ''https://XXXX:YYYY@thredds.met.no/thredds/dodsC/....nc''
+Example ''$HOME/.netrc'':
+<code>
+machine thredds.met.no
+    login XXXX
+    password YYYY
+</code>
+Example ''$HOME/.dodsrc'' (replace ''YOURHOME'' with the value og ''$HOME''):
+<code>
+HTTP.NETRC=YOURHOME/.netrc
+</code>
+Unfortunately, this does not always seem to work as expected.
+Known status of OpenDAP authentication support (applies to ''fimex'' and ''ncdump''):
+  * Specifying the password in the URL does not seem to work when the password contains a ''/'', at least for Ubuntu 18.04.
+  * For Ubuntu 16.04 (xenial, EOL), both URL and netrc seem to work.
+  * For Ubuntu 18.04 (bionic), username and password cannot be read from netrc, but can be specified in the URL.
+  * For Ubuntu 20.04 (focal), username and password can only be read from netrc, but cannot be specified in the URL.