Commits · f7049d537e7dcf6a372c4cccff764d9c9f8d5d3e

SNIO throws an exception if the user specified a METAFILE that does not exists/is not valid. ARPSIO was wrongly reading grids (wrong layer for DEM and swapping x and y)

A new method, getExtension() has been added to IOUtils in order to return the extension of a given filename. This is used by the SMETIO and SNIO plugins to automatically add the proper extension to input file names if they don't already have one.

The Median Average Deviation filter has been ported (and validated) to the new filtering infrastructure.

Several error messages have been improved.

SNIO.cc:173-176 Allow to read meta data from either *.sno (smet-format) or *.snoold (snowpack-format) if METAFILE is either not provided or not found

Because POPC does not properly support std::cout and requires cout instead, this has been fixed in the code, with the necessary "using namespace" added. Only one std::cout remains (in IOUtils) and will be removed if absolutely necessary later.

SNIO: Change of Config keys, the following keys are relevant now for reading meteo data and meta data:
METEOPATH:  Path to the meteo files directory
STATION#: Specifies the meteo data file for station number #
METADATA: Specifies the file with meta data for all meteo data files

Note that NROFKEYS is no longer necessary and METEOFILE# has been replaced by STATION# to be more consistent with the other MeteoIO plugins.

ImisIO: The key NROFSTATIONS is not required anymore and not parsed by ImisIO - the plugin now simply looks for STATION1, STATION2 and so on in the config object until a certain key STATION# can not be found.

Reverting the last change: In all plugins the goal is to use the keys STATION1, STATION2, etc to denote the individual sources for meteo data.

Fixed a bug in array /= <scalar>. A piece of old code had been left behind, so it was dividing twice...

Bringing up to date the data_converter that fell behind a while ago (for a commented out section of its code).

Improved error message for the new copy mechanism. Currently, this has the following limitation: the parameter to copy must exist for ALL stations and be present for element 0 of each buffer.

Enhancement: It is now possible to duplicate a certain meteo parameter when reading data with MeteoIO. This feature is especially useful when one parameter needs to be filtered in two different ways (e.g. a running average spanning 5 hours and one spanning 48 hours). The syntax to use in your io.ini:

[Input]
COPY::TA2 = TA

This means that a new meteo parameter called TA2 will be added when reading meteo data from an IO source and that this new parameter will be initialized with the value of MeteoData::TA. Thus there is a copy of TA called TA2. This copy can be now used to set up a specific filter:

[Filters]
TA2::filter1 = mean_avg
TA2::arg1 = right 5 3600

Add a setMinBufferRequirements() method to IOManager and BufferedIOHandler. This allows an application to specify its buffering needs. For example, when SNOWPACK runs grass detection, it needs the data up to 48 hours before the first time step to compute some averages. Using this call, SNOWPACK will request at least 48 hours of data in pre-buffering. if buff_before is set to something larger, it will be kept, but if it is set to something smaller, it will be increased.

Necessary changes for the POPC version (added missing files to the autotools, redid marshalling of MeteoData following the changes made in MeteoData)

The documentation has been updated, some error and information messages improved and standardized (to be formatted the same way as with other plugins)

Two new methods have been implemented in IOUtils: bearing(string) that converts a string like "NW" into a numeric bearing and isNumeric(string) that returns true if the given string represents a number.

GSNIO has been modified so that the slope bearing are supported, both numeric and as strings (ie: "SSW" for example). The GSN field "NAME" is also mapped to StationData::name.

Finally, an option has been added to cmake, so the user can chose to compile as static library (now false by default).

And as usual, I forgot to update meteoio.lsm when doing the release...

GSNIO: Cleanup of code, getting rid of code duplication, added comments. Furthermore now the GSN meta data info SLOPE is used to set the slope angle of the station.

Further reduction of the MeteoData class: the setData(Parameter, value) setter has been eliminated and replaced where used with the new parenthesis operator(size_t index).

Performance boost: Redesign of class MeteoData. The individual public double members like tss, ta, rh have been removed and instead of the rather complicated internal representation with the help of std::map and pointers, the MeteoData object now holds all its important information in one double vector (meteo data) and one string vector (parameter names). Thus the overloaded copy constructor could be slashed radically. This leads to huge performance gains, especially when dealing with huge vectors of MeteoData (which are needed for filtering, resampling, etc).

Furthermore the access to the meteo parameters has been simpleified by overloading the operator(), replacing the old .param(size_t index) and .param(string paramname) functions:

MeteoData md;
double ta = md(MeteoData::TA);

OR

double ta = md("TA");

These changes were propagated into all of MeteoIO.

GSNIO: Added support for RAIN_METER (HNW), SURFACE_TEMP (TSS) and SOLAR_RAD (ISWR) - possibly other values will need to be added.

ISSUE: GSN has up to two measurements per minute. We need to find a way to deal with this elegantly in the SMET output (currently only displaying minutes and not seconds for the timestamp), internally the julian date is used for comparisons.

SMETIO: Further development of the writeMeteoData procedure. Now all meteo parameters present in the MeteoData objects can be written (so not only the standard ones like MeteoData::TA, MeteoData::RH, etc). This lead to a slight reorganization of the code. Comments were added for private member functions.

GSNIO: More comments explaining the mapping between the GSN meteo data fields and the MeteoData meteo parameters.

The GSN plugin is now capable of dealing with OLWR correctly, i.e. it is used to calculate TSS if TSS is IOUtils::nodata.

GSNIO.cc: changed the way we convert a double value to time_t.

Files that were relevant for the old A3DWebService (replaced by GSNWebservice) are irrelevant now and thus deleted.

GSNIO plugin: no more need to include the gsoap++ library, this makes the compilation on Windows a lot easier. Instead of the library the file stdsoap2.cpp, with an implementation of all the library functions is directly included in the gsn folder. It is compiled and linked into libgsnio when PLUGIN_GSNIO is set to ON.