Commits · a96066c06d2f42252b3806b1792b36a773fead7c

Bringing up to date the data_converter that fell behind a while ago (for a commented out section of its code).

Improved error message for the new copy mechanism. Currently, this has the following limitation: the parameter to copy must exist for ALL stations and be present for element 0 of each buffer.

Enhancement: It is now possible to duplicate a certain meteo parameter when reading data with MeteoIO. This feature is especially useful when one parameter needs to be filtered in two different ways (e.g. a running average spanning 5 hours and one spanning 48 hours). The syntax to use in your io.ini:

[Input]
COPY::TA2 = TA

This means that a new meteo parameter called TA2 will be added when reading meteo data from an IO source and that this new parameter will be initialized with the value of MeteoData::TA. Thus there is a copy of TA called TA2. This copy can be now used to set up a specific filter:

[Filters]
TA2::filter1 = mean_avg
TA2::arg1 = right 5 3600

Add a setMinBufferRequirements() method to IOManager and BufferedIOHandler. This allows an application to specify its buffering needs. For example, when SNOWPACK runs grass detection, it needs the data up to 48 hours before the first time step to compute some averages. Using this call, SNOWPACK will request at least 48 hours of data in pre-buffering. if buff_before is set to something larger, it will be kept, but if it is set to something smaller, it will be increased.

Necessary changes for the POPC version (added missing files to the autotools, redid marshalling of MeteoData following the changes made in MeteoData)

The documentation has been updated, some error and information messages improved and standardized (to be formatted the same way as with other plugins)

Two new methods have been implemented in IOUtils: bearing(string) that converts a string like "NW" into a numeric bearing and isNumeric(string) that returns true if the given string represents a number.

GSNIO has been modified so that the slope bearing are supported, both numeric and as strings (ie: "SSW" for example). The GSN field "NAME" is also mapped to StationData::name.

Finally, an option has been added to cmake, so the user can chose to compile as static library (now false by default).

And as usual, I forgot to update meteoio.lsm when doing the release...

GSNIO: Cleanup of code, getting rid of code duplication, added comments. Furthermore now the GSN meta data info SLOPE is used to set the slope angle of the station.

Further reduction of the MeteoData class: the setData(Parameter, value) setter has been eliminated and replaced where used with the new parenthesis operator(size_t index).

Performance boost: Redesign of class MeteoData. The individual public double members like tss, ta, rh have been removed and instead of the rather complicated internal representation with the help of std::map and pointers, the MeteoData object now holds all its important information in one double vector (meteo data) and one string vector (parameter names). Thus the overloaded copy constructor could be slashed radically. This leads to huge performance gains, especially when dealing with huge vectors of MeteoData (which are needed for filtering, resampling, etc).

Furthermore the access to the meteo parameters has been simpleified by overloading the operator(), replacing the old .param(size_t index) and .param(string paramname) functions:

MeteoData md;
double ta = md(MeteoData::TA);

OR

double ta = md("TA");

These changes were propagated into all of MeteoIO.

GSNIO: Added support for RAIN_METER (HNW), SURFACE_TEMP (TSS) and SOLAR_RAD (ISWR) - possibly other values will need to be added.

ISSUE: GSN has up to two measurements per minute. We need to find a way to deal with this elegantly in the SMET output (currently only displaying minutes and not seconds for the timestamp), internally the julian date is used for comparisons.

SMETIO: Further development of the writeMeteoData procedure. Now all meteo parameters present in the MeteoData objects can be written (so not only the standard ones like MeteoData::TA, MeteoData::RH, etc). This lead to a slight reorganization of the code. Comments were added for private member functions.

GSNIO: More comments explaining the mapping between the GSN meteo data fields and the MeteoData meteo parameters.

The GSN plugin is now capable of dealing with OLWR correctly, i.e. it is used to calculate TSS if TSS is IOUtils::nodata.

GSNIO.cc: changed the way we convert a double value to time_t.

Files that were relevant for the old A3DWebService (replaced by GSNWebservice) are irrelevant now and thus deleted.

GSNIO plugin: no more need to include the gsoap++ library, this makes the compilation on Windows a lot easier. Instead of the library the file stdsoap2.cpp, with an implementation of all the library functions is directly included in the gsn folder. It is compiled and linked into libgsnio when PLUGIN_GSNIO is set to ON.

The installation for Windows as well as the autodetection have been improved (ie: they now work out of the box automatically). The calls to Date::set(0,0) have been removed since we now have Date::undefined.

The new GSN plugin, this version is developed for LINUX only, WINDOWS and MACOS adjustments will follow. The default data server is planetdata.epfl.ch, but can be changed by setting the ENDPOINT manually in the [Input] section of your io.ini. With this plugin MeteoIO can be used to pull data from any GSN server running the GSN webservice.

This first version of the new GSN plugin still has a few issues, such as dealing correctly with OLWR and HNW.

Example of a working setup:
[Input]
COORDSYS        = CH1903
TIME_ZONE       = 1

METEO = GSN
STATION1 = wan1
STATION2 = wan6

The icons have been reworked, in order to more or less match the Microsoft specs (but since my version of XP does not properly handle the full specs, I kept it as simple as possible). The bmp files are therefore not necessary anymore.

The FindMeteoIO script now properly reads the registry on Windows and therefore autodetection now works on Windows.

Removed some unecessary variables in exceptions catching (this should remove VC++ (rightful) warnings).

Some Visual C++ warnings have been turned off (namely, that it can not generate a copy constructor) in MeteoIO.h, so each application using MeteoIO would benefit from it (and avoid being polluted by unecessary warnings). 

Exception catching is now done by const reference, as recommended in our coding style.

The CMakeLists were not making Visual C++ happy. This has been fixed. Several types issues have been fixed. The /Wp64 option of Visual C++ has been turned off, since it reports wrongly some things as errors (dixit Microsoft and my own experience).

The OLWR hack for Norway has been implemented in SMETIO (a cleaner, long term solution will still have to be developed). Various types issues have been identified by Visual C++ and should have been fixed.