Commits · 1adfbb727c3b1658e8e7e263f00fa3f9625b7dec

GSNIO: Added support for RAIN_METER (HNW), SURFACE_TEMP (TSS) and SOLAR_RAD (ISWR) - possibly other values will need to be added.

ISSUE: GSN has up to two measurements per minute. We need to find a way to deal with this elegantly in the SMET output (currently only displaying minutes and not seconds for the timestamp), internally the julian date is used for comparisons.

SMETIO: Further development of the writeMeteoData procedure. Now all meteo parameters present in the MeteoData objects can be written (so not only the standard ones like MeteoData::TA, MeteoData::RH, etc). This lead to a slight reorganization of the code. Comments were added for private member functions.

GSNIO: More comments explaining the mapping between the GSN meteo data fields and the MeteoData meteo parameters.

The GSN plugin is now capable of dealing with OLWR correctly, i.e. it is used to calculate TSS if TSS is IOUtils::nodata.

GSNIO.cc: changed the way we convert a double value to time_t.

Files that were relevant for the old A3DWebService (replaced by GSNWebservice) are irrelevant now and thus deleted.

GSNIO plugin: no more need to include the gsoap++ library, this makes the compilation on Windows a lot easier. Instead of the library the file stdsoap2.cpp, with an implementation of all the library functions is directly included in the gsn folder. It is compiled and linked into libgsnio when PLUGIN_GSNIO is set to ON.

The installation for Windows as well as the autodetection have been improved (ie: they now work out of the box automatically). The calls to Date::set(0,0) have been removed since we now have Date::undefined.

The new GSN plugin, this version is developed for LINUX only, WINDOWS and MACOS adjustments will follow. The default data server is planetdata.epfl.ch, but can be changed by setting the ENDPOINT manually in the [Input] section of your io.ini. With this plugin MeteoIO can be used to pull data from any GSN server running the GSN webservice.

This first version of the new GSN plugin still has a few issues, such as dealing correctly with OLWR and HNW.

Example of a working setup:
[Input]
COORDSYS        = CH1903
TIME_ZONE       = 1

METEO = GSN
STATION1 = wan1
STATION2 = wan6

The icons have been reworked, in order to more or less match the Microsoft specs (but since my version of XP does not properly handle the full specs, I kept it as simple as possible). The bmp files are therefore not necessary anymore.

The FindMeteoIO script now properly reads the registry on Windows and therefore autodetection now works on Windows.

Removed some unecessary variables in exceptions catching (this should remove VC++ (rightful) warnings).

Some Visual C++ warnings have been turned off (namely, that it can not generate a copy constructor) in MeteoIO.h, so each application using MeteoIO would benefit from it (and avoid being polluted by unecessary warnings). 

Exception catching is now done by const reference, as recommended in our coding style.

The CMakeLists were not making Visual C++ happy. This has been fixed. Several types issues have been fixed. The /Wp64 option of Visual C++ has been turned off, since it reports wrongly some things as errors (dixit Microsoft and my own experience).

The OLWR hack for Norway has been implemented in SMETIO (a cleaner, long term solution will still have to be developed). Various types issues have been identified by Visual C++ and should have been fixed.

More size_t related issues have been found (thanks to the new snowpack server) and fixed. Basically, please remember that any variable used with/for the return value of a call to size() MUST be of type size_t (this becomes specially relevant in 64 bits).

The water triple point pressure has been updated to a better value.

Cleaning up the CMakeLists, adding a version string as well as a new method: getLibVersion() to get the said version string (with compilation date and time). A BuildVersion cmake macro has been written and will be shared with snowpack (and later with alpine3d).

Several HACKS have been removed (either the HACK had been fixed but the comment was still there, or it has now been fixed, or after more (careful) consideration, it has been decided that the HACK was not a HACK)

Better error messages when compiling in debug as well as for dimensions issues (adding arrays of incompatible dimensions, invalid subset, etc)

The VW_MAX field was not properly handled in SMETIO. The failure count has been slightly improved in SNIO (to decrease the number of failures when a model could recover: if ILWR is not provided but TSS is, we don't count it as a failure anymore). 

The implementation of the krigging is moving forward. A bug has been found and fixed in Fit1D, a variogram is now computed (but not using a true covariance, which prevents our krigging from properly working). 

The #define NOSAFECHECKS have been deleted and replaced by a definition by the CMakeLists when in debug mode. This means that when compiling in debug mode, the code will be quite slower but will properly check and report out of bounds access in tables and matrix.

A Fit1D object is now created by specifying which regression model to use through an enum. Assignment operators as well as copy constructors have also been implemented (and tested).

The config.dox file has been updated by doxygen to match more recent doxygen versions and syntax.

An update of libsmet. Added SMETReader::get_filename() and SMETReader::get_header_intvalue(string key) with which a header value can be directly converted into an integer.

Added libsmet.h to MeteoIO.h

2) Speedup when reading large SMET ASCII files

A new library for dealing with SMET files has been developed. The plugin SMETIO builds on top of this library now. It provides:
- A SMETReader class, to read SMET files and parse the header info
- A SMETWriter class to write SMET files and set the header info

The SMET library (libsmet.h and libsmet.cc) are completely independent from the rest of MeteoIO. They have their own exception handling and helper functions, thus they can easily be distributed to other parties wishing to read and write SMET files with C/C++.

A (more) intelligent handling of buffered grids has been implemented: the grids are stored in the equivalent of a circular buffer of a given size (user defined, or 10 by default). This prevents running out of memory when processing large numbers of grids!

A method for computing quantiles has been implemented in libinterpol1D. A vector of data has to be provided as well as a vector of the desired quantiles (ex: 0.25, 0.5, 0.75) and a vector of values for these quantiles will be returned. So far, the algorithm that is used produces the same results as R in default operations. The possibility of choosing which quantiles algorithms might be added in the future.

The getJulianDayNumber method was just totally wrong... This has been fixed. One can also force a GMT day of year with a flag.

Finally, some documentation has been written/updated.

Some methods have been moved into another class (like the simple linear interpolation between two points that is now in ResamplingAlgorithms), some renammed (like the new weightedMean that replaces the ill-nammed "linearInterpolate"). The regression model based on two segments is now part of libinterpol1D and has been renammed. More regression models have been implemented. 

The "initFit" method of Fit1D has been renammed in "fit" and the setGuess method now turns fit_ready to true, so that a user can force his provided parameters to be used by a given model (do a setGuess() with the parameters, then call f(x) without calling "fit", so no internal fit of the parameters would be performed).

Reorganizing all the statistical elements... this commit won't compile, this is just to move files around. Wait for next commit before updating!

Bugfix: The nr_stations variable was not initialized in all use cases but then used to resize vec_streampos. This lead to a std::bad_alloc and a seg fault when trying to load SMETIO for writing only (in_meteo != "SMET").

Speed optimizations when reading data with the GEOtop plugin are now more elaborate. This leads to significant performance gains when reading meteo data in GEOtop format.