GitLab

The exclude / keep files were not properly handled in order to be case insensitive. This has been fixed in order to be consistent with the KEEP/EXCLUDE statements. The default buffer centering has been changed to 5% (more logical for the usual use cases).

the key BUFF_CHUNK_SIZE has been renamed as BUFFER_SIZE for more clarity and its default value is now 370 (which makes more sense for most applications). Some documentation about it has been written.

Now the dataCreators are defined in the [Input] section with a {parameter}::create = {algorithm} statement. They behave the same as the dataGenerators but are called *before* the filtering takes place and always work with the whole vector of data (ie whole dataset). In order to make life easier for the devs, a new structure will be devised...

Introduced the basic structure that will be required to build a new plugin to read Matlab files prepared by the OSHD project/service. This is not usable yet but should come quite soon.

A bug in the MeteoData::mergeTimeSeries() method has been fixed that was related to the handling of extra parameters. The SHADE filter can now compute masks directly from the DEM, but this has required to propagate the Config object all the way down to the filter. Some minor code cleanup and documentation fixes.

Please notice that the SHADE filter is currently only appropriate for a single station! The most probable use case is to merge different stations into a new location (or to downscale to a new location) and properly mask the radiation by the surrounding terrain.

A few extra comments have been added to better understand the flow of data. The "merge" feature was not properly handling all situations, this should now be fixed.

Code cleanup and fix for IMIS: now the ENET stations receive the number 1 for the automatic stations instead of 0.

very minor code cleanup, some comments were wrong and have been fixed, a wrong debug message has been fixed (in toString())

A gridBuffer class has finally been implemented (basically, moving the old grid buffering code into it) and is now in use for the GridsManager. An invalid file name in the examples has been fixed and a toString() debug message has been improved in the TimeSeriesManager.

The Buffer class is now used to buffer meteo time series. Since this is not (yet) a proper ringbuffer, all data is erased before pushing more data into a buffer (similarly to what it was before this commit). It has been tested with data_converter on numerous data (including with virtual stations) as well as with snowpack on operational stations.

Following a bug report from GeoTop, the add_to_cache() method that had been partially removed is now back, under a slightly different name: add_to_points_cache(). Otherwise, white spaces, copyright headings were modified and some pragmas added for VC++ in GSNIO and CosmoXMLIO.

In order to make it more modular and allow more advanced processing (virtual stations, downscaling, multiple io sources) the IOManager is now a proper wrapper: the processing is fully delegated to either a GridsManager or a TimeSeriesManager. These can in turn be reused at some other places (like in the Meteo2DInterpolator) to offer full buffering and processing of "local" time series. The buffering is now done by these two new classes (therefore the BufferedIOHandler class has been removed) and it is planned that dataClasses will be implemented for proper ringbuffers (one for time series, one for grids and one for isolated points) and receive the generic buffering code later on. 

A new fastPow(double, int) has been implemented for positive exponents. The begining of a generic handling of units also appeared in IOUtils. Finally, the ProcessingLevels are now defined in IOUtils instead of IOManager.