Now testing the array1d<double>. The Undercatch filter has been renamed as Undercatch_wmo so we can offer competing models (hint: Hamon 1973).

Two new members have been added to Grid3DObject, to store the heights of the 3D levels (ie: level 1 = 10m above ground, etc). This is similar as what is done by ARPS, GRIB, etc A boolean specifies if these are absolute or relative heights (ie: above DEM).

The unventilated temperatures filter and unheated rain gauge filter have been renamed. The "soft" option has been added to Unheated_RainGauge. And the usual documentation fixes...

The last filters that had not been ported to the new filtering infrastructure have been ported and their documentation updated. All filters now use window specifications (instead of vector of pointers). The misleading filter argument "index" (for parameter type) has been renamed as "param" for all filters. The use of "unsigned int" for looping over vectors has been replaced by "size_t". The old "soft" behavior for the filters has been restored (ie: if not soft, a point that can not be checked by the filter is deleted).

A few more "consts" have been added.

Checked the Passive_T filter on real data, added more flexibility to it (ie: it can compute the albedo using iswr and rswr, compute rswr from iswr and an albedo, etc) and fixed some mistakes. It now gives realistic results but a proper validation (ie: comparing with high quality, ventilated measurements) is still required.

The Passive_T filter has been reworked and renamed as ProcPassiveT. A proper documentation has been written for it.

All the cout have been replaced by cerr in order to avoid messing with the end user's application. Some old commented out code has been removed.

Another fix/enhancement for POPC: the libraries now ends with "popc" in the popc version, as the autotools build was doing.

Windchill and heat index have been implemented in Atmosphere.

Some cleanup in the filters, some code moved to ProcessingBlock, so that elements that are not filters can inherit ProcessingBlock and get all that it needs. A processing element has been implemented to multiply by a given constant, another one to add a given offset and another one to correct precipitation for undercatch.

Some invalid doxygen comments have been fixed in MathOptim.

The "RateFilter" filter has been renammed "FilterRate" in order to be more consistent with other filters (this does not change anything user-side). A new filter has been created, HNW_MELT. This applies the Snowpack criteria on a precipitation measurement: if relative humidity is not high enough or TA and TSS too far apart, it is considered that any measured precipitation comes from snow melting in the (unheated) rain gauge, therefore the measurement is deleted.

The last occurences of NROFSTATIONS have been deleted in BormaIO, closing issue 163.

Some code cleanup took place in CosmoIO and FilterMax.

In IMISIO, a new option and behavior has been implemented to properly manage precipitation measurements: ANETZ stations keep their HNW (they are considered reliable). IMIS stations by default don't produce HNW anymore. A key (USE_IMIS_HNW) can force using them, but a detection of winter conditions (ie: TA>0 and TSS>0) removes measurements known to be invalid. If neither TA nor TSS are available, then HNW is deleted (in order to prevent injecting HNW=0 in the system during a freeze event if the station would happen to miss TA and TSS). USE_IMIS_HNW should always be followed by the HNW_MELT filter.

A new method, getExtension() has been added to IOUtils in order to return the extension of a given filename. This is used by the SMETIO and SNIO plugins to automatically add the proper extension to input file names if they don't already have one.

The Median Average Deviation filter has been ported (and validated) to the new filtering infrastructure.

Several error messages have been improved.

A bug has been found in the processing of the variance: we were using a naive formula that is ill-fitted to signals showing small variations around a large mean. This lead to catastrophic cancellation and negative values... This has been replaced by a (slower) compensated formula (that works in two passes). The standard deviation filter has been fixed. 

The Tukey filter has been brought back into the new infrastructure and should now be usable. However it is not suitable to snow heights: in such a case, the standard deviation is too small (or even zero) and the signal might show some sudden variations (like in the case of a snow fall) that would therefore be falsely rejected. This filter seems much better suited to wind speeds that exhibit some constant background noise, thus a non-null standard deviation.

The rate filter can now take 2 arguments: in such a case, the first one is the minimum rate and the second the maximum rate. This would allow to define a descent rate different from the climb rate.

Several error messages have been improved in A3DIO and general plugin loading.

Finally, two small tools for working with smet files have been contributed, one allowing transparent loading of smet files in xmgrace (smet2agr). And the example io.ini has been fixed (it had been broken and was not working with the examples anymore)

In SNIO, the METAFILE can now be optional (which means that the metadata remain nodata, the user has therefore to fill them himself). This is used by Snowpack.

After the Visual C++ compilation log from Raphael, some changes have been implemented: lots of warnigs about signed/unsigned fixed, some unreachable code removed, and some methods reimplemented for Windows. We are not there yet, but moving closer...

The WIND_AVG filter has been ported. The problem is that it is not possible to get at the same time VW and DW. This will have to be fixed later... 

More documentation has been written. 

Documentation update. A new section "how to build your io.ini configuration file" has been added to the end user section of the documentation.

The Standard Deviation filter has been moved to the new structure. Some optimizations for windowed_filters will have to be implemented at some point... (see issue 132 for some ideas)

The full support for timezones has been brought back. This fixes issue 71. The SMET, SMET, IMIS, BORMA plugins have been validated. Geotop should be validtaed if an input data set is available. A new class will have to be implemented to represent time periods. This is currently only a typedef pointing to the Date class, but a specific class would be welcomed.

GSN has been fixed for some changes on the web service, but does not retrieve the correct timestamps (is this a GSN issue?). The GSN compilation has been improved: the warnings related to GSOAP have been removed. 

A new long wave radiaiton model using cloudiness as input has been added (Omstedt, 1990). 

The min and max filters have been implemented. The "how to write a filter" documentation page has been updated to relfect the latest changes. The operator << has been implemented for various objects involved in the data processing.

[Filters]
RH::filter1 = rate
RH::arg1 = 0.01

Further improvements to the new filtering infrastructure: windowed filters now inherit from the class WindowedFilter, giving them an easy handle on getting the correct window for every data point. FilterMedianAvg and FilterMeanAvg now fully implemented (soft/not soft, left/center/right windowing). Sample io.ini:

[Filters]
TA::filter1     = mean_avg
TA::arg1        = soft right 5 3600
TA::filter2     = min_max
TA::arg2        = soft 282 286 280 290

RH::filter1     = median_avg
RH::arg1        = center 8 3600

New filter system rolled out with currently two filters up and running: min_max and mean_avg (without the soft option, only left or right centering). The new filter system is built upon processing blocks that take a vector<MeteoData> as input and return a processed vector<MeteoData>. The individual filters are stacked in a ProcessingStack where they are invoked sequentially.