Code cleanup in NetCDFIO (as well as mapping for the Albedo grids), extra code comment in data_converter.cc

More includes cleanup and code cleanup in the plugins (getting rid of the "stationindex" thing that was pretty much deprecated in all plugins)

First fixes for NetCDF so it could be used by Alpine3D: a bug when handling precipitation grids has been fixed (nodata now remain nodata) and the data packing has been removed (since when appending new grids it can simply not work). A future alternative could be "bit shaving", see https://www.unidata.ucar.edu/blogs/developer/entry/compression_by_bit_shaving .

A small bug has been fixed in the SMET specs. The experimental "UnShade" filter has been removed while the SNOS filter has been renamed as "DETECT_GRASS" and MAX_CHANGE as "Time_Consistency" in order to better reflect the cited paper. The NOISE processing is now documented. Otherwise, some documentation typos have been fixed.

Documentation fixes and slightly improved kml files that now contain the station elevation in the point description

A bug has been found in NetCDFIO: it should look for the GRID2D key, not the METEO key! In Coords, the lat/lon are checked for validity in setLatLon() in order to catch grossly out of range coordinates (as was found on the Snowpack operational system for a few stations).

In order to add 3D grid reading/writing methods to the plugins, the whole architecture of IOInterface has been changed: this is not a purely virtual class anymore, it now always implements the "nothing implemented here" exception. This makes the plugins more compact (there is no need to implement empty methods for what the plugin can not support) and much clearer. The documentation and template have been changed acoordingly.

A bug has been fixed: there was a confusion between the mean adiabatic lapse rate and the dry one. Small code cleanup in DEMObject (with a better toString() method), ARPSIO and ProcShade.

Now GSN uses the virtual sensor name as station_id, making it much more logical when using exclude/keep/merge statements. The NetCDF plugin does not require anymore to be configured for the inputs in order to produce output grids. Otherwise, code and documentation cleanup.

More documentation about ECMWF and MeteoCH as well as a new name that is tried when looking for a DEM grid: "height"

Fixed an initialization bug that always tried to setup downscaling... Slightly better documentation about exploring the parameters of a NetCDF file.

More documentation improvements... Now it should be quite straightforward to build downscaled time series for virtual stations based on Era Interim.

Added a documentation section about Era Interim. In the ECMWF schema, the "Albedo" parameter has been replaced by the "Forecast albedo" parameter has it simplifies data retrieval.

A bug has been fixed in the NetCDF plugin that prevented reading some DEMs. The ability to remap parameters (between NetCDF and MeteoGrids) in the ini file has been added in order to add flexibility. The support for "years" and "months" time units has been implemented in a way that is compatible with the standard NetCDF tools.

The NetCDFIO plugin can now properly handle multiple files in one directory specified by "GRID2DPATH" or one single file specified by "GRID2DFILE". Small code cleanup in CNRMIO and CosmoXMLIO.

A new MeteoGrid has been created, RSNO to contain the snow mean density. This is used in NetCDF in order to handle more fields and therefore extract the snow height from ECMWF data sets.

Several exceptions have been renamed in order to be more generic (ex: instead of FileNotFound -> NotFound) and their text has been modified accordingly. The GSN plugin now reports the errors with more relevant details (invalid sensor name, no permissions).

Code cleanup and fix for IMIS: now the ENET stations receive the number 1 for the automatic stations instead of 0.

Finally, a long awaited (and MAJOR) change: HNW is gone, it is now PSUM. This name should be clearer and every occurences of "HNW" (even in temporary variables or algorithms) have been replaced by psum. A check is performed on keys containing "hnw" and an exception is thrown if some are found, urging the user to update the ini file. Please keep in mind that the calling codes have to now refer to MeteoData::PSUM and that some algorithms are now named differently!

Trying to close some potential security flaws (using FlawFinder). All files opened for reading are now checked and special files (devices, etc) are refused.

Data packing has been implemented (packing from "double" to "int"). The loss of precision is fully negligible with practical data (1/10 of a mm on an Europe-wide DEM for example) while leading to 50% smaller file sizes.

Grids can not properly be written out. The data packing is not supported yet and the units handling is still not finished (accumulated values are tricky to handle from within MeteoIO).

The reading support is now more generic: the time units are read and parsed from the file. The units are always corrected when necessary. If no date is provided and the file only contains the grid at one time step, it will be read by default. The DEM extraction from pressure data now works properly for any file (ie no more hard coded dates).

Removed some commented out code, improved some documentation and recomputed a test that had been invalidated by changing the implementation of the HNW_Snow spatial interpolation method.

Some doxygen comments have been improved, A few physical constants have been added. The DEM extraction from pressure fields in NETCDFIO has been improved (the previous calculation was mostly wrong).

All the PNGs that we written were corrupt: the first line of data was missing. This has been fixed. for NetCDF, the ability to calculate the altitude from the pressure (and sea level pressure) has been added with a controlling key. This is not very precise but this could help for troubleshooting problems when no DEM has been provided (such as with ECMWF data sets).

A new date format has been added: RFC868. Two MeteoGrids have been renamed: ISW_DIR as ISWR_DIR and ISW_DIFF as ISWR_DIFF while a new grid has been declared (P_SEA). A few new constants have been declared. Some new links into the GRIB documentation as well as support for TAU_CLD. The NetCDF support is much improved, although there are still things left to do (writing grids out has been disabled for the moment, the parsing of the time units is currently not done, there is no support for automatically getting the data out of multiple files in a directory, etc).

Several warnings have been fixed. The (slightly) wrong geolocalization calculation such as found in fixed in NetCDF has also been fixed in GRIB. A bug that was preventing GRIB DEM from being read has been fixed.

The CNRM plugin can now be enabled and properly works. Its documentation has been updated and improved. The NetCDF plugin can now read DEMs using various schema/conventions and its documentation now matches the code. A few more MeteoGrids have been defined that are required for meteorological model outputs and for some future spatial interpolations (ISW_DIR, ISW_DIFF for example). The PNG plugin creates a few more EXIF fields in order to make it very easy to integrate in google earth (but it seems that google earth does not like indexed pngs). A bug computing the geolocalization of grids coming from NetCDF has been fixed (all grids were slightly off).

Some threshold were making trouble for very high resolution simulations with Winstral, they have been changed. A broken link has been fixed in NetCDFIO.