Commits · 40a6803375d6706a2a73d41e1acab93e3ac0f172

Bringing MeteoIO and SNOWPACK installers closer to one another (by creating a proper documentation group for components install)

cpack can now build a package without documentation (unfortunately, there's no way to give a warning). The cmake module FindMeteoIO has been much improved for Mac and for Windows. It now looks at several registry keys in Windows and builds possible search paths out of them. It should therefore now be more robust.

Hopefully, a (slightly) more sensitive fix (there is no need to apply any correction to a null wind speed!)

An extra check on the timestamp has been added in SMETIO in order to throw an exception for duplicated timestamps or non chronological order (as happens with daylight saving time). Some private methods in libinterpol2D as well as some () operators for the arrays are now inline in order to help autovectorization find more potentially vectorizable code (and it finds some more). An arithmetic exception could happen in FilterRate (division by 0) and has been fixed.

If the speed is equal to 0 (exactly) we assume a small speed of 0.01 m/s.

Otherwise a division by zero would occur because:
u = (-1.) * (speed * sin(dir));
dir = (1.5 * Cst::PI) - atan(v/u);

The usage of SMET for giving special points was not documented. When giving OLWR in SMET, TSS was computed but could lead to an arithmetic exception. PNGIO could throw an exception without freeing all the png_* memory, this has been improved. A few HACKS have been fixed/removed.

Some improvements for allowing the ARPS plugin to read u, v, w, etc from an ARPS file. Unfortunatelly, files edited with ARPSGRID are stripped of all markup for fields, so they are currently not supported. It also seems that not all files contain all possible fields, and even if they would, they would still miss some important field (like TA, RH, etc). This is therefore of little practical interest...

Reading data temporal validity was not working for forecast data, that uses more complicated validity model (and I missunderstood how the validity was expressed). This is now fixed and works both on COSMO reanalysis and forecast data (and it is way more complicated and bloated as I ever imagined...).

The wind fields are now all properly corrected for the rotated grid, including U and V. The VW and DW fields are even cached since they might be accessed several times for a given time step.

The geolocalization is now read right after indexing the file and then kept in cache when accessing files by index. The bearing offset required for vector field is now computed and properly applied (except for U and V grids where it is not done yet).

Fixed a naming issue with ARCIO, the cellsize is now computed in a more precise way (using the distance betweens two corners) as recommended by WMO and the distance calculations from Coords are now static methods.

Deleting duplicate points in GRIB was not working properly. The output time zone was not handled correctly in SMET. Some error messages have been improved.

GRIB_PREFIX is now optional, the virtual station lines can now contain comments (useful for giving a location description) and the plugin help text has been improved with some compiling requirements.

A3DIO was not yet working as a true plugin. This should now be fixed. GRIBIO was imposing a "GRIB_EXT" key, it is now optional.

A3DIO is now a plugin like any other, that is built by default but can also be disabled. The plugins are now listed in alphabetic order by ccmake.

The file extension (or none) can now be specified for GRIBIO. This is necessary for MeteoSwiss files that have no extensions. Better error messages in libsmet (by catching and rethrowing exceptions).

The correction for undercatch from Japan has been fixed and renamed in "RT3_Jp". A readLineToVec(line, vec_double) has been added to IOUtils (it is much faster, if possible, to read directly as a vector of double than to read as vector of strings and then convert the strings to doubles).

The lat/lon rotation code has been moved to Coords as a static method and some issues have been fixed (it was still not working properly). This should now work and handle correctly the South Pole coordinates as given by the GRIB file (the necessary transformation has been documented in Coords, namely -latitudeSouthPole; 180+longitudeSouthPole).

Some documentation fixes, new gradients (black to white, white to black and blue-white-red) defined and used for new variables in PNGIO (P, ALB and DW). A bug has been fixed for ILWR in GRIBIO as well as a bug when converting geographic coordinates to rotated ones.

New options have been added to the undercatch filter, allowing to specify the temperature thresholds with the CST argument (to make it more similar to GeoTop).

The << operator for Coords has been slightly improved. The Gradient class now generated true-color output when indexed=false (and is used to generate true-color PNGs when PNG_INDEXED=false).

The GRIBIO plugin now reads a file name prefix from io.ini. It also properly convert the internal rotated lat/lon into geographic lat/lon and properly computes cell size. The georeferencing of grids is therefore now correct. The WMO standardized tables are now read first before trying alternate parameters. The documentation has been significantly improved.

I got bugged by a general slowness of ARCIO when reading grids... After re-writing the core loop (not calling readLineToVec anymore, not calling convertString anymore, thus bypassing a lot of checks that are not necessary in the context of reading a grid), reading a large grid is almost 6 times faster, with the same level of error reporting as before (and actually even more now).

The wind velocity for the undercatch correction was taken as is. It is now corrected to 2m using a log profile with a constant roughness length (0.03).

GRIBIO is now able to detect duplicate grid points when associating grid points and user virtual stations, and removes the duplicates (ie: the first station is kept, the other ones leading to the same grid point deleted). This means that before using it, the user should try a simple read_meteo to make sure that his points lead to unique virtual stations.

Added the Japanese correction for their Geonor rain gauges. We are still waiting for the paper giving this correction, since the results seem weird...

This version of GRIBIO is able to return meteo data from virtual stations. Some extra checks need to be implemented (for example, ensuring the unicity of the virtual stations). Tested with valgrind for performance and memory leaks.

A read2DGrid(grid, filename) method has been implemented in GRIBIO that returns the first grid it finds. If the input file only contains one grid, this would make sense... The snow height grid is now computed and the albedo grid is now correct (it was in percent). A readMeteo() method has been implemented and is almost functionnal (it just needs to list the available files and extract their timestamp to be finished). Some code cleanup.

Some code cleanup, improved memory management (ie: using the GRIB API free functions). A first version of readMeteo that is not even pre-alpha (therefore de-activated).

In GRIBIO, time range is now checked. Some code cleanup and some parameters are read from another table. The wind height correction has been disabled for now (since we have to standardize what we do here).

Added the wind log scaling law. Code cleanup in GRIBIO as well as more meteofileds supported. The readDEM method has been implemented.

improvements for the Legend class: if the generated legend text is too long, an alternate format is used. Moreover, values close enough to zero are rounded to a true zero.

First working version of GRIBIO!! The file naming scheme might still be non-standard, but it can open a file, index it and access the various fields through the index (ie: it is very fast). When a given field is not available, some backup strategies are tried (like extracting TA and dew point if RH can not be directly read). Specifying a file name as argument does not work however, since such a file is a collection of grids (-> which grid to output?). One option might be to accept it and return the first grid (relevant if the file contains only one grid). A readDEM will be implemented later, as well as the ability to read virtual stations data.

IOManager: Removed unnecessary consistency check in IOManager::interpolate(), the grid can only have the same size as the DEM anyway. Expanded the arguments of the interpolate() procedure to allow the user to pass a reference to a string, that will hold some info about the interpolation used. 

Added the grid() operator to 2D and 3D grids (basically, calling the same operator on array2D and array3D).

Fixed a parameter reading bug in PNGIO (reading the number of levels).

Bugfix for libsmet and thus release of the readSpecialPoints function in SMETIO.cc. It is now possible to read a vector of Coords objects through SMETIO, the format of the SMET file could be something like this:

SMET 1.1 ASCII
[HEADER]
station_id = my_pts
epsg 	   = 32632
nodata	   = -999
fields 	   = easting northing altitude
[DATA]
713700 5.05578e+06 0
730900 5.15678e+06 0
674200 5.06278e+06 0
674400 5.08078e+06 0