Tests fail: Results don't match the expected results
The tests in the pipeline now run without errors. However, most of the results don't match the expected results:
See Log here: https://gitlabext.wsl.ch/snow-models/alpine3d/-/jobs/4081/raw
...
1/2 Test #1: simple.smoke .....................***Failed Error regular expression found in output. Regex=[error|differ|fail]157.64 sec
test 2
Start 2: basics_simple.smoke
2: Test command: /builds/snow-models/alpine3d/build/tests/basics/run_basics.sh "../simple/output_ref/5_2_dischma.met.bz2"
2: Test timeout computed to be: 1500
2: CTEST_FULL_OUTPUT (line required by CTest to avoid output truncation)
2:
2: *** Checking simulation 5_2_dischma.met
2: *** basic checks:
2: Comparing snow height (HS) [fail] → 708 errors µ_abs=1.88 µ_rel=0.065 @ 2014-10-29T12:00
2: Comparing surface temperature (TSS) [fail] → 414 errors µ_abs=2.66 µ_rel=1.08 @ 2014-10-01T12:00
2: Comparing albedo (ALB) [fail] → 1 error µ_abs=0.051 µ_rel=0.0601 @ 2014-10-25T12:00
2:
2: **** check the mass balance:
2: Comparing snow water equiv. (SWE) [fail] → 684 errors µ_abs=1.06 µ_rel=0.0175 @ 2014-10-14T10:00
2: Comparing snow rate [fail] → 1 error µ_abs=3.29 @ 2014-11-04T14:00
2: Comparing rain rate [OK]
2: Comparing snowpack runoff [fail] → 1 error µ_abs=0.772 µ_rel=0.632 @ 2014-10-14T10:00
2:
2: **** check the energy balance components:
2: Comparing sensible heat [fail] → 1074 errors µ_abs=2.61 µ_rel=1.33 @ 2014-10-01T02:00
2: Comparing latent heat [fail] → 1075 errors µ_abs=1.62 µ_rel=7.78 @ 2014-10-01T02:00
2: Comparing OLWR [fail] → 657 errors µ_abs=10.6 µ_rel=0.038 @ 2014-10-01T02:00
2: Comparing ILWR [fail] → 699 errors µ_abs=10.4 µ_rel=0.0406 @ 2014-10-02T08:00
2: Comparing RSWR [fail] → 138 errors µ_abs=3.79 µ_rel=0.0689 @ 2014-10-01T10:00
2: Comparing ISWR [fail] → 73 errors µ_abs=13.4 µ_rel=0.0858 @ 2014-10-01T10:00
2: Comparing ground flux [OK]
2: Comparing rain heat flux [fail] → 45 errors µ_abs=0.0342 µ_rel=2.22 @ 2014-10-01T02:00
2: Comparing surface input heat flux [fail] → 1061 errors µ_abs=13.4 µ_rel=0.772 @ 2014-10-01T02:00
2:
2: **** check the internal energy state:
2: Comparing internal energy change [fail] → 821 errors µ_abs=7.23 µ_rel=0.623 @ 2014-10-14T02:00
2: Comparing phase change heat flux [fail] → 158 errors µ_abs=13.1 µ_rel=2.41 @ 2014-10-14T08:00
2: Comparing liquid water content (LWC) [OK]
2/2 Test #2: basics_simple.smoke ..............***Failed Error regular expression found in output. Regex=[error|differ|fail] 0.88 sec
0% tests passed, 2 tests failed out of 2