Results

  1. Main result
    1. Error by month
  2. Resolution sweep
  3. Other cameras
  4. Failure audit
    1. Worst accepted frames
    2. Rejected frames
  5. More figures

All numbers on this page are rendered from results/real/ by scripts/build_site_assets.py. Errors are in cm. Depth ranges are by gauge height: dry (up to 0.5 cm), 0.5–10 cm and above 10 cm.

Main result

Mean absolute error (MAE) is the primary metric. Intervals are 95% bootstrap intervals over whole months, so they reflect month-to-month spread rather than frame count. The two locked months give no interval.

EvaluationFramesMethodnMAE [95% CI]RMSEBiasDry0.5–10>10
Leave-one-month-out CV gated learned reader 1319 1.13 [0.7, 1.7] 3.1 +0.4 0.4 2.0 1.5
gated threshold baseline 1319 6.97 [6.0, 8.4] 10.1 +1.1 5.9 8.0 7.8
all learned reader 1976 3.38 [2.1, 4.5] 7.3 +0.5 1.9 5.0 4.1
Locked test gated learned reader 233 0.79 1.2 +0.0 0.0 1.6 0.6
gated threshold baseline 233 11.52 14.6 -8.7 9.2 7.2 12.5
all learned reader 283 3.11 8.9 -2.1 1.6 2.1 3.4

Gated means the frame passed the sharpness gate (coverage 67% in CV, 82% locked).

  • On gated CV frames the learned reader has 1.13 cm MAE (95% CI 0.67–1.69) against 6.97 cm for the threshold baseline and 8.80 cm for always-0.
  • On the two locked months it reaches 0.79 cm (baseline 11.52, always-0 18.90).
  • Without the gate the errors are 3.38 cm (CV) and 3.11 cm (locked). The gate buys reliability by abstaining on 33% of CV and 18% of locked frames.
  • Per-month MAE has median 1.06 cm and worst 3.78 cm.
  • A causal five-reading median makes things worse (1.13 to 1.77 cm), because levels move tens of centimetres per hour.
Held-out predictions: one event, camera versus gauge, river camera, and error versus plate scale
Held-out predictions. (a) One event; ticks mark rejected frames. (b) Camera against gauge, coloured by month. (c) River camera, locked flood. (d) CV error against plate scale; dashed line is the error model.

Error by month

Gated MAE for each held-out month (leave-one-month-out CV). Bars are scaled to the largest month.

MonthFramesLargest gauge (cm)MAE (cm)
2023-0210744.51.46
2023-0312229.00.98
2024-019826.52.93
2024-034122.91.46
2024-0418231.41.83
2024-122316.50.97
2025-01615.53.78
2025-064029.00.78
2025-071055.51.16
2026-032-0.00.0
2026-071700.00.18
2026-0814216.80.15
2026-0937633.81.06

Resolution sweep

Registration is computed once at native resolution. Frames are then area-downsampled by a factor \(f\) from 1 to 64, the plate is resampled with 360/\(f\) rows, and the reader is retrained for each \(f\). Plate scale is \(s = 0.16 f\) cm per pixel.

Downsample fcm per pixelLearned MAELearned RMSEBaseline MAE
10.161.133.086.97
20.311.173.225.66
40.621.082.965.11
81.251.233.225.02
162.491.363.164.97
324.981.843.826.81
649.963.616.2811.55

Gated MAE is 1.13 cm at native scale, 1.36 cm at 2.5 cm/px, 1.84 cm at 5.0 cm/px and 3.61 cm at 10.0 cm/px, which is over twice native. With scale \(s\) and waterline error \(\sigma_v\), \(\mathrm{Var}(\hat h) = s^2\sigma_v^2 + \sigma_g^2\). Fitting RMSE² to the gated sweep gives \(\sigma_v = 0.55\) px and \(\sigma_g = 3.0\) cm. The \(\sigma_g\) floor dominates at fine scales, so resolution is not the binding constraint at this camera.

You can see what coarser scales do to the plate in the demo.

Ranking frames by decode margin instead of the sharpness gate gives 2.28 cm at the gate’s coverage (the gate gives 1.13 cm), so a cheap image statistic abstains better than the classifier’s own confidence.

Other cameras

Table values are gated MAE in cm. “/ 0” is the no-water guess on the same frames. The three added cameras and the river camera were not used to build the method.

CameraSceneLargest gaugeIn-site / 0Held-out zero-shot / 0Held-out calibratedGate coverage (held-out, %)
in_overlandcream plate55 1.13 / 8.80 6.69 / 11.16 7.1447
in_northcream plate25 1.05 / 1.44 1.08 / 1.50 1.0853
oh_wetlandwhite plate42 0.54 / 2.73 1.52 / 2.01 1.8199
wi_mt1orange plate19 0.55 / 0.27 4.96 / 0.33 4.9686
hancockriver plate211†– 20 / 8612–

† Hancock: the flood range above the plate bottom. Its trivial guess is the plate bottom.

  • In-site (leave-one-month-out), the reader beats always-0 on in_overland, in_north (1.05 vs 1.44 cm) and oh_wetland (0.54 vs 2.73 cm). wi_mt1 stays nearly dry (gauge up to 19 cm), and always-0 wins there.
  • With the camera held out, zero-shot, the reader beats always-0 on in_overland (6.69 vs 11.16 cm, but only 47% of frames pass the gate), in_north (1.08 vs 1.50) and oh_wetland (1.52 vs 2.01).
  • It fails on wi_mt1 (4.96 vs 0.33). Having never seen an orange plate, the classifier reads it as fully submerged in sunny frames (69 cm at gauge 0).
  • On frames with water (gauge above 0.5 cm) its error is much larger (6.1 and 24.7 cm against 13.3 and 34.1 cm for the no-water guess), and calibration does not help.
  • River plate. Zero-shot MAE over the 211 cm flood is 20 cm (plate-bottom guess 86), and 12 cm calibrated. Pooling helps inside the stage range it saw (4, 7 against 8, 11 cm at 11–16 ft) and hurts beyond it (37 against 22 cm at 16–19 ft).
Real frames: median-error examples, largest accepted errors, rejected frames, and cameras held out of training
Real frames (crop and plate strip). Row 1: median-error examples, and Hancock. Row 2: largest accepted errors and rejected frames. Row 3: cameras held out of training, zero-shot; the last one is the wi_mt1 failure.

Failure audit

Infrared is not worse than daylight (3.30 vs 3.41 cm MAE). The costly cases are a borrowed pose (9.82 vs 1.91 cm for a registered pose) and frames outside the gate (7.90 vs 1.13 cm). In the worst accepted day frame, glare washes out the plate and water streaks on the panel look like wet rows.

The overlays below are saved by scripts/real_report.py. Each shows the frame, the plate strip and the reading. Captions give the gauge height and the reader’s estimate.

Worst accepted frames

Rejected frames

More figures

Error against coverage when frames are ranked by confidence
Error against coverage in CV: how MAE changes as the least trustworthy frames are dropped.
Time series of gauge and reader for September 2026
Held-out time series for September 2026, the event used in the demo.