Spaces:

Duplicated from vincewin/CREST_demo

vincewin
/

CREST_runner

Running

App Files Files Community

CREST_runner / hf_data

576 kB

Ctrl+K

Ctrl+K

2 contributors

History: 126 commits

vincewin's picture

NARR reader hardening + TEMP gap visibility (CREST_AI 08a219d)

dd54d43 verified 4 days ago

analysis.py

4.79 kB
V2: FastAPI+Leaflet map dashboard, Docker SDK (EF5 fork + Arrow), live hydrograph + 2-D streamflow, warmup/state/cache, SNOW17, western CREST 3 months ago
basic.py

10.8 kB
V20.5: local-COG fallback for terrain reads (HF rate limits) + feedback addressed-flags helpers 3 months ago
calibrate.py

14.5 kB
Auto-calibration plumbing: per-check miss history, params refresh from CREST_state (newer wins), baseline-relative save, params/ append-only in persist, autocal records on /api/events 17 days ago
caljobs.py

2.77 kB
UX-level user isolation: per-browser job ownership + tokens, configuration-tagged caches, calibration no longer locks the gauge, global + per-user CPU admission, tab guard 14 days ago
chatagent.py

10.9 kB
Health-check fix batch (CREST_AI 3dca271) 6 days ago
control.py

11 kB
control: output_grids accepts EF5 token list for event runs 2 months ago
conusstate.py

24.7 kB
CONUS state mosaic: full-basin runs warm-start from fleet pre-runs stitched across the gauge and its upstream gauges; full run is the default scheme again 13 days ago
crashlog.py

4.51 kB
V18.8: error watchdog records everything — browser error beacon (window.onerror/unhandledrejection -> /api/clienterror, rate-limited 30/min), threading.excepthook backstop, SSE stream generator capture, and captures at the silent fallbacks (LLM parse, BC obs, result-cache save, cal LLM propose, snow clips, OAuth callback, history save, compactor). errors.jsonl stays ephemeral by design. 3 months ago
datamgr.py

8.54 kB
V18.8: error watchdog records everything — browser error beacon (window.onerror/unhandledrejection -> /api/clienterror, rate-limited 30/min), threading.excepthook backstop, SSE stream generator capture, and captures at the silent fallbacks (LLM parse, BC obs, result-cache save, cal LLM propose, snow clips, OAuth callback, history save, compactor). errors.jsonl stays ephemeral by design. 3 months ago
domain.py

8.86 kB
V14: Speed run vs Full run at the Simulate button — speed run truncates the domain at cut-set boundary gauges (obs injected as inflow), with an obs-coverage gate and fallback to full 3 months ago
eventqueue.py

14.1 kB
Health-check fix batch (CREST_AI 3dca271) 6 days ago
eventscore.py

6.4 kB
V30 operations: episode final products (consolidated stats + event-scoped nowcast verification replace the running event on end), CPU rung demoted to last resort behind worker claims, provenance stamps in manifests, /api/health self-monitoring, runner-split plumbing (EVENT_TICK / EVENT_RUNNER_URL), event-score labels + no Model-options panel in nowcast mode about 2 months ago
eventsim.py

50.8 kB
CONUS state mosaic: full-basin runs warm-start from fleet pre-runs stitched across the gauge and its upstream gauges; full run is the default scheme again 13 days ago
eventstore.py

38.3 kB
finalize_episodes: clip 'ended' to now; peak_obs from episode-window hydro rows only 12 days ago
feedback.py

4.53 kB
V20.5: local-COG fallback for terrain reads (HF rate limits) + feedback addressed-flags helpers 3 months ago
fleetstore.py

8.27 kB
Hindcast runs use the fleet's rows + states: value-based cache keys, merging fleet fetch, gap-safe cache plan, fleet state carried past the fleet period, speed scheme default 13 days ago
floodbrief.py

19.2 kB
Health-check fix batch (CREST_AI 3dca271) 6 days ago
forcing.py

13.1 kB
Fix rainless event sims: fill tar-missing MRMS hours from mrms_recent; surface missing forcing; fleet states + DI-LSTM DA for nowcast runs; 'nowcast' trace label 2 months ago
forcingfresh.py

9.03 kB
Health-check fix batch (CREST_AI 3dca271) 6 days ago
gauges.py

4.86 kB
V20.5: local-COG fallback for terrain reads (HF rate limits) + feedback addressed-flags helpers 3 months ago
gaugetz.py

1.12 kB
hydrograph times in the gauge local time zone (UTC toggle for emergency users) 3 months ago
health.py

10.7 kB
Health-check fix batch (CREST_AI 3dca271) 6 days ago
hucdomain.py

19.2 kB
Event EF5 extent = HUC12 basin bounds (union with default square): the sqrt-area square centred on the outlet clipped elongated catchments (Spoon R 3,884/4,241 km2, Pope Ck 199/449); hucdomain.basin_bounds; run_gauge(domain_bbox=) about 2 months ago
llm.py

4.16 kB
V3 interface: map-first gauge pins, full-width chat + 3/4 map, gauge tabs, AI info feed (progress bars + event news), HF OAuth + profile, streamflow legend/toggle/autozoom, AI calibration (AI_cali rules) + persistent param store, spline hydrograph, time-range fallback prompt 3 months ago
mrmsframes.py

1.67 kB
Nowcast MRMS rain-radar overlay (24h/48h/7d anim) + persistent 2D depth legend + queue worker wake-ping about 2 months ago
multipliers.py

3.82 kB
V22: virtual points — 2,676 ungauged HydroBASINS lev07 outlets fill CONUS gauge gaps; hindcast via upstream-gauge injection (speed scheme forced) + nearest-gauge parameter regionalization 3 months ago
neighbors.py

6.92 kB
V13: upstream-gauge boundary conditions (multi-gauge control + EF5 DA), cancel/supersede running sims + Stop button, auto re-run after calibration 3 months ago
nowcast.py

3.42 kB
V19: AI nowcast wiring — after each successful gauge run the dashboard asks the companion CREST_nowcast Space (DI-LSTM, ZeroGPU) for a +6h corrected tail and draws it as a dotted orange trace on the hydrograph; graceful no-op while the model is untrained or the Space is asleep 3 months ago
nowcaststore.py

18.3 kB
UX: event aging + pins + basin boundary; precip bars on nowcast hydrograph 2 months ago
obs.py

9.24 kB
obs store: replace-don't-merge on refetched windows so USGS-scrubbed provisional values (phantom floods) self-heal instead of persisting forever about 2 months ago
osminfra.py

10.1 kB
risk view: tile-first worldpop/OSM probes (CREST_riskdata pre-hosted parquet; live fetch = fallback) about 2 months ago
params.py

6.43 kB
params: fall back to whole-COG download when /vsicurl windowed read fails 3 months ago
paramstore.py

5.12 kB
UX-level user isolation: per-browser job ownership + tokens, configuration-tagged caches, calibration no longer locks the gauge, global + per-user CPU admission, tab guard 14 days ago
persist.py

11.6 kB
Auto-calibration plumbing: per-check miss history, params refresh from CREST_state (newer wins), baseline-relative save, params/ append-only in persist, autocal records on /api/events 17 days ago
pipeline.py

52.4 kB
NARR reader hardening + TEMP gap visibility (CREST_AI 08a219d) 4 days ago
provenance.py

2.94 kB
V30 operations: episode final products (consolidated stats + event-scoped nowcast verification replace the running event on end), CPU rung demoted to last resort behind worker claims, provenance stamps in manifests, /api/health self-monitoring, runner-split plumbing (EVENT_TICK / EVENT_RUNNER_URL), event-score labels + no Model-options panel in nowcast mode about 2 months ago
report.py

19.8 kB
V18.6: reports are a registered-user benefit — signed-in downloads are copied to a per-user library (cap 20) that persists to the private dataset and shows under 👤 My reports (download/delete); guests' reports stay ephemeral: discarded via a pagehide beacon when they close the app, with a 6-h janitor TTL backstop 3 months ago
riskprobe.py

5.75 kB
Risk view (map_visual lens for 2-D inundation): /api/riskprobe per-PIXEL depth/speed/flow-dir + DEFRA hazard class + WorldPop 2026-2030 population (resampled to the solver grid) + OSM infrastructure values; Dockerfile CRESTIMAP_REF -> e8652781 (maxspeed/flowdir rasters) about 2 months ago
rivernet.py

3.98 kB
UX: gauge locate ping on tab click (both modes) + upstream HydroRIVERS network in nowcast 3 months ago
routednow.py

6.48 kB
Hindcast runs use the fleet's rows + states: value-based cache keys, merging fleet fetch, gap-safe cache plan, fleet state carried past the fleet period, speed scheme default 13 days ago
runner.py

13.5 kB
fix: EF5 lowercases gauge id in ts filename — read ts.<id.lower()>.<model>.csv so ungauged 'V…' points produce output (V22 hindcast + V23 nowcast were 0-row) 3 months ago
simjobs.py

15.8 kB
UX-level user isolation: per-browser job ownership + tokens, configuration-tagged caches, calibration no longer locks the gauge, global + per-user CPU admission, tab guard 14 days ago
snow.py

11.6 kB
V18.8: error watchdog records everything — browser error beacon (window.onerror/unhandledrejection -> /api/clienterror, rate-limited 30/min), threading.excepthook backstop, SSE stream generator capture, and captures at the silent fallbacks (LLM parse, BC obs, result-cache save, cal LLM propose, snow clips, OAuth callback, history save, compactor). errors.jsonl stays ephemeral by design. 3 months ago
statebundle.py

4.83 kB
V20: virtual-user fleet — lazy fetch of pre-simulated results/states from read-only CREST_fleet repo (f16 per-gauge state bundles, 10-day warm starts); fleet_run.py orchestrator for the server 3 months ago
statecache.py

13.2 kB
Hindcast runs use the fleet's rows + states: value-based cache keys, merging fleet fetch, gap-safe cache plan, fleet state carried past the fleet period, speed scheme default 13 days ago
ungaugednow_store.py

15.8 kB
Health-check fix batch (CREST_AI 3dca271) 6 days ago
virtualpoints.py

2.75 kB
V22.1: rename to 'ungauged points'; 10-day warm-up for ungauged runs (upstream injection carries the river) 3 months ago
viz.py

13.8 kB
V21.5: Eckhardt baseflow (PyPI baseflow pkg) for 2-D scale + thresholds; nowcast always opens at CONUS view 3 months ago
worldpop.py

11.9 kB
risk view: tile-first worldpop/OSM probes (CREST_riskdata pre-hosted parquet; live fetch = fallback) about 2 months ago