Zarr And Product Overview¶
The dashboard depends on a mix of numeric Zarr stores, WXcam media products, and operations-monitor products.
Numeric instrument Zarrs¶
- Ceilometer Zarr
- Cloud Radar Zarr
- HATPRO Zarr
- Meteorology Zarr
- ASFS Logger Zarr
- ASFS Fast Sonic Zarr
- ASFS Fast Gas Zarr
- Power Zarr
WXcam products¶
Operations products¶
Design pattern¶
The general rule is:
- raw mirrored inputs live under
/project/aurora/raw - dashboard-facing products live under
/data/aurora/products
For most numeric instruments, that means a fixed-schema Zarr plus generated PNG
quicklooks. The fixed-summary 1D instruments can also write prewarmed latest
interactive Plotly JSON under /data/aurora/products/dashboard/prewarm/.
WXcam adds media/catalog products on top of that pattern, while Operations
Dashboard adds raw JSONL snapshots, a monitoring Zarr, archived PNG quicklooks,
live trend cards, and observe-only health reports.
Numeric appenders use a common safe-append policy: incoming files are sorted, deduplicated, filtered to genuinely new timestamps, and materialized before the Zarr append. That keeps the deployed stores monotonic and avoids partial chunk writes that can otherwise appear as false data gaps or all-NaN stripes.