Skip to content

Power Zarr

Path:

  • /data/aurora/products/power/power.zarr

Dataset shape

  • dimension: time
  • deployed shape when checked on 2026-05-21:
  • time=1118886
  • time coverage when checked: 2026-05-05 15:15:23.598658936 to 2026-05-21 20:15:04
  • sorted unique time coordinate

Time coordinate

  • time is parsed from the raw aps_time column

Useful root attributes

  • instrument = "power"
  • title = "Power level1 data"
  • source = "power_data_YYYYMMDD.csv"
  • wind_columns_excluded = "true"

Variable layout

  • one float32 time series per retained source column
  • the deployed store currently contains 62 variables

Important ingest rules:

  • raw column names are normalized by replacing . with _
  • columns containing wind are excluded
  • columns ending in time are excluded

Examples include:

  • ACOutputAmps
  • ACOutputHZ
  • ACOutputVolts
  • ACOutputWatts
  • BatteryAmps
  • BatterySOC
  • BatteryState
  • BatteryWatts
  • DCInverterWatts
  • InternalTemperature
  • HeatsinkTemperature
  • TempSensor1
  • TempSensor2
  • TempSensor3
  • TempSensor4
  • MaxSolarWatts_East

Schema note

  • append runs keep the existing variable set fixed in the same way as vaisalamet
  • append writes materialize only the already-filtered new sample block before writing, matching the cross-instrument Zarr append policy

Chunking

  • time-only variables are chunked (1200,)

Dashboard performance note

The stored Zarr schema and chunking remain unchanged. The dashboard opens this store with larger read chunks for interactive plotting, applies display-only sanity limits for impossible APS values, uses per-trace time downsampling, and rounds live latest windows into 5-minute cache buckets. Those choices are presentation-layer optimizations only; they do not change ingest or storage. The interactive APS summary prefers a compact derived display-summary Zarr under /data/aurora/products/power/power_display_summary.zarr. The latest APS interactive figure is also prewarmed as Plotly JSON by the quicklook pipeline under /data/aurora/products/dashboard/prewarm/.

Derived display-summary Zarr

Path:

  • /data/aurora/products/power/power_display_summary.zarr

This is the primary dashboard-serving Power summary product. It is built from power.zarr plus the optional ASFS logger watts_on_48vdc_Avg overlay by generate_power_display_summary.py. It keeps the raw Power Zarr authoritative, but stores only the curated one-minute traces needed by the APS summary panels. That lets the interactive browser switch Power windows without repeatedly opening and merging multi-day one-second APS samples.

When checked on 2026-05-21, this derived store had time=21547, 25 data variables, sorted unique timestamps, and coverage from 2026-05-05 15:15:00 to 2026-05-21 20:10:00.

Important variables include:

  • SolarWatts_East, SolarWatts_South, SolarWatts_West
  • SolarVolts_East, SolarVolts_South, SolarVolts_West
  • BatteryAmps, BatteryWatts, BatterySOC
  • ACOutputWatts, DCInverterWatts, watts_on_48vdc_Avg
  • ACOutputVolts, DCInverterVolts
  • InternalTemperature, HeatsinkTemperature, TempSensor1-TempSensor4
  • PowerDisplaySolarYield_East
  • PowerDisplaySolarYield_South
  • PowerDisplaySolarYield_West
  • PowerDisplayCumulativePowerGeneratedTotal
  • PowerDisplayCumulativePowerUtilised

Root attributes include:

  • power_display_summary_product = "true"
  • source = "derived from power.zarr and optional asfs_logger.zarr ASS 48 V power"
  • frequency = "1min" unless overridden by AURORA_POWER_DISPLAY_SUMMARY_FREQ

The display-summary product is regenerated by the Power quicklook pipeline. It is safe to delete and rebuild because it is derived from the raw Power and ASFS logger Zarrs.

Derived display-energy Zarr

Path:

  • /data/aurora/products/power/power_display_energy.zarr

This is a compact compatibility product containing only the cumulative kWh traces used by the APS cumulative panel. It can be built directly from power.zarr by generate_power_display_energy.py, but the normal quicklook pipeline now refreshes it from the broader display-summary product.

BatterySOC is stored in the broader display-summary product, not in this compatibility store. The generated and utilised energy traces from this compact store are plotted on the cumulative panel's right axis when the broader summary product is unavailable.

When checked on 2026-05-21, this derived store had time=21547, 5 data variables, sorted unique timestamps, and coverage from 2026-05-05 15:15:00 to 2026-05-21 20:10:00.

Variables:

  • PowerDisplaySolarYield_East
  • PowerDisplaySolarYield_South
  • PowerDisplaySolarYield_West
  • PowerDisplayCumulativePowerGeneratedTotal
  • PowerDisplayCumulativePowerUtilised

Root attributes include:

  • power_display_energy_product = "true"
  • source = "derived from power.zarr"
  • frequency = "1min" unless overridden by AURORA_POWER_DISPLAY_ENERGY_FREQ

The display-energy product is safe to delete and rebuild because it is derived entirely from the dashboard display-summary logic.