Primary location for community water system (CWS) delivery, demand unit (DU),
and M&I crosswalk spreadsheets the backend consumes. Everything that used
to live under etl/tier_data/reference/, etl/statistics/reference/, or
a top-level reference/ directory has been consolidated here.
| File | Source | Purpose |
|---|---|---|
Final_M&Idemandunits_withlatlongs.xlsx |
Kristin Dobson (May 2026) | M&I demand unit list. Centroids, gw_su, sw_du, optional Notes. Read by etl/tier_data/scripts/reconcile_gw_sw_sources.py. |
Systems_served_by_DU_systemname_updated.xlsx |
earlier delivery | PWS list keyed by DU system name. |
Master list of systems served for sw units updated april 13.xlsx |
spring-2026 CWS delivery | PWS master (~476 systems). |
Updated HHS allocations May 6 2026.xlsx |
spring-2026 CWS delivery | HHS allocation list (~76 rows). |
Updated Master crosswalk SW DUs M&I May7 2026.xlsx |
spring-2026 CWS delivery | SW DU delivery crosswalk (~75 rows). Read by etl/statistics/scripts/compare_master_crosswalk.py (not yet implemented). |
Today du_urban_entity.gw / .sw are stored as text ('0' / '1' / empty) on live RDS, while the team xlsx uses integer 0 / 1, so reconcile the type when loading these files. The planned BOOLEAN migration and the deferred value reconciliation against the CalSim manual are both covered in gw_sw_reconciliation.md (Step 7 for the type change).
- Audit script:
etl/tier_data/scripts/reconcile_gw_sw_sources.py - Crosswalk comparison script:
etl/statistics/scripts/compare_master_crosswalk.py[not yet implemented] - CSV conversion and DB staging are documented in
database/README.md(spring-2026 CWS section).