# Bill X-ray pass bars

Written Nov 14 2026, 11:58 AM PT, before any analysis code existed. Nothing here changes after the first test run. Results that miss a bar get reported as misses.

## What is being tested

Bill X-ray reads a home's hourly electricity file and says how much went to heating and cooling, EV charging, a timed load such as a pool pump, the always-on floor, and everything else. The question is whether those numbers are right.

## Data

Three real homes with sub-meters, 8 home-years in total. Files are in `data/truth/`.

| Home | Home-years | Sub-metered truth |
|---|---|---|
| AMPds2, Burnaby BC | Apr 2012 to Mar 2013, Apr 2013 to Mar 2014 | heat pump plus furnace fan |
| Smart* Home B, Massachusetts | 2014, 2015, 2016 | AC plus furnace |
| Smart* Home C, Massachusetts | 2014, 2015, 2016 | furnace 1 plus furnace 2 |

The engine sees only the whole-home hourly total and outdoor temperature. It never sees a sub-meter.

## Split

- **Dev** (tuning allowed): AMPds2 Apr 2012 to Mar 2013, Home B 2014.
- **Test** (run once, at the end, by Claude and not by Codex): the other 6 home-years.

## Bars, scored on the test split

**Bar 1, heating and cooling.** Error is the gap, in points of the yearly total, between the engine's heating plus cooling share and the sub-metered share.
- Pass: median error at or under 6 points, and no home-year over 12 points.
- It must also beat the simple rule of thumb (yearly total minus 12 times the lowest month) on median error.

**Bar 2, EV charging.** A known EV load is added to each real home-year: 7.2 kW, 4 nights a week, starting between 9 PM and 1 AM, 1.5 to 4 hours, fixed random seed.
- Pass: detected EV energy within 20% of what was added on at least 5 of 6 home-years, and on the same homes with no EV added the engine reports EV energy at or under 2% of the yearly total on all 6.

**Bar 3, timed load.** A known pump is added: 1.2 kW, 10 AM to 4 PM, every day.
- Pass: detected timed energy with the pump, minus detected timed energy without it, is within 25% of what was added on at least 5 of 6 home-years.

## What a miss means

- Bar 1 misses: the page stops giving a heating and cooling dollar figure and shows only what it measures directly.
- Bar 2 or 3 misses: that detector is removed from the page.
- The always-on floor and the cost by time of day are direct measurements of the file and need no bar.

## Limits known before the run

- Three homes, all in cold climates. No home in a hot, dry climate like San Diego.
- The EV and pump loads are synthetic. Real chargers and pumps are less tidy.
- The furnace sub-meters include standby power that does not move with the weather, so the engine may read low.
