# results_calib

Fold-safe **temperature** and **Platt** scaling on frozen `stem_ms96` (and SWA) logits. Fit on LODO non-held-out corpus folds only (subsample ≤400k frames). Never AASD/Carta labels. Apply through fixed HMM p_stay **0.994** scale **0.8**, and through causal tau-30 high-pass of the calibrated evidence (`*_hp30`). Emissions re-fit from calibrated corpus streams.

Code: `stem_ms96_calib.py`. Fit params: `models/stem_ms96_calib/fit_params.json`. JSON: `results/research/stem_ms96_calib.json`. Log: `experiments/stem_ms96_calib.log` / `stem_ms96_calib_console.log`.

Temperature alone is nearly invariant under the Gaussian HMM (T≈0.84–0.95; raw≡temp). Platt (a·z+b) changes the bias and moves Acc slightly.

## stem_ms96 LODO (preset)

| Held-out | raw H/Acc | temp H/Acc | platt H/Acc | platt_hp30 H/Acc |
|---|---|---|---|---|
| AVGC | 0.7945/74.06 | 0.7945/74.06 | 0.7906/75.63 | 0.7967/71.71 |
| DTU | 0.9061/89.85 | 0.9061/89.85 | 0.9015/90.66 | 0.8173/69.44 |
| KUL | 0.8755/82.33 | 0.8755/82.33 | 0.8603/83.21 | 0.8588/76.04 |
| UHD | 0.8407/79.47 | 0.8407/79.47 | 0.8486/80.96 | 0.8199/74.16 |
| USTC | 0.9219/86.34 | 0.9219/86.34 | 0.9083/86.41 | 0.8325/71.32 |
| **mean** | **0.8677/82.41** | **0.8677/82.41** | **0.8619/83.37** | **0.8250/72.53** |

## SWA LODO (preset)

| Held-out | raw H/Acc | platt H/Acc |
|---|---|---|
| AVGC | 0.8015/74.91 | 0.8022/75.88 |
| DTU | 0.9003/89.52 | 0.8993/90.11 |
| KUL | 0.8769/82.35 | 0.8705/82.88 |
| UHD | 0.8553/80.09 | 0.8558/80.71 |
| USTC | 0.9161/86.19 | 0.9011/86.04 |
| **mean** | **0.8700/82.61** | **0.8658/83.12** |

## External (preset)

| Backbone | Set | raw H/Acc | temp H/Acc | platt H/Acc | platt_hp30 H/Acc | vs linear_hp30 |
|---|---|---|---|---|---|---|
| stem ens | AASD | 0.6212/51.38 | 0.6212/51.38 | 0.6236/50.98 | 0.5827/51.13 | 0.6422/53.12 |
| stem ens | Carta | 0.5491/49.56 | 0.5491/49.56 | 0.5557/49.44 | 0.5740/50.96 | 0.6520/60.54 |
| SWA all5 | AASD | 0.6202/51.08 | 0.6202/51.08 | 0.6213/50.71 | 0.6010/51.05 | 0.6422/53.12 |
| SWA all5 | Carta | 0.5507/48.68 | 0.5507/48.68 | 0.5484/48.77 | 0.5695/49.79 | 0.6520/60.54 |

stem external uses equal average of five held-* stem streams; calib fit pooled from each fold's train sets only.

## Targets

| Target | Result |
|---|---|
| AASD Acc>60 (Phase 1 gate) | **miss** (best Acc 51.38 stem raw; all variants ≤51.4) → Phase 2 required |
| AVGC H>=0.85 Acc>=78 | miss (platt AVGC Acc +1.57 vs raw but H flat/down) |
| UHD H>=0.85 | met under SWA raw/temp/platt (0.8553–0.8558); already met by SWA |
| Carta vs linear_hp30 | moved away |

## Notes

- Pure temperature scaling does not change official scores (emission sd absorbs T).
- Platt raises mean LODO Acc slightly (+0.5–1.0) and can raise AVGC Acc, but hurts mean H and does not move AASD Acc toward 60.
- hp30 of calibrated stem/SWA evidence stays near Acc 51 on AASD (far below linear_hp30 on raw seed logits).
