# results_temp_attn_spk

**Zero-init causal temporal MHSA residual after SPK-init vlaai_ws blocks**.
Pre-norm MHSA (heads=4) on post-VLAAI features; `out_proj` zero-init ⇒ identity @step 0. SPK remap `bb.*`→`bb.bb.*`. **NOT** speech FiLM; **NOT** SE/graph/channel-mask; **NOT** Conformer replace; **NOT** FIR/Morlet/FBCNet; **NOT** stem ALiBi/RoPE; **NOT** tip post-process.

Swap-test delta=0.0102. Prep `eaP_n5_t60`, sw2, max 4 ep×250, batch 64. HMM p_stay 0.994 scale 0.8; also hp30.

Code: `temp_attn_spk_lodo.py` / `decoders.TempAttnVLAAI`. Checkpoints: `models/temp_attn_spk/held-*.pt`, `/root/disk_3tb/eeg-thao/models/all5_direct_clf_w10b3_ptSPK_tempattn_aug-sw2.pt`. JSON: `/root/disk_3tb/eeg-thao/results/direct_clf__eaP_n5_t60_w10b3_ptSPK_tempattn_aug-sw2.json`.

## LODO (preset)

| Held-out | H | Acc % | hp30 H/Acc | vs published vlaai |
|---|---:|---:|---|---|
| AVGC | 0.6684 | 65.01 | 0.6409/62.42 | pub 0.7846/72.14 |
| DTU | 0.8261 | 74.38 | 0.7996/68.18 | pub 0.7846/72.14 |
| KUL | 0.7862 | 71.23 | 0.7733/66.94 | pub 0.7846/72.14 |
| UHD | 0.7661 | 71.31 | 0.7604/67.67 | pub 0.7846/72.14 |
| USTC | 0.7702 | 68.24 | 0.7571/63.78 | pub 0.7846/72.14 |
| **mean** | **0.7634** | **70.03** | **0.7463/65.80** | pub 0.7846/72.14; se-vlaai AASD 52.59; speech-resid 52.87 |

## External (preset)

| Set | H | Acc % | hp30 H/Acc | Acc tip 53.53 | se-vlaai | speech-resid |
|---|---:|---:|---|---|---|---|
| AASD | 0.6416 | 52.92 | 0.6413/53.09 | Δ-0.61 | Δ+0.33 | Δ+0.05 |
| Carta2026 | 0.6430 | 59.50 | 0.6648/61.01 | — | — | — |

## Targets

| Target | Result |
|---|---|
| AVGC H>=0.85 Acc>=78 | miss (0.6684/65.01) |
| UHD H>=0.85 | miss (0.7661) |
| AASD Acc>60 with H>0.63 | miss (0.6416/52.92; hp30 53.09) |
| AASD Acc vs tip 53.53 | Δ -0.61 (hp30 Δ -0.44) |
| Acc>60? | NO |

## NEXT IDEA

If temp-attn ≈ se/speech-resid (~0.77 LODO, AASD Acc ~52–53): close vlaai identity-residual family (SE/graph/speech-FiLM/temp-MHSA). Prefer a qualitatively new Acc frame front-end that can lift AASD Acc toward 60 — not tip post-process, not stem AdaLN/ALiBi/RoPE, not FIR/Morlet/FBCNet banks.
