2026-10-29T07:02:28+00:00 waiting GPU try=1; xcorr:
2026-10-29 07:01:39 memory probe batch 64 ok; peak 0.19 GB
2026-10-29 07:01:39 forward check ok
3213676 /bin/bash -O extglob -c snap=$(command cat <&3) && builtin shopt -s extglob && builtin eval -- "$snap" && { builtin set +u 2>/dev/null || true; builtin eval "${__CURSOR_SANDBOX_ENV_RESTORE:-}" 2>/dev/null; builtin export PWD="$(builtin pwd)"; builtin shopt -s expand_aliases 2>/dev/null; builtin eval "$1" < /dev/null; }; COMMAND_EXIT_CODE=$?; dump_bash_state >&4; builtin exit $COMMAND_EXIT_CODE -- chmod +x /root/disk_3tb/eeg-thao/experiments/run_xcorr_matched.sh; cd /root/disk_3tb/eeg-thao && nohup bash experiments/run_xcorr_matched.sh > experiments/xcorr_matched_wrapper.log 2>&1 & echo WRAPPER_PID=$!; sleep 3; head -30 experiments/xcorr_matched_wrapper.log; flock -n multi_agent_opt/gpu.lock echo LOCK_FREE_NOW || echo LOCK_BUSY_NOW; nvidia-smi --query-gpu=memory.used,utilization.gpu --format=csv; pgrep -af 'run_xcorr|xcorr_matched|stem_sw2|sw2_ms' | grep -v grep | head -15
3213678 bash experiments/run_xcorr_matched.sh
GPU_LOCK_ACQUIRED pid=3214173 at 2026-10-29T07:02:58+00:00
memory.used [MiB], utilization.gpu [%]
0 MiB, 0 %
stem-sw2-ms start steps=1000 batch=512 EXTRA_HP30=True c_in=26 OFF=3 a_sw2=0.5
device cuda
causality check passed
loaded direct_clf__eaP_n5_t60_w10b3_ptSPK_aug-sw2
loaded direct_clf__eaP_n5_t60_w10b3_ptSPK_s1_aug-sw2
loaded direct_clf__eaP_n5_t60_w10b3_ptSPK_s2_aug-sw2
loaded direct_clf__eaP_n5_t60_w10b3_ptSPK_s3_aug-sw2
building causal transforms
sufficient statistics
  stats id lda4
  stats id dyn
  stats hp60 lda4
  stats hp60 dyn
  stats z60 lda4
  stats z60 dyn
  stats sm1 lda4
  stats sm1 dyn
cache hit /root/disk_3tb/eeg-thao/models/sw2_hp30_blend/cache/sw2_lodo_Z_meta.pkl
SW2 LODO aligned OK; expanded dim=26 (expect 26)
fold held-out=AVGC init /root/disk_3tb/eeg-thao/models/stem_ms96_swa/held-AVGC.pt
  expanded SWA 24→26 from /root/disk_3tb/eeg-thao/models/stem_ms96_swa/held-AVGC.pt
    held-AVGC step 1/1000 loss 0.2327
    held-AVGC step 200/1000 loss 0.2215
    held-AVGC step 400/1000 loss 0.2383
    held-AVGC step 600/1000 loss 0.2635
    held-AVGC step 800/1000 loss 0.2103
    held-AVGC step 1000/1000 loss 0.2245
  trained held-AVGC loss 0.2245 frame-acc 0.939 (44s)
LODO AVGC p 0.994 sc 0.8  H 0.8054 Acc 75.29 L 0.866 SDT 7.03
LODO_hp30 AVGC p 0.994 sc 0.8  H 0.7762 Acc 71.06
fold held-out=DTU init /root/disk_3tb/eeg-thao/models/stem_ms96_swa/held-DTU.pt
  expanded SWA 24→26 from /root/disk_3tb/eeg-thao/models/stem_ms96_swa/held-DTU.pt
    held-DTU step 1/1000 loss 0.3442
    held-DTU step 200/1000 loss 0.3504
    held-DTU step 400/1000 loss 0.3391
    held-DTU step 600/1000 loss 0.3790
    held-DTU step 800/1000 loss 0.3250
    held-DTU step 1000/1000 loss 0.3404
  trained held-DTU loss 0.3404 frame-acc 0.918 (50s)
LODO DTU p 0.994 sc 0.8  H 0.9007 Acc 89.09 L 0.911 SDT 5.24
LODO_hp30 DTU p 0.994 sc 0.8  H 0.8265 Acc 70.84
fold held-out=KUL init /root/disk_3tb/eeg-thao/models/stem_ms96_swa/held-KUL.pt
  expanded SWA 24→26 from /root/disk_3tb/eeg-thao/models/stem_ms96_swa/held-KUL.pt
    held-KUL step 1/1000 loss 0.2567
    held-KUL step 200/1000 loss 0.2736
    held-KUL step 400/1000 loss 0.2546
    held-KUL step 600/1000 loss 0.2765
    held-KUL step 800/1000 loss 0.2483
    held-KUL step 1000/1000 loss 0.2535
  trained held-KUL loss 0.2535 frame-acc 0.934 (53s)
LODO KUL p 0.994 sc 0.8  H 0.8684 Acc 81.84 L 0.925 SDT 3.88
LODO_hp30 KUL p 0.994 sc 0.8  H 0.8437 Acc 74.77
fold held-out=UHD init /root/disk_3tb/eeg-thao/models/stem_ms96_swa/held-UHD.pt
  expanded SWA 24→26 from /root/disk_3tb/eeg-thao/models/stem_ms96_swa/held-UHD.pt
    held-UHD step 1/1000 loss 0.2439
    held-UHD step 200/1000 loss 0.3107
    held-UHD step 400/1000 loss 0.2418
    held-UHD step 600/1000 loss 0.2545
    held-UHD step 800/1000 loss 0.2538
    held-UHD step 1000/1000 loss 0.2477
  trained held-UHD loss 0.2477 frame-acc 0.931 (52s)
LODO UHD p 0.994 sc 0.8  H 0.8517 Acc 80.05 L 0.910 SDT 2.45
LODO_hp30 UHD p 0.994 sc 0.8  H 0.8096 Acc 73.31
fold held-out=USTC init /root/disk_3tb/eeg-thao/models/stem_ms96_swa/held-USTC.pt
  expanded SWA 24→26 from /root/disk_3tb/eeg-thao/models/stem_ms96_swa/held-USTC.pt
    held-USTC step 1/1000 loss 0.2735
    held-USTC step 200/1000 loss 0.3125
    held-USTC step 400/1000 loss 0.2748
    held-USTC step 600/1000 loss 0.2815
    held-USTC step 800/1000 loss 0.2705
    held-USTC step 1000/1000 loss 0.2703
  trained held-USTC loss 0.2703 frame-acc 0.916 (53s)
LODO USTC p 0.994 sc 0.8  H 0.9171 Acc 86.36 L 0.978 SDT 0.40
LODO_hp30 USTC p 0.994 sc 0.8  H 0.8298 Acc 70.93
all-5 fine-tune for AASD/Carta, init /root/disk_3tb/eeg-thao/models/stem_ms96_swa/all5.pt
  expanded SWA 24→26 from /root/disk_3tb/eeg-thao/models/stem_ms96_swa/all5.pt
    all5 step 1/1000 loss 0.2896
    all5 step 200/1000 loss 0.3003
    all5 step 400/1000 loss 0.2868
    all5 step 600/1000 loss 0.2828
    all5 step 800/1000 loss 0.2765
    all5 step 1000/1000 loss 0.2752
  trained all5 loss 0.2752 frame-acc 0.904 (53s)
cache hit /root/disk_3tb/eeg-thao/models/sw2_hp30_blend/cache/sw2_external_a05.pkl
  external AASD: 900 trials
  external Carta2026: 480 trials
  external emissions mu 3.1558 sd 2.4649 scale 0.8
  external hp30 emissions mu 1.7970 sd 2.5011 scale 0.8
EXT AASD p 0.994 sc 0.8  H 0.6197 Acc 50.87 L 0.793 SDT 13.28
EXT_hp30 AASD p 0.994 sc 0.8  H 0.6016 Acc 51.11
EXT Carta2026 p 0.994 sc 0.8  H 0.5433 Acc 47.93 L 0.627 SDT 28.00
EXT_hp30 Carta2026 p 0.994 sc 0.8  H 0.5613 Acc 49.26
LODO mean H 0.8686 Acc 82.53
AASD Acc 50.87 vs linear_hp30 53.12 (Δ-2.25) / SW2 53.46 (Δ-2.59)
wrote /root/disk_3tb/eeg-thao/results/research/stem_ms96_sw2_ms.json and /root/disk_3tb/eeg-thao/multi_agent_opt/results_stem_sw2_ms.md in 504s
EXIT:0
