========================================================================== FACULTY: khoa_cong_nghe_thong_tin | strategy=expanding | event y<5.0 MODEL: XGB regressor (weighted 8,3) + XGB classifier P(y<5.0); blended = p*mean_low + (1-p)*raw DEV folds (chi in)=[1, 2, 3, 4, 5] | HOLDOUT folds=[6, 7] ========================================================================== >>> DEV folds (chi in ket qua, KHONG tune) fold 1: n_train=19725 n_test=5222 mean_low=2.31 fold 2: n_train=24947 n_test=4598 mean_low=2.27 fold 3: n_train=29545 n_test=6277 mean_low=2.26 fold 4: n_train=35822 n_test=5072 mean_low=2.30 fold 5: n_train=40896 n_test=6398 mean_low=2.33 ### DEV — BLENDED (warn = blended < event) fold test base% | AP AUC | ACC PREC REC F1 flag% 1 5222 3.6% | 0.226 0.768 | 0.954 0.304 0.201 0.242 2.4% 2 4598 3.3% | 0.449 0.884 | 0.932 0.263 0.579 0.361 7.3% 3 6277 3.5% | 0.265 0.862 | 0.841 0.135 0.656 0.223 16.9% 4 5072 4.8% | 0.341 0.886 | 0.847 0.198 0.713 0.309 17.4% 5 6398 5.5% | 0.281 0.830 | 0.837 0.189 0.598 0.288 17.3% -------------------------------------------------------------------------- POOL 27567 4.2% | 0.290 0.840 | 0.878 0.186 0.566 0.280 12.7% [fold 1] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 38 151 | 189 actual >=5.0 (neg) 87 4946 | 5033 total 125 5097 | [fold 2] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 88 64 | 152 actual >=5.0 (neg) 247 4199 | 4446 total 335 4263 | [fold 3] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 143 75 | 218 actual >=5.0 (neg) 920 5139 | 6059 total 1063 5214 | [fold 4] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 174 70 | 244 actual >=5.0 (neg) 707 4121 | 4828 total 881 4191 | [fold 5] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 210 141 | 351 actual >=5.0 (neg) 899 5148 | 6047 total 1109 5289 | [POOL] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 653 501 | 1154 actual >=5.0 (neg) 2860 23553 | 26413 total 3513 24054 | ### DEV — CLASSIFICATION HEAD (warn = P(y<5.0) >= 0.5) fold test base% | AP AUC | ACC PREC REC F1 flag% 1 5222 3.6% | 0.231 0.796 | 0.965 0.586 0.090 0.156 0.6% 2 4598 3.3% | 0.437 0.892 | 0.970 0.564 0.434 0.491 2.5% 3 6277 3.5% | 0.256 0.864 | 0.953 0.290 0.243 0.264 2.9% 4 5072 4.8% | 0.342 0.880 | 0.934 0.344 0.402 0.371 5.6% 5 6398 5.5% | 0.270 0.826 | 0.921 0.309 0.359 0.332 6.4% -------------------------------------------------------------------------- POOL 27567 4.2% | 0.289 0.840 | 0.947 0.352 0.312 0.331 3.7% [fold 1] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 17 172 | 189 actual >=5.0 (neg) 12 5021 | 5033 total 29 5193 | [fold 2] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 66 86 | 152 actual >=5.0 (neg) 51 4395 | 4446 total 117 4481 | [fold 3] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 53 165 | 218 actual >=5.0 (neg) 130 5929 | 6059 total 183 6094 | [fold 4] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 98 146 | 244 actual >=5.0 (neg) 187 4641 | 4828 total 285 4787 | [fold 5] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 126 225 | 351 actual >=5.0 (neg) 282 5765 | 6047 total 408 5990 | [POOL] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 360 794 | 1154 actual >=5.0 (neg) 662 25751 | 26413 total 1022 26545 | >>> HOLDOUT folds fold 6: n_train=47294 n_test=5651 mean_low=2.43 fold 7: n_train=53319 n_test=6926 mean_low=2.60 ### HOLDOUT — BLENDED (warn = blended < event) fold test base% | AP AUC | ACC PREC REC F1 flag% 6 5651 10.0% | 0.370 0.823 | 0.771 0.266 0.735 0.390 27.6% 7 6926 15.1% | 0.454 0.820 | 0.786 0.377 0.639 0.474 25.7% -------------------------------------------------------------------------- POOL 12577 12.8% | 0.402 0.816 | 0.779 0.325 0.673 0.438 26.5% [fold 6] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 414 149 | 563 actual >=5.0 (neg) 1145 3943 | 5088 total 1559 4092 | [fold 7] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 670 378 | 1048 actual >=5.0 (neg) 1107 4771 | 5878 total 1777 5149 | [POOL] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 1084 527 | 1611 actual >=5.0 (neg) 2252 8714 | 10966 total 3336 9241 | ### HOLDOUT — CLASSIFICATION HEAD (warn = P(y<5.0) >= 0.5) fold test base% | AP AUC | ACC PREC REC F1 flag% 6 5651 10.0% | 0.362 0.834 | 0.866 0.368 0.485 0.419 13.1% 7 6926 15.1% | 0.439 0.813 | 0.850 0.504 0.338 0.405 10.1% -------------------------------------------------------------------------- POOL 12577 12.8% | 0.389 0.813 | 0.857 0.435 0.389 0.411 11.5% [fold 6] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 273 290 | 563 actual >=5.0 (neg) 468 4620 | 5088 total 741 4910 | [fold 7] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 354 694 | 1048 actual >=5.0 (neg) 348 5530 | 5878 total 702 6224 | [POOL] confusion matrix (positive = y<5.0) pred WARN pred OK | total actual <5.0 (pos) 627 984 | 1611 actual >=5.0 (neg) 816 10150 | 10966 total 1443 11134 | ========================================================================== Ghi chu: AP/AUC = chat luong xep hang (frontier, khong phu thuoc nguong). ACC/PREC/REC/F1 = tai diem van hanh tu nhien o tren. POOL = micro-average (gop fold roi tinh 1 lan). DEV folds chi de tham khao — KHONG dung de tune gi.