========================================================================================== ACADEMIC EARLY-WARNING DATA EDA — TEXT REPORT ========================================================================================== Faculty: khoa_cong_nghe_thong_tin Splits directory: /root/disk_3tb/earlywarning/data/splits/expanding Strategy: expanding Failure definition: target_grade10 < 5.0 Development folds: [1, 2, 3, 4, 5] Holdout/diagnostic folds: [6, 7] IMPORTANT: feature-engineering decisions should primarily use DEVELOPMENT results. Holdout sections are diagnostics, not a feature-selection oracle. ========================================================================================== 1. FOLD INVENTORY, TARGET DRIFT, AND INTEGRITY CHECKS ========================================================================================== Analyzing fold 1 ... Analyzing fold 2 ... Analyzing fold 3 ... Analyzing fold 4 ... Analyzing fold 5 ... Analyzing fold 6 ... Analyzing fold 7 ... Fold-level summary fold train_rows_raw test_rows_raw train_rows_valid_target test_rows_valid_target test_semesters train_failure_count train_failure_rate test_failure_count test_failure_rate train_mean_grade test_mean_grade train_unique_students test_unique_students train_unique_courses test_unique_courses new_student_rate new_course_rate registration_id_overlap registration_id_overlap_rate student_overlap_count student_overlap_rate course_overlap_count course_overlap_rate train_duplicate_keys test_duplicate_keys train_feature_count test_feature_count common_feature_count train_only_feature_count test_only_feature_count 1 19725 5222 19725 5222 20221 613 0.0311 189 0.0362 7.0405 6.9204 945 996 109 64 0.3755 0.0944 0 0.0000 649 0.6516 42 0.6562 0 0 276 276 276 0 0 2 24947 4598 24947 4598 20222 802 0.0321 152 0.0331 7.0154 6.9952 1292 941 131 72 0.0009 0.0909 0 0.0000 940 0.9989 55 0.7639 0 0 276 276 276 0 0 3 29545 6277 29545 6277 20231 954 0.0323 218 0.0347 7.0122 6.9437 1293 1134 148 69 0.3110 0.0429 0 0.0000 784 0.6914 53 0.7681 0 0 276 276 276 0 0 4 35822 5072 35822 5072 20232 1172 0.0327 244 0.0481 7.0002 6.9494 1643 1076 164 69 0.0022 0.0416 0 0.0000 1073 0.9972 55 0.7971 0 0 276 276 276 0 0 5 40896 6398 40896 6398 20241 1416 0.0346 351 0.0549 6.9940 6.9970 1646 1200 178 77 0.2979 0.0591 0 0.0000 836 0.6967 64 0.8312 0 0 276 276 276 0 0 6 47294 5652 47294 5651 20242 1767 0.0374 563 0.0996 6.9944 6.8327 2010 1135 191 62 0.0000 0.0147 0 0.0000 1135 1.0000 59 0.9516 0 0 276 276 276 0 0 7 53320 6926 53319 6926 20251 2359 0.0442 1048 0.1513 6.9778 6.6445 2010 1210 194 79 0.3097 0.1125 0 0.0000 869 0.7182 62 0.7848 0 0 276 276 276 0 0 Top 30 train→test feature shifts per fold fold feature train_missing_rate test_missing_rate missing_rate_change abs_missing_rate_change standardized_mean_shift psi_train_to_test train_all_missing test_all_missing 1 prev_semester_NHHK 0.0034 0.0011 -0.0022 0.0022 1.9454 6.6664 False False 1 prev_semester_ordinal 0.0034 0.0011 -0.0022 0.0022 1.8841 6.6664 False False 1 prev_ssvhk_NHHK 0.0000 0.0000 0.0000 0.0000 1.9194 6.5657 False False 1 prev_ssvhk_semester_ordinal 0.0000 0.0000 0.0000 0.0000 1.7884 6.5657 False False 1 hist_ssvhk_semester_count 0.0000 0.0000 0.0000 0.0000 0.1380 5.2762 False False 1 hist_course_grade10_max 0.0000 0.0000 0.0000 0.0000 1.6975 3.3400 False False 1 recent3_course_grade10_max 0.0000 0.0000 0.0000 0.0000 1.7258 3.3058 False False 1 course_fail_rate_clipped 0.1783 0.0433 -0.1350 0.1350 0.4867 2.7785 False False 1 hist_target_course_pass_rate 0.1783 0.0433 -0.1350 0.1350 0.4870 2.5683 False False 1 hist_target_course_mean_grade10 0.1783 0.0433 -0.1350 0.1350 0.6942 1.7951 False False 1 hist_component_grade_max 0.0000 0.0000 0.0000 0.0000 0.5550 1.5512 False False 1 hist_passed_credits_sum 0.0034 0.0011 -0.0022 0.0022 0.3930 1.5197 False False 1 hist_component_courses 0.0000 0.0000 0.0000 0.0000 0.1249 1.5159 False False 1 student_prior_course_count_log 0.0000 0.0000 0.0000 0.0000 0.2431 1.4983 False False 1 hist_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.1281 1.4839 False False 1 recent3_component_grade_max 0.0000 0.0000 0.0000 0.0000 0.5561 1.4800 False False 1 hist_course_grade10_std 0.0000 0.0000 0.0000 0.0000 0.6343 1.4517 False False 1 hist_component_T1_count 0.0000 0.0000 0.0000 0.0000 0.1333 1.4514 False False 1 hist_component_high_rate 0.0000 0.0000 0.0000 0.0000 0.9543 1.4281 False False 1 hist_component_B1_count 0.0000 0.0000 0.0000 0.0000 0.7639 1.3132 False False 1 recent3_course_grade10_std 0.0000 0.0000 0.0000 0.0000 0.5519 1.2362 False False 1 hist_target_course_count 0.0000 0.0000 0.0000 0.0000 0.3392 1.1240 False False 1 recent3_component_grade_median 0.0000 0.0000 0.0000 0.0000 0.8786 1.1189 False False 1 hist_component_K1_mean 0.0347 0.0000 -0.0347 0.0347 0.9649 1.0100 False False 1 hist_component_K2_count 0.0000 0.0000 0.0000 0.0000 0.2228 1.0075 False False 1 hist_component_B1_mean 0.3073 0.0310 -0.2763 0.2763 0.7438 0.9933 False False 1 hist_component_K1_count 0.0000 0.0000 0.0000 0.0000 0.2204 0.9801 False False 1 hist_component_grade_median 0.0000 0.0000 0.0000 0.0000 0.8697 0.9676 False False 1 recent3_component_grade_count 0.0000 0.0000 0.0000 0.0000 0.4075 0.9484 False False 1 hist_semester_count 0.0034 0.0011 -0.0022 0.0022 0.2356 0.9448 False False 2 reg_first_days_from_open 0.6049 0.0072 -0.5977 0.5977 0.6706 8.7131 False False 2 reg_last_days_from_open 0.6049 0.0072 -0.5977 0.5977 0.6870 8.2432 False False 2 prev_ssvhk_NHHK 0.0000 0.0000 0.0000 0.0000 1.3737 8.0881 False False 2 prev_ssvhk_semester_ordinal 0.0000 0.0000 0.0000 0.0000 1.5413 8.0881 False False 2 hist_ssvhk_semester_count 0.0000 0.0000 0.0000 0.0000 0.3462 6.6847 False False 2 prev_semester_NHHK 0.0029 0.0011 -0.0018 0.0018 1.3273 5.1588 False False 2 prev_semester_ordinal 0.0029 0.0011 -0.0018 0.0018 1.3865 5.1588 False False 2 hist_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.0229 2.8884 False False 2 student_prior_course_count_log 0.0000 0.0000 0.0000 0.0000 0.2256 2.8849 False False 2 hist_passed_credits_sum 0.0029 0.0011 -0.0018 0.0018 0.3300 2.7394 False False 2 hist_component_B1_count 0.0000 0.0000 0.0000 0.0000 0.9439 2.6317 False False 2 hist_component_count 0.0000 0.0000 0.0000 0.0000 0.0704 2.4504 False False 2 recent3_course_grade10_max 0.0000 0.0000 0.0000 0.0000 1.2020 2.2495 False False 2 hist_course_grade10_max 0.0000 0.0000 0.0000 0.0000 1.1926 2.2439 False False 2 hist_component_courses 0.0000 0.0000 0.0000 0.0000 0.0329 1.8245 False False 2 hist_target_course_count 0.0000 0.0000 0.0000 0.0000 0.2344 1.7256 False False 2 hist_component_T1_count 0.0000 0.0000 0.0000 0.0000 0.0315 1.6435 False False 2 recent3_component_grade_max 0.0000 0.0000 0.0000 0.0000 0.4807 1.4529 False False 2 course_fail_rate_clipped 0.1500 0.0307 -0.1194 0.1194 0.4245 1.4528 False False 2 hist_component_grade_count 0.0000 0.0000 0.0000 0.0000 0.0806 1.4097 False False 2 hist_component_grade_max 0.0000 0.0000 0.0000 0.0000 0.4803 1.4002 False False 2 hist_component_K1_count 0.0000 0.0000 0.0000 0.0000 0.0575 1.3463 False False 2 hist_component_K2_count 0.0000 0.0000 0.0000 0.0000 0.0590 1.3395 False False 2 hist_target_course_pass_rate 0.1500 0.0307 -0.1194 0.1194 0.4253 1.3274 False False 2 hist_semester_count 0.0029 0.0011 -0.0018 0.0018 0.2241 1.0837 False False 2 recent3_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.2546 1.0635 False False 2 hist_course_grade10_std 0.0000 0.0000 0.0000 0.0000 0.3976 1.0567 False False 2 recent3_course_grade10_std 0.0000 0.0000 0.0000 0.0000 0.4518 0.9983 False False 2 course_status_PML ||| pháp_luật_đại_cương ||| General Law 0.0000 0.0000 0.0000 0.0000 1.4142 0.9009 False False 2 recent3_component_grade_count 0.0000 0.0000 0.0000 0.0000 0.2300 0.7800 False False 3 reg_after_deadline_count 0.5119 0.0040 -0.5079 0.5079 4.9503 13.4788 False False 3 reg_first_days_from_open 0.5119 0.0040 -0.5079 0.5079 0.7934 10.1378 False False 3 reg_last_days_from_open 0.5119 0.0040 -0.5079 0.5079 0.7781 9.3549 False False 3 prev_semester_NHHK 0.0026 0.0013 -0.0014 0.0014 1.9238 8.7495 False False 3 prev_semester_ordinal 0.0026 0.0013 -0.0014 0.0014 1.8825 8.7495 False False 3 prev_ssvhk_NHHK 0.0000 0.0000 0.0000 0.0000 1.8956 8.5323 False False 3 prev_ssvhk_semester_ordinal 0.0000 0.0000 0.0000 0.0000 1.7876 8.5323 False False 3 hist_ssvhk_semester_count 0.0000 0.0000 0.0000 0.0000 0.2501 5.1717 False False 3 prev_conduct_score 0.0002 0.0000 -0.0002 0.0002 0.6116 1.5830 False False 3 target_semester_unseen_course_rate 0.0064 0.0064 0.0000 0.0000 0.5822 1.1520 False False 3 hist_target_course_mean_grade10 0.1315 0.0183 -0.1131 0.1131 0.3586 1.0866 False False 3 hist_component_B1_count 0.0000 0.0000 0.0000 0.0000 0.5750 0.9841 False False 3 hist_target_course_count 0.0000 0.0000 0.0000 0.0000 0.5581 0.8194 False False 3 hist_passed_credits_sum 0.0026 0.0013 -0.0014 0.0014 0.4075 0.7871 False False 3 hist_semester_count 0.0026 0.0013 -0.0014 0.0014 0.3475 0.7724 False False 3 hist_course_grade10_max 0.0000 0.0000 0.0000 0.0000 0.6958 0.7495 False False 3 reg_span_days 0.5119 0.0040 -0.5079 0.5079 0.0787 0.7402 False False 3 course_fail_rate_clipped 0.1315 0.0183 -0.1131 0.1131 0.2227 0.6775 False False 3 hist_component_courses 0.0000 0.0000 0.0000 0.0000 0.3509 0.6692 False False 3 student_prior_course_count_log 0.0000 0.0000 0.0000 0.0000 0.3014 0.6676 False False 3 hist_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.3338 0.6602 False False 3 hist_component_T1_count 0.0000 0.0000 0.0000 0.0000 0.3384 0.6264 False False 3 course_cluster_id 0.0000 0.0000 0.0000 0.0000 0.0965 0.6166 False False 3 hist_target_course_pass_rate 0.1315 0.0183 -0.1131 0.1131 0.2244 0.6156 False False 3 hist_registered_credits_mean 0.0026 0.0013 -0.0014 0.0014 0.2341 0.5271 False False 3 hist_component_K2_count 0.0000 0.0000 0.0000 0.0000 0.3997 0.5115 False False 3 recent3_component_grade_count 0.0000 0.0000 0.0000 0.0000 0.4592 0.5043 False False 3 hist_component_grade_count 0.0000 0.0000 0.0000 0.0000 0.4030 0.4936 False False 3 hist_component_K1_count 0.0000 0.0000 0.0000 0.0000 0.3925 0.4747 False False 3 target_semester_average_course_difficulty 0.0595 0.0064 -0.0531 0.0531 0.5442 0.4238 False False 4 reg_first_days_from_open 0.4229 0.0142 -0.4087 0.4087 0.2760 9.9805 False False 4 prev_semester_NHHK 0.0024 0.0010 -0.0014 0.0014 1.3889 9.2281 False False 4 prev_semester_ordinal 0.0024 0.0010 -0.0014 0.0014 1.4369 9.2281 False False 4 prev_ssvhk_NHHK 0.0000 0.0000 0.0000 0.0000 1.4238 9.0026 False False 4 prev_ssvhk_semester_ordinal 0.0000 0.0000 0.0000 0.0000 1.5544 9.0026 False False 4 reg_last_days_from_open 0.4229 0.0142 -0.4087 0.4087 0.2771 6.1249 False False 4 hist_ssvhk_semester_count 0.0000 0.0000 0.0000 0.0000 0.3294 6.0892 False False 4 reg_after_deadline_count 0.4229 0.0142 -0.4087 0.4087 0.6172 2.7097 False False 4 hist_component_B1_count 0.0000 0.0000 0.0000 0.0000 0.7585 2.0903 False False 4 hist_passed_credits_sum 0.0024 0.0010 -0.0014 0.0014 0.1847 1.5046 False False 4 reg_span_days 0.4229 0.0142 -0.4087 0.4087 0.0899 1.3620 False False 4 hist_target_course_count 0.0000 0.0000 0.0000 0.0000 0.2688 1.1287 False False 4 prev_conduct_score 0.0002 0.0000 -0.0002 0.0002 0.5491 1.0710 False False 4 hist_semester_count 0.0024 0.0010 -0.0014 0.0014 0.1938 1.0007 False False 4 hist_component_courses 0.0000 0.0000 0.0000 0.0000 0.0982 0.8735 False False 4 student_prior_course_count_log 0.0000 0.0000 0.0000 0.0000 0.1777 0.7897 False False 4 hist_component_T1_count 0.0000 0.0000 0.0000 0.0000 0.0874 0.7810 False False 4 hist_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.0819 0.7420 False False 4 hist_component_count 0.0000 0.0000 0.0000 0.0000 0.1135 0.7091 False False 4 hist_component_grade_count 0.0000 0.0000 0.0000 0.0000 0.1099 0.6308 False False 4 hist_component_K1_count 0.0000 0.0000 0.0000 0.0000 0.0813 0.5988 False False 4 target_semester_average_course_difficulty 0.0502 0.0294 -0.0208 0.0208 0.4755 0.5939 False False 4 hist_component_K2_count 0.0000 0.0000 0.0000 0.0000 0.0870 0.5903 False False 4 target_semester_unseen_course_rate 0.0064 0.0233 0.0169 0.0169 0.4308 0.4323 False False 4 course_fail_rate_clipped 0.1116 0.0319 -0.0797 0.0797 0.1712 0.4268 False False 4 hist_target_course_pass_rate 0.1116 0.0319 -0.0797 0.0797 0.1722 0.4093 False False 4 target_semester_registered_credits 0.0000 0.0000 0.0000 0.0000 0.1606 0.3824 False False 4 hist_conduct_mean 0.0002 0.0000 -0.0002 0.0002 0.4127 0.3726 False False 4 hist_course_grade10_max 0.0000 0.0000 0.0000 0.0000 0.4956 0.3520 False False 4 recent3_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.1157 0.3362 False False 5 prev_ssvhk_NHHK 0.0000 0.0000 0.0000 0.0000 1.8384 12.0201 False False 5 prev_ssvhk_semester_ordinal 0.0000 0.0000 0.0000 0.0000 1.7532 12.0201 False False 5 reg_first_days_from_open 0.3722 0.0036 -0.3686 0.3686 0.2924 9.7827 False False 5 prev_semester_NHHK 0.0022 0.0011 -0.0011 0.0011 1.8610 9.5755 False False 5 prev_semester_ordinal 0.0022 0.0011 -0.0011 0.0011 1.8332 9.5755 False False 5 reg_last_days_from_open 0.3722 0.0036 -0.3686 0.3686 0.3085 9.1248 False False 5 hist_ssvhk_semester_count 0.0000 0.0000 0.0000 0.0000 0.2231 4.9574 False False 5 reg_after_deadline_count 0.3722 0.0036 -0.3686 0.3686 0.6335 2.7777 False False 5 prev_conduct_score 0.0001 0.0000 -0.0001 0.0001 0.6623 0.8446 False False 5 target_semester_average_course_difficulty 0.0476 0.0081 -0.0395 0.0395 0.5852 0.7834 False False 5 hist_conduct_mean 0.0001 0.0000 -0.0001 0.0001 0.6393 0.7577 False False 5 hist_semester_count 0.0022 0.0011 -0.0011 0.0011 0.3131 0.7434 False False 5 hist_component_B1_count 0.0000 0.0000 0.0000 0.0000 0.4123 0.7212 False False 5 hist_passed_credits_sum 0.0022 0.0011 -0.0011 0.0011 0.3557 0.7051 False False 5 hist_target_course_count 0.0000 0.0000 0.0000 0.0000 0.8571 0.6277 False False 5 target_semester_unseen_course_rate 0.0085 0.0058 -0.0027 0.0027 0.4113 0.6096 False False 5 reg_span_days 0.3722 0.0036 -0.3686 0.3686 0.2202 0.5626 False False 5 prev_registered_credits 0.0022 0.0011 -0.0011 0.0011 0.4014 0.5279 False False 5 hist_registered_credits_mean 0.0022 0.0011 -0.0011 0.0011 0.4391 0.5224 False False 5 student_prior_course_count_log 0.0000 0.0000 0.0000 0.0000 0.2824 0.4836 False False 5 recent3_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.3442 0.4761 False False 5 hist_component_courses 0.0000 0.0000 0.0000 0.0000 0.3319 0.4760 False False 5 hist_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.3339 0.4584 False False 5 hist_component_T1_count 0.0000 0.0000 0.0000 0.0000 0.3538 0.4299 False False 5 course_cluster_id 0.0000 0.0000 0.0000 0.0000 0.0299 0.4207 False False 5 hist_target_course_mean_grade10 0.1017 0.0527 -0.0491 0.0491 0.1683 0.4196 False False 5 course_status_PML ||| chủ_nghĩa_xã_hội_khoa_học ||| Scientific Socialism 0.0000 0.0000 0.0000 0.0000 0.8533 0.4132 False False 5 recent3_registered_credits_mean 0.0022 0.0011 -0.0011 0.0011 0.4605 0.4112 False False 5 recent3_component_grade_count 0.0000 0.0000 0.0000 0.0000 0.3832 0.3747 False False 5 hist_component_count 0.0000 0.0000 0.0000 0.0000 0.3974 0.3646 False False 6 prev_ssvhk_NHHK 0.0000 0.0000 0.0000 0.0000 1.4803 9.7741 False False 6 prev_ssvhk_semester_ordinal 0.0000 0.0000 0.0000 0.0000 1.5857 9.7741 False False 6 prev_semester_NHHK 0.0021 0.0014 -0.0007 0.0007 1.4497 7.8696 False False 6 prev_semester_ordinal 0.0021 0.0014 -0.0007 0.0007 1.4858 7.8696 False False 6 hist_ssvhk_semester_count 0.0000 0.0000 0.0000 0.0000 0.3513 5.6863 False False 6 hist_component_B1_count 0.0000 0.0000 0.0000 0.0000 0.6039 2.3077 False False 6 hist_component_count 0.0000 0.0000 0.0000 0.0000 0.1408 1.4524 False False 6 hist_component_courses 0.0000 0.0000 0.0000 0.0000 0.1010 1.3173 False False 6 hist_passed_credits_sum 0.0021 0.0014 -0.0007 0.0007 0.1955 1.2869 False False 6 hist_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.0980 1.2479 False False 6 student_prior_course_count_log 0.0000 0.0000 0.0000 0.0000 0.1871 1.2313 False False 6 target_semester_unseen_course_rate 0.0081 0.0276 0.0195 0.0195 0.4761 1.2141 False False 6 hist_component_grade_count 0.0000 0.0000 0.0000 0.0000 0.1334 0.8757 False False 6 hist_conduct_mean 0.0001 0.0000 -0.0001 0.0001 0.6783 0.8420 False False 6 hist_component_T1_count 0.0000 0.0000 0.0000 0.0000 0.1102 0.8170 False False 6 prev_conduct_score 0.0001 0.0000 -0.0001 0.0001 0.6070 0.7825 False False 6 hist_component_K2_count 0.0000 0.0000 0.0000 0.0000 0.1171 0.7756 False False 6 hist_target_course_mean_grade10 0.0951 0.0145 -0.0806 0.0806 0.0607 0.7710 False False 6 hist_component_K1_count 0.0000 0.0000 0.0000 0.0000 0.1173 0.7262 False False 6 hist_semester_count 0.0021 0.0014 -0.0007 0.0007 0.2142 0.5729 False False 6 hist_target_course_count 0.0000 0.0000 0.0000 0.0000 0.4408 0.5430 False False 6 target_semester_average_course_difficulty 0.0423 0.0283 -0.0140 0.0140 0.1462 0.4829 False False 6 recent3_component_grade_count 0.0000 0.0000 0.0000 0.0000 0.1399 0.3804 False False 6 course_fail_rate_clipped 0.0951 0.0145 -0.0806 0.0806 0.1441 0.3652 False False 6 hist_target_course_pass_rate 0.0951 0.0145 -0.0806 0.0806 0.1443 0.3607 False False 6 recent3_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.1066 0.3437 False False 6 target_semester_registered_credits 0.0000 0.0000 0.0000 0.0000 0.1883 0.3019 False False 6 course_cluster_id 0.0000 0.0000 0.0000 0.0000 0.1884 0.2805 False False 6 hist_component_grade_std 0.0001 0.0000 -0.0001 0.0001 0.2084 0.2774 False False 6 target_semester_difficulty_weighted_workload 0.0000 0.0000 0.0000 0.0000 0.1215 0.2379 False False 7 prev_ssvhk_NHHK 0.0000 0.0000 0.0000 0.0000 1.7838 12.1426 False False 7 prev_ssvhk_semester_ordinal 0.0000 0.0000 0.0000 0.0000 1.7171 12.1426 False False 7 reg_first_days_from_open 0.3989 0.0048 -0.3942 0.3942 0.3929 10.0146 False False 7 reg_last_days_from_open 0.3989 0.0048 -0.3942 0.3942 0.4125 9.0427 False False 7 prev_semester_NHHK 0.0020 0.0000 -0.0020 0.0020 1.8031 8.8345 False False 7 prev_semester_ordinal 0.0020 0.0000 -0.0020 0.0020 1.7865 8.8345 False False 7 hist_ssvhk_semester_count 0.0000 0.0000 0.0000 0.0000 0.1106 4.9607 False False 7 reg_after_deadline_count 0.3989 0.0048 -0.3942 0.3942 1.7515 2.9216 False False 7 hist_passed_credits_sum 0.0020 0.0000 -0.0020 0.0020 0.2822 1.8224 False False 7 recent3_registered_credits_mean 0.0020 0.0000 -0.0020 0.0020 0.4789 1.6825 False False 7 hist_conduct_mean 0.0001 0.0000 -0.0001 0.0001 0.8182 1.0464 False False 7 hist_registered_credits_mean 0.0020 0.0000 -0.0020 0.0020 0.6213 0.8748 False False 7 prev_conduct_score 0.0001 0.0000 -0.0001 0.0001 0.7827 0.8256 False False 7 prev_registered_credits 0.0020 0.0000 -0.0020 0.0020 0.4596 0.7088 False False 7 prev_passed_credits 0.0020 0.0000 -0.0020 0.0020 0.3717 0.6342 False False 7 hist_semester_count 0.0020 0.0000 -0.0020 0.0020 0.2010 0.5650 False False 7 student_prior_course_count_log 0.0000 0.0000 0.0000 0.0000 0.1620 0.5435 False False 7 hist_target_course_count 0.0000 0.0000 0.0000 0.0000 0.7811 0.5356 False False 7 hist_course_grade10_count 0.0000 0.0000 0.0000 0.0000 0.1969 0.4600 False False 7 course_status_PML ||| kinh_tế_chính_trị_mác_lênin ||| Political Economics of Marxism-Leninism 0.0000 0.0000 0.0000 0.0000 0.7222 0.4594 False False 7 hist_component_B1_count 0.0000 0.0000 0.0000 0.0000 0.2892 0.4198 False False 7 hist_component_courses 0.0000 0.0000 0.0000 0.0000 0.2147 0.3268 False False 7 hist_component_T1_count 0.0000 0.0000 0.0000 0.0000 0.2115 0.2953 False False 7 hist_target_course_mean_grade10 0.0859 0.0432 -0.0427 0.0427 0.1931 0.2783 False False 7 hist_course_grade10_std 0.0001 0.0003 0.0002 0.0002 0.5019 0.2505 False False 7 target_semester_average_course_difficulty 0.0409 0.0180 -0.0228 0.0228 0.0028 0.2401 False False 7 hist_course_pass_rate 0.0000 0.0000 0.0000 0.0000 0.5448 0.2097 False False 7 hist_component_count 0.0000 0.0000 0.0000 0.0000 0.2694 0.2073 False False 7 hist_component_grade_count 0.0000 0.0000 0.0000 0.0000 0.2504 0.2064 False False 7 hist_course_grade10_max 0.0000 0.0000 0.0000 0.0000 0.2510 0.2026 False False Features entirely missing in a fold test set fold feature train_missing_rate test_missing_rate 1 reg_after_deadline_count 0.5003 1.0000 1 reg_first_days_from_open 0.5003 1.0000 1 reg_last_days_from_open 0.5003 1.0000 1 reg_span_days 0.5003 1.0000 6 reg_after_deadline_count 0.3224 1.0000 6 reg_first_days_from_open 0.3224 1.0000 6 reg_last_days_from_open 0.3224 1.0000 6 reg_span_days 0.3224 1.0000 ========================================================================================== 2. CANONICAL NON-DUPLICATED SNAPSHOTS ========================================================================================== Development snapshot: fold 5 train + test, deduplicated by ['base_row_id']: 47,294 rows Full diagnostic snapshot: fold 7 train + test, deduplicated by ['base_row_id']: 60,245 rows The latest expanding fold is used instead of concatenating all fold training files, because expanding training files repeat historical rows. ========================================================================================== 3. TARGET DISTRIBUTION AND SEMESTER EVOLUTION ========================================================================================== All available semesters — sample size, failure prevalence, and grades target_semester_ordinal target_NHHK rows unique_students unique_courses failures failure_rate grade_zero_rate grade_below_3_rate near_fail_4_to_5_rate mean_grade median_grade grade_std grade_q05 grade_q25 grade_q75 grade_q95 50 20181 635 125 12 37 0.0583 0.0142 0.0394 0.0094 6.6057 6.8000 1.5475 4.0700 6.0000 7.5000 8.6000 51 20182 624 131 15 41 0.0657 0.0048 0.0353 0.0176 6.3744 6.4000 1.5435 4.4150 5.6000 7.3000 8.7850 52 20183 37 10 4 11 0.2973 0.2162 0.2432 0.0270 4.9054 6.4000 2.8683 0.0000 3.4000 7.0000 7.5200 53 20191 1609 309 22 79 0.0491 0.0081 0.0329 0.0081 6.7685 6.9000 1.6356 5.0000 6.0000 7.9000 9.0000 54 20192 1617 302 20 93 0.0575 0.0087 0.0303 0.0179 6.6568 6.7000 1.5779 4.7000 5.8000 7.6000 9.0000 55 20193 3 3 1 0 0.0000 0.0000 0.0000 0.0000 6.8000 6.7000 0.2160 6.6100 6.6500 6.9000 7.0600 56 20201 3115 558 29 96 0.0308 0.0022 0.0148 0.0093 6.8939 7.0000 1.3813 5.1000 6.0000 7.9000 8.8000 57 20202 2815 556 29 77 0.0274 0.0053 0.0178 0.0060 7.0517 7.2000 1.3811 5.1000 6.3000 8.0000 9.0000 58 20203 1 1 1 0 0.0000 0.0000 0.0000 0.0000 6.8000 6.8000 0.0000 6.8000 6.8000 6.8000 6.8000 59 20211 5277 845 52 63 0.0119 0.0030 0.0080 0.0028 7.6219 7.8000 1.2323 5.6000 7.0000 8.5000 9.3000 60 20212 3992 803 57 116 0.0291 0.0063 0.0163 0.0083 6.8369 6.8000 1.4030 5.1000 6.0000 7.8000 9.0000 62 20221 5222 996 64 189 0.0362 0.0079 0.0230 0.0075 6.9204 7.0000 1.5102 5.0000 6.0000 8.0000 9.0000 63 20222 4598 941 72 152 0.0331 0.0072 0.0196 0.0078 6.9952 7.1000 1.5057 5.1000 6.1000 8.1000 9.0000 65 20231 6277 1134 69 218 0.0347 0.0051 0.0186 0.0105 6.9437 7.0000 1.4503 5.1000 6.1000 8.0000 8.9000 66 20232 5072 1076 69 244 0.0481 0.0091 0.0246 0.0156 6.9494 7.1000 1.6046 5.0000 6.0000 8.1000 9.1000 67 20233 2 2 1 0 0.0000 0.0000 0.0000 0.0000 7.7500 7.7500 0.1500 7.6150 7.6750 7.8250 7.8850 68 20241 6398 1200 77 351 0.0549 0.0056 0.0244 0.0206 6.9970 7.1000 1.6245 4.7000 6.0000 8.2000 9.1000 69 20242 5651 1135 62 563 0.0996 0.0142 0.0345 0.0465 6.8327 7.1000 1.7689 3.8000 5.9000 8.1000 9.1000 70 20243 374 237 6 29 0.0775 0.0107 0.0294 0.0401 7.0816 7.2000 1.7709 4.4300 6.0000 8.5000 9.2000 71 20251 6926 1210 79 1048 0.1513 0.0091 0.0461 0.0739 6.6445 6.9000 1.8827 3.1000 5.6000 8.1000 9.1000 Development grade distribution by bands grade_band rows rate grade = 0 298 0.0063 0 < grade < 3 671 0.0142 3 <= grade < 4 292 0.0062 4 <= grade < 5 506 0.0107 5 <= grade < 6 8454 0.1788 6 <= grade < 7 11274 0.2384 7 <= grade < 8 12706 0.2687 8 <= grade < 9 9984 0.2111 9 <= grade <= 10 3109 0.0657 outside [0,10] 0 0.0000 Development target_status × binary class target_status failure_<5 normal_>=5 All eligible_normal_numeric_grade 1767 45527 47294 All 1767 45527 47294 Meaningful semesters for adjacent drift analysis: [50, 51, 53, 54, 56, 57, 59, 60, 62, 63, 65, 66, 68, 69, 70, 71] Small/special semesters requiring data-quality interpretation target_semester_ordinal target_NHHK rows unique_students unique_courses failures failure_rate grade_zero_rate grade_below_3_rate near_fail_4_to_5_rate mean_grade median_grade grade_std grade_q05 grade_q25 grade_q75 grade_q95 52 20183 37 10 4 11 0.2973 0.2162 0.2432 0.0270 4.9054 6.4000 2.8683 0.0000 3.4000 7.0000 7.5200 55 20193 3 3 1 0 0.0000 0.0000 0.0000 0.0000 6.8000 6.7000 0.2160 6.6100 6.6500 6.9000 7.0600 58 20203 1 1 1 0 0.0000 0.0000 0.0000 0.0000 6.8000 6.8000 0.0000 6.8000 6.8000 6.8000 6.8000 67 20233 2 2 1 0 0.0000 0.0000 0.0000 0.0000 7.7500 7.7500 0.1500 7.6150 7.6750 7.8250 7.8850 ========================================================================================== 4. FEATURE QUALITY PROFILE — DEVELOPMENT DATA ========================================================================================== Model feature count in development snapshot: 276 Feature-quality counts measure feature_count constant 16 binary 41 near-zero variance 102 missing >=90% 10 conversion loss >0 0 nonnegative high-skew candidates 98 features with infinities converted to missing 0 Top 30 features by missingness feature numeric_missing_rate numeric_unique is_constant is_binary dominant_value_rate_nonmissing numeric_conversion_loss_count infinite_value_count skew iqr_outlier_rate hist_same_course_last_grade10 0.9161 65 False False 0.0673 0 0 -1.1742 0.0691 hist_same_course_best_grade10 0.9161 65 False False 0.0726 0 0 -1.2755 0.0920 hist_same_course_mean_grade10 0.9161 163 False False 0.0600 0 0 -1.1591 0.0655 hist_same_course_component_mean 0.9158 429 False False 0.0568 0 0 -1.0238 0.0701 hist_same_course_component_min 0.9158 74 False False 0.2573 0 0 0.3624 0.0013 hist_same_course_pass_rate 0.9149 3 False False 0.9888 0 0 9.3566 0.0000 hist_same_course_VT_count 0.9149 2 False True 0.9856 0 0 8.1534 0.0000 hist_same_course_CT_count 0.9149 1 True True 1.0000 0 0 0.0000 0.0000 hist_same_course_attempts 0.9149 5 False False 0.8708 0 0 3.1590 0.0000 hist_same_course_component_count 0.9145 13 False False 0.7027 0 0 1.6154 0.0000 reg_first_days_from_open 0.3224 40 False False 0.1358 0 0 -1.5934 0.1642 reg_last_days_from_open 0.3224 51 False False 0.1042 0 0 -1.5643 0.1676 reg_span_days 0.3224 31 False False 0.6681 0 0 1.8296 0.0154 reg_after_deadline_count 0.3224 14 False False 0.7031 0 0 1.5072 0.2224 hist_component_B1_low_rate 0.1424 10 False False 0.9543 0 0 5.3742 0.0000 hist_component_B1_mean 0.1424 235 False False 0.0199 0 0 -1.1876 0.0448 course_fail_rate_clipped 0.0951 313 False False 0.0597 0 0 0.9857 0.0101 hist_target_course_pass_rate 0.0951 335 False False 0.0469 0 0 -0.9652 0.0101 hist_target_course_mean_grade10 0.0951 378 False False 0.0103 0 0 0.0460 0.0000 target_semester_average_course_difficulty 0.0423 121 False False 0.0640 0 0 -0.5554 0.0087 isDKCung 0.0221 2 False True 0.9302 0 0 3.3769 0.0000 hist_component_K1_low_rate 0.0146 367 False False 0.3666 0 0 1.3534 0.0188 hist_component_K2_mean 0.0146 2842 False False 0.0300 0 0 -0.8093 0.0224 hist_component_K2_low_rate 0.0146 261 False False 0.6377 0 0 3.6727 0.0886 hist_component_K1_mean 0.0146 3051 False False 0.0085 0 0 -0.6275 0.0143 target_semester_unseen_course_rate 0.0081 25 False False 0.7254 0 0 2.3944 0.1114 hist_warning_credit_debt_count 0.0021 9 False False 0.8991 0 0 5.3582 0.0000 hist_warning_gpa_sem_count 0.0021 3 False False 0.9875 0 0 10.0588 0.0000 hist_warning_gpa_cum_count 0.0021 3 False False 0.9978 0 0 25.2134 0.0000 recent3_warning_count 0.0021 4 False False 0.9136 0 0 4.2121 0.0000 ... 246 additional rows saved to CSV. Top 30 sparse/near-constant features feature numeric_missing_rate numeric_unique is_constant is_binary dominant_value_rate_nonmissing numeric_conversion_loss_count infinite_value_count skew iqr_outlier_rate course_status_ENG ||| thực_hành_tiếng_c1 ||| Language skills C1 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_ENG ||| thực_hành_tiếng_anh_b1 ||| English Language Skills B1 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_ENG ||| thực_hành_tiếng_anh_b2 ||| English Language Skills B2 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_ESP ||| thực_hành_tiếng_anh_b2 ||| English Language Skills - Level B2 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_ESP ||| thực_hành_tiếng_anh_b1 ||| English Language Skills - Level B1 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_1b1 ||| Second Foreign Language - Chinese 1B1 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_MME ||| quản_trị_khủng_hoảng_truyền_thông ||| Communication Crisis Management 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_MME ||| hệ_thống_thông_tin_doanh_nghiệp ||| Enterprise Information Systems 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_MAT ||| toán_cao_cấp_và_ứng_dụng_trong_kinh_tế_kinh_doanh ||| Mathematics for Economics and Business 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_a2 ||| Second Foreign Language - Chinese A2 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_2b1 ||| Second Foreign Language - Chinese 2B1 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_a1 ||| Second Foreign Language - Chinese A1 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_ENG ||| phiên_dịch_3 ||| Interpreting Practice 3 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 hist_same_course_CT_count 0.9149 1 True True 1.0000 0 0 0.0000 0.0000 course_status_JAP ||| thực_hành_tiếng_nhật_a1 ||| Japanese Language Skills A1 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 recent3_hp_CT_count 0.0000 1 True True 1.0000 0 0 0.0000 0.0000 course_status_ENG ||| phương_pháp_học_tập_và_nghiên_cứu_khoa_học ||| Study and Research Skills 0.0000 2 False True 1.0000 0 0 217.4718 0.0000 course_status_ENG ||| biên_tập_và_hiệu_đính_bản_dịch ||| Reviewing and Editing of Translated Texts 0.0000 2 False True 1.0000 0 0 217.4718 0.0000 course_status_VNS ||| thực_hành_tiếng_việt_a1 ||| Vietnamese Language Skills A1 0.0000 2 False True 1.0000 0 0 217.4718 0.0000 course_status_ENG ||| biên_dịch_3 ||| Translation Practice 3 0.0000 2 False True 1.0000 0 0 217.4718 0.0000 course_status_FIT ||| ứng_dụng_công_nghệ_thông_tin ||| Computer Skills 0.0000 2 False True 1.0000 0 0 217.4718 0.0000 course_status_ENG ||| kiến_tập ||| Practicum 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_VIP ||| tiếng_việt_trong_hành_chức ||| Vietnamese in Use 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_ENG ||| thực_tập_tốt_nghiệp ||| Internship 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_MGT ||| quản_trị_học ||| Introduction to Management 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 hist_component_K2_DC_count 0.0000 2 False True 1.0000 0 0 153.7709 0.0000 hist_component_B1_DC_count 0.0000 2 False True 1.0000 0 0 153.7709 0.0000 ... 246 additional rows saved to CSV. Top 30 positively skewed features feature numeric_missing_rate numeric_unique is_constant is_binary dominant_value_rate_nonmissing numeric_conversion_loss_count infinite_value_count skew iqr_outlier_rate course_status_ENG ||| biên_dịch_3 ||| Translation Practice 3 0.0000 2 False True 1.0000 0 0 217.4718 0.0000 course_status_ENG ||| biên_tập_và_hiệu_đính_bản_dịch ||| Reviewing and Editing of Translated Texts 0.0000 2 False True 1.0000 0 0 217.4718 0.0000 course_status_VNS ||| thực_hành_tiếng_việt_a1 ||| Vietnamese Language Skills A1 0.0000 2 False True 1.0000 0 0 217.4718 0.0000 course_status_FIT ||| ứng_dụng_công_nghệ_thông_tin ||| Computer Skills 0.0000 2 False True 1.0000 0 0 217.4718 0.0000 course_status_ENG ||| phương_pháp_học_tập_và_nghiên_cứu_khoa_học ||| Study and Research Skills 0.0000 2 False True 1.0000 0 0 217.4718 0.0000 course_status_ENG ||| thực_tập_tốt_nghiệp ||| Internship 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_ENG ||| kiến_tập ||| Practicum 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_MGT ||| quản_trị_học ||| Introduction to Management 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 course_status_VIP ||| tiếng_việt_trong_hành_chức ||| Vietnamese in Use 0.0000 3 False False 1.0000 0 0 175.0585 0.0000 hist_component_K2_DC_count 0.0000 2 False True 1.0000 0 0 153.7709 0.0000 hist_component_K1_DC_count 0.0000 2 False True 1.0000 0 0 153.7709 0.0000 hist_component_B1_DC_count 0.0000 2 False True 1.0000 0 0 153.7709 0.0000 course_status_VIP ||| hà_nội_học ||| Hanoi Studies 0.0000 3 False False 0.9999 0 0 147.9655 0.0000 course_status_ENG ||| ngôn_ngữ_học_đối_chiếu ||| Contrastive Linguistics 0.0000 3 False False 0.9999 0 0 147.9655 0.0000 course_status_ENG ||| chuyên_đề_giao_tiếp_liên_văn_hóa ||| Intercultural Communication Project 0.0000 3 False False 0.9999 0 0 147.9655 0.0000 course_status_ENG ||| chuyên_đề_hướng_nghiệp ||| Career Mentoring Project 0.0000 3 False False 0.9999 0 0 147.9655 0.0000 course_status_ENG ||| ngữ_pháp_học_tiếng_anh_2 ||| English Grammar 2 0.0000 3 False False 0.9999 0 0 147.9655 0.0000 course_status_ENG ||| phiên_dịch_1 ||| Interpreting Practice 1 0.0000 3 False False 0.9998 0 0 70.5190 0.0000 course_status_ENG ||| phiên_dịch_2 ||| Interpreting Practice 2 0.0000 3 False False 0.9998 0 0 70.5190 0.0000 course_status_ENG ||| biên_dịch_2 ||| Translation Practice 2 0.0000 3 False False 0.9998 0 0 70.5190 0.0000 course_status_ENG ||| biên_dịch_1 ||| Translation Practice 1 0.0000 3 False False 0.9998 0 0 70.5190 0.0000 course_status_ENG ||| nhập_môn_biên_phiên_dịch ||| Introductory Translation & Interpreting 0.0000 3 False False 0.9998 0 0 70.5190 0.0000 course_status_ENG ||| kỹ_năng_nghe_1_a2_b1 ||| Listening skills 1 0.0000 3 False False 0.9998 0 0 67.0782 0.0000 course_status_ENG ||| kỹ_năng_viết_1_a2_b1 ||| Writing skills 1 0.0000 3 False False 0.9998 0 0 67.0782 0.0000 course_status_ENG ||| kỹ_năng_nói_1_a2_b1 ||| Speaking skills 1 0.0000 3 False False 0.9998 0 0 67.0782 0.0000 course_status_ENG ||| kỹ_năng_đọc_1_a2_b1 ||| Reading Skills 1 0.0000 3 False False 0.9998 0 0 67.0782 0.0000 course_status_ENG ||| chuyên_đề_văn_học_mỹ ||| American Literature Project 0.0000 3 False False 0.9997 0 0 65.4945 0.0000 ... 246 additional rows saved to CSV. ========================================================================================== 5. FAILURE-vs-NORMAL CLASS SEPARABILITY — DEVELOPMENT DATA ========================================================================================== How many individual features separate the two classes? directionless_auc_band feature_count feature_rate 0.50-0.52 149 0.5399 0.52-0.55 40 0.1449 0.55-0.60 22 0.0797 0.60-0.65 24 0.0870 0.65-0.70 20 0.0725 >=0.70 21 0.0761 Top 30 features by directionless univariate AUC feature valid_failure_rows valid_normal_rows mean_failure mean_normal auc_raw auc_directionless predictive_direction cohens_d_failure_minus_normal point_biserial_corr distribution_overlap information_value abs_missing_rate_gap hist_same_course_best_grade10 203 3765 2.0690 3.6707 0.2035 0.7965 lower=failure -1.1635 -0.2484 0.5384 1.3216 0.0322 hist_same_course_mean_grade10 203 3765 1.9819 3.5793 0.2073 0.7927 lower=failure -1.1603 -0.2477 0.5506 1.2985 0.0322 hist_same_course_last_grade10 203 3765 2.0069 3.5895 0.2107 0.7893 lower=failure -1.1162 -0.2389 0.5532 1.2337 0.0322 prev_semester_gpa10 1761 45435 5.3743 6.7943 0.2449 0.7551 lower=failure -1.2978 -0.2388 0.6231 0.9236 0.0014 hist_component_grade_mean 1767 45527 6.5954 7.2765 0.2522 0.7478 lower=failure -1.0539 -0.1960 0.6370 0.8491 0.0000 prev_cumulative_gpa10 1761 45435 6.3090 7.0371 0.2551 0.7449 lower=failure -1.0658 -0.1980 0.6297 0.8139 0.0014 recent3_component_grade_mean 1767 45527 6.4290 7.2274 0.2564 0.7436 lower=failure -1.0744 -0.1997 0.6278 0.8262 0.0000 hist_semester_gpa10_mean 1761 45435 6.2231 7.0026 0.2570 0.7430 lower=failure -1.0607 -0.1971 0.6175 0.8287 0.0014 recent3_semester_gpa10_mean 1761 45435 5.8279 6.8518 0.2573 0.7427 lower=failure -1.1507 -0.2131 0.6273 0.8494 0.0014 hist_course_grade10_mean 1767 45527 5.9816 6.8847 0.2573 0.7427 lower=failure -1.1084 -0.2057 0.6178 0.8764 0.0000 prev_passed_credits 1761 45435 11.1102 15.4383 0.2595 0.7405 lower=failure -1.0571 -0.1964 0.6539 0.8787 0.0014 recent3_course_grade10_mean 1767 45527 5.7002 6.7841 0.2632 0.7368 lower=failure -1.1183 -0.2075 0.6106 0.8759 0.0000 hist_component_K1_mean 1712 44893 6.0728 6.8735 0.2650 0.7350 lower=failure -0.9744 -0.1803 0.6543 0.7511 0.0172 recent3_component_grade_median 1767 45527 6.6487 7.3934 0.2726 0.7274 lower=failure -0.9888 -0.1843 0.6668 0.7409 0.0000 hist_component_K2_mean 1712 44893 7.3138 8.1873 0.2744 0.7256 lower=failure -0.9166 -0.1699 0.6457 0.7281 0.0172 hist_course_pass_rate 1767 45527 0.7671 0.9076 0.2815 0.7185 lower=failure -1.1966 -0.2213 0.6151 0.8930 0.0000 hist_course_grade10_median 1767 45527 6.2616 7.0312 0.2828 0.7172 lower=failure -1.0065 -0.1875 0.6492 0.7587 0.0000 hist_component_grade_median 1767 45527 6.8374 7.4139 0.2828 0.7172 lower=failure -0.9006 -0.1684 0.6797 0.6466 0.0000 recent3_course_grade10_median 1767 45527 5.8553 6.9215 0.2841 0.7159 lower=failure -1.1019 -0.2046 0.6581 0.7875 0.0000 hist_course_grade10_std 1762 45527 1.9415 1.4080 0.7037 0.7037 higher=failure 0.8596 0.1607 0.6537 0.7635 0.0028 recent3_course_grade10_std 1762 45527 1.9627 1.4199 0.7015 0.7015 higher=failure 0.8246 0.1543 0.6530 0.6932 0.0028 prev_failed_credits 1761 45435 5.4850 1.5933 0.6986 0.6986 higher=failure 1.2235 0.2259 0.6792 0.6173 0.0014 hist_component_low_rate 1767 45527 0.1652 0.0889 0.6985 0.6985 higher=failure 0.9701 0.1809 0.6647 0.6925 0.0000 prev_outstanding_failed_credits 1761 45435 10.9375 3.6532 0.6950 0.6950 higher=failure 1.1583 0.2144 0.7096 0.5547 0.0014 hist_component_high_rate 1767 45527 0.2960 0.4001 0.3108 0.6892 lower=failure -0.6303 -0.1187 0.6837 0.4949 0.0000 hist_component_numeric_rate 1767 45527 0.9382 0.9857 0.3190 0.6810 lower=failure -1.1189 -0.2076 0.6772 0.6161 0.0000 hist_component_special_rate 1767 45527 0.0618 0.0143 0.6810 0.6810 higher=failure 1.1189 0.2076 0.6785 0.6120 0.0000 recent3_course_grade10_min 1767 45527 2.5316 4.1092 0.3195 0.6805 lower=failure -0.7241 -0.1360 0.7036 0.4510 0.0000 hist_component_T1_special_count 1767 45527 2.4924 0.5782 0.6764 0.6764 higher=failure 1.1117 0.2063 0.6960 0.5017 0.0000 hist_component_K1_low_rate 1712 44893 0.2136 0.1057 0.6755 0.6755 higher=failure 0.8790 0.1631 0.6872 0.6337 0.0172 ... 246 additional rows saved to CSV. Top 30 features by absolute standardized mean difference feature valid_failure_rows valid_normal_rows mean_failure mean_normal auc_raw auc_directionless predictive_direction cohens_d_failure_minus_normal point_biserial_corr distribution_overlap information_value abs_missing_rate_gap prev_semester_gpa10 1761 45435 5.3743 6.7943 0.2449 0.7551 lower=failure -1.2978 -0.2388 0.6231 0.9236 0.0014 prev_failed_credits 1761 45435 5.4850 1.5933 0.6986 0.6986 higher=failure 1.2235 0.2259 0.6792 0.6173 0.0014 recent3_component_VT_count 1767 45527 1.4782 0.2925 0.6592 0.6592 higher=failure 1.2001 0.2219 0.7077 0.4266 0.0000 hist_course_pass_rate 1767 45527 0.7671 0.9076 0.2815 0.7185 lower=failure -1.1966 -0.2213 0.6151 0.8930 0.0000 recent3_component_special_count 1767 45527 2.9440 0.6738 0.6737 0.6737 higher=failure 1.1738 0.2173 0.6966 0.4900 0.0000 hist_same_course_best_grade10 203 3765 2.0690 3.6707 0.2035 0.7965 lower=failure -1.1635 -0.2484 0.5384 1.3216 0.0322 hist_same_course_mean_grade10 203 3765 1.9819 3.5793 0.2073 0.7927 lower=failure -1.1603 -0.2477 0.5506 1.2985 0.0322 prev_outstanding_failed_credits 1761 45435 10.9375 3.6532 0.6950 0.6950 higher=failure 1.1583 0.2144 0.7096 0.5547 0.0014 recent3_semester_gpa10_mean 1761 45435 5.8279 6.8518 0.2573 0.7427 lower=failure -1.1507 -0.2131 0.6273 0.8494 0.0014 hist_warning_in_last_semester 1761 45435 0.2828 0.0406 0.6211 0.6211 higher=failure 1.1414 0.2114 1.0000 0.0000 0.0014 hist_component_numeric_rate 1767 45527 0.9382 0.9857 0.3190 0.6810 lower=failure -1.1189 -0.2076 0.6772 0.6161 0.0000 hist_component_special_rate 1767 45527 0.0618 0.0143 0.6810 0.6810 higher=failure 1.1189 0.2076 0.6785 0.6120 0.0000 recent3_course_grade10_mean 1767 45527 5.7002 6.7841 0.2632 0.7368 lower=failure -1.1183 -0.2075 0.6106 0.8759 0.0000 hist_same_course_last_grade10 203 3765 2.0069 3.5895 0.2107 0.7893 lower=failure -1.1162 -0.2389 0.5532 1.2337 0.0322 hist_component_T1_special_count 1767 45527 2.4924 0.5782 0.6764 0.6764 higher=failure 1.1117 0.2063 0.6960 0.5017 0.0000 recent3_warning_count 1761 45435 0.5866 0.1046 0.6445 0.6445 higher=failure 1.1096 0.2058 1.0000 0.0000 0.0014 hist_course_grade10_mean 1767 45527 5.9816 6.8847 0.2573 0.7427 lower=failure -1.1084 -0.2057 0.6178 0.8764 0.0000 recent3_course_grade10_median 1767 45527 5.8553 6.9215 0.2841 0.7159 lower=failure -1.1019 -0.2046 0.6581 0.7875 0.0000 hist_component_VT_count 1767 45527 1.8297 0.3961 0.6587 0.6587 higher=failure 1.0886 0.2022 0.7123 0.3949 0.0000 hist_warning_rate 1761 45435 0.1486 0.0280 0.6499 0.6499 higher=failure 1.0861 0.2016 0.7095 0.5316 0.0014 hist_component_special_count 1767 45527 3.8840 0.9357 0.6736 0.6736 higher=failure 1.0789 0.2005 0.6991 0.4527 0.0000 recent3_component_grade_mean 1767 45527 6.4290 7.2274 0.2564 0.7436 lower=failure -1.0744 -0.1997 0.6278 0.8262 0.0000 prev_cumulative_gpa10 1761 45435 6.3090 7.0371 0.2551 0.7449 lower=failure -1.0658 -0.1980 0.6297 0.8139 0.0014 hist_semester_gpa10_mean 1761 45435 6.2231 7.0026 0.2570 0.7430 lower=failure -1.0607 -0.1971 0.6175 0.8287 0.0014 prev_passed_credits 1761 45435 11.1102 15.4383 0.2595 0.7405 lower=failure -1.0571 -0.1964 0.6539 0.8787 0.0014 hist_component_grade_mean 1767 45527 6.5954 7.2765 0.2522 0.7478 lower=failure -1.0539 -0.1960 0.6370 0.8491 0.0000 hist_warning_consecutive_max 1761 45435 0.7093 0.1333 0.6486 0.6486 higher=failure 1.0447 0.1942 0.7092 0.5309 0.0014 hist_warning_count 1761 45435 0.7422 0.1414 0.6483 0.6483 higher=failure 1.0221 0.1902 0.7092 0.5309 0.0014 hist_warning_credit_debt_count 1761 45435 0.7416 0.1412 0.6481 0.6481 higher=failure 1.0218 0.1901 0.7096 0.5300 0.0014 hist_course_grade10_median 1767 45527 6.2616 7.0312 0.2828 0.7172 lower=failure -1.0065 -0.1875 0.6492 0.7587 0.0000 ... 246 additional rows saved to CSV. Top 30 features by binned Information Value feature valid_failure_rows valid_normal_rows mean_failure mean_normal auc_raw auc_directionless predictive_direction cohens_d_failure_minus_normal point_biserial_corr distribution_overlap information_value abs_missing_rate_gap hist_same_course_best_grade10 203 3765 2.0690 3.6707 0.2035 0.7965 lower=failure -1.1635 -0.2484 0.5384 1.3216 0.0322 hist_same_course_mean_grade10 203 3765 1.9819 3.5793 0.2073 0.7927 lower=failure -1.1603 -0.2477 0.5506 1.2985 0.0322 hist_same_course_last_grade10 203 3765 2.0069 3.5895 0.2107 0.7893 lower=failure -1.1162 -0.2389 0.5532 1.2337 0.0322 prev_semester_gpa10 1761 45435 5.3743 6.7943 0.2449 0.7551 lower=failure -1.2978 -0.2388 0.6231 0.9236 0.0014 hist_course_pass_rate 1767 45527 0.7671 0.9076 0.2815 0.7185 lower=failure -1.1966 -0.2213 0.6151 0.8930 0.0000 prev_passed_credits 1761 45435 11.1102 15.4383 0.2595 0.7405 lower=failure -1.0571 -0.1964 0.6539 0.8787 0.0014 hist_course_grade10_mean 1767 45527 5.9816 6.8847 0.2573 0.7427 lower=failure -1.1084 -0.2057 0.6178 0.8764 0.0000 recent3_course_grade10_mean 1767 45527 5.7002 6.7841 0.2632 0.7368 lower=failure -1.1183 -0.2075 0.6106 0.8759 0.0000 recent3_semester_gpa10_mean 1761 45435 5.8279 6.8518 0.2573 0.7427 lower=failure -1.1507 -0.2131 0.6273 0.8494 0.0014 hist_component_grade_mean 1767 45527 6.5954 7.2765 0.2522 0.7478 lower=failure -1.0539 -0.1960 0.6370 0.8491 0.0000 hist_semester_gpa10_mean 1761 45435 6.2231 7.0026 0.2570 0.7430 lower=failure -1.0607 -0.1971 0.6175 0.8287 0.0014 recent3_component_grade_mean 1767 45527 6.4290 7.2274 0.2564 0.7436 lower=failure -1.0744 -0.1997 0.6278 0.8262 0.0000 prev_cumulative_gpa10 1761 45435 6.3090 7.0371 0.2551 0.7449 lower=failure -1.0658 -0.1980 0.6297 0.8139 0.0014 recent3_course_grade10_median 1767 45527 5.8553 6.9215 0.2841 0.7159 lower=failure -1.1019 -0.2046 0.6581 0.7875 0.0000 hist_course_grade10_std 1762 45527 1.9415 1.4080 0.7037 0.7037 higher=failure 0.8596 0.1607 0.6537 0.7635 0.0028 hist_course_grade10_median 1767 45527 6.2616 7.0312 0.2828 0.7172 lower=failure -1.0065 -0.1875 0.6492 0.7587 0.0000 hist_component_K1_mean 1712 44893 6.0728 6.8735 0.2650 0.7350 lower=failure -0.9744 -0.1803 0.6543 0.7511 0.0172 recent3_component_grade_median 1767 45527 6.6487 7.3934 0.2726 0.7274 lower=failure -0.9888 -0.1843 0.6668 0.7409 0.0000 hist_component_K2_mean 1712 44893 7.3138 8.1873 0.2744 0.7256 lower=failure -0.9166 -0.1699 0.6457 0.7281 0.0172 recent3_course_grade10_std 1762 45527 1.9627 1.4199 0.7015 0.7015 higher=failure 0.8246 0.1543 0.6530 0.6932 0.0028 hist_component_low_rate 1767 45527 0.1652 0.0889 0.6985 0.6985 higher=failure 0.9701 0.1809 0.6647 0.6925 0.0000 hist_component_grade_median 1767 45527 6.8374 7.4139 0.2828 0.7172 lower=failure -0.9006 -0.1684 0.6797 0.6466 0.0000 hist_component_K1_low_rate 1712 44893 0.2136 0.1057 0.6755 0.6755 higher=failure 0.8790 0.1631 0.6872 0.6337 0.0172 prev_failed_credits 1761 45435 5.4850 1.5933 0.6986 0.6986 higher=failure 1.2235 0.2259 0.6792 0.6173 0.0014 hist_component_numeric_rate 1767 45527 0.9382 0.9857 0.3190 0.6810 lower=failure -1.1189 -0.2076 0.6772 0.6161 0.0000 hist_component_special_rate 1767 45527 0.0618 0.0143 0.6810 0.6810 higher=failure 1.1189 0.2076 0.6785 0.6120 0.0000 prev_outstanding_failed_credits 1761 45435 10.9375 3.6532 0.6950 0.6950 higher=failure 1.1583 0.2144 0.7096 0.5547 0.0014 hist_warning_rate 1761 45435 0.1486 0.0280 0.6499 0.6499 higher=failure 1.0861 0.2016 0.7095 0.5316 0.0014 hist_warning_consecutive_max 1761 45435 0.7093 0.1333 0.6486 0.6486 higher=failure 1.0447 0.1942 0.7092 0.5309 0.0014 hist_warning_count 1761 45435 0.7422 0.1414 0.6483 0.6483 higher=failure 1.0221 0.1902 0.7092 0.5309 0.0014 ... 246 additional rows saved to CSV. Top 30 features where missingness differs by class feature valid_failure_rows valid_normal_rows mean_failure mean_normal auc_raw auc_directionless predictive_direction cohens_d_failure_minus_normal point_biserial_corr distribution_overlap information_value abs_missing_rate_gap hist_same_course_component_count 220 3826 2.5636 3.1508 0.3565 0.6435 lower=failure -0.4422 -0.0998 0.6920 0.4796 0.0405 hist_same_course_pass_rate 218 3808 0.0000 0.0117 0.4941 0.5059 lower=failure -0.1121 -0.0254 1.0000 0.0000 0.0397 hist_same_course_attempts 218 3808 1.1514 1.1507 0.4970 0.5030 lower=failure 0.0015 0.0003 0.9960 0.0001 0.0397 hist_same_course_CT_count 218 3808 0.0000 0.0000 0.5000 0.5000 higher=failure 0.0000 0.0000 0.9978 0.0062 0.0397 hist_same_course_VT_count 218 3808 0.0688 0.0113 0.5288 0.5288 higher=failure 0.4855 0.1092 1.0000 0.0000 0.0397 hist_component_B1_mean 1458 39100 6.8486 7.2048 0.3939 0.6061 lower=failure -0.3914 -0.0727 0.8299 0.1853 0.0337 hist_component_B1_low_rate 1458 39100 0.0629 0.0296 0.5290 0.5290 higher=failure 0.2173 0.0404 1.0000 0.0000 0.0337 hist_same_course_component_min 205 3775 1.7220 2.2358 0.3840 0.6160 lower=failure -0.3012 -0.0664 0.7824 0.2712 0.0331 hist_same_course_component_mean 205 3775 3.4896 4.6243 0.3415 0.6585 lower=failure -0.6487 -0.1420 0.7107 0.4112 0.0331 hist_same_course_best_grade10 203 3765 2.0690 3.6707 0.2035 0.7965 lower=failure -1.1635 -0.2484 0.5384 1.3216 0.0322 hist_same_course_mean_grade10 203 3765 1.9819 3.5793 0.2073 0.7927 lower=failure -1.1603 -0.2477 0.5506 1.2985 0.0322 hist_same_course_last_grade10 203 3765 2.0069 3.5895 0.2107 0.7893 lower=failure -1.1162 -0.2389 0.5532 1.2337 0.0322 hist_component_K2_mean 1712 44893 7.3138 8.1873 0.2744 0.7256 lower=failure -0.9166 -0.1699 0.6457 0.7281 0.0172 hist_component_K2_low_rate 1712 44893 0.1053 0.0370 0.6511 0.6511 higher=failure 0.8906 0.1652 0.7346 0.4225 0.0172 hist_component_K1_low_rate 1712 44893 0.2136 0.1057 0.6755 0.6755 higher=failure 0.8790 0.1631 0.6872 0.6337 0.0172 hist_component_K1_mean 1712 44893 6.0728 6.8735 0.2650 0.7350 lower=failure -0.9744 -0.1803 0.6543 0.7511 0.0172 reg_first_days_from_open 1172 30876 -1.9795 -14.2260 0.5416 0.5416 higher=failure 0.2705 0.0507 0.8528 0.1907 0.0149 reg_last_days_from_open 1172 30876 1.1246 -10.8763 0.5211 0.5211 higher=failure 0.2571 0.0482 0.8675 0.1328 0.0149 reg_span_days 1172 30876 3.1041 3.3497 0.4848 0.5152 lower=failure -0.0435 -0.0082 0.9448 0.0322 0.0149 reg_after_deadline_count 1172 30876 1.7048 1.7192 0.4955 0.5045 lower=failure -0.0046 -0.0009 0.9822 0.0050 0.0149 isDKCung 1753 44497 0.0981 0.0687 0.5147 0.5147 higher=failure 0.1156 0.0221 1.0000 0.0000 0.0147 hist_target_course_pass_rate 1577 41219 0.8062 0.8540 0.3682 0.6318 lower=failure -0.4000 -0.0752 0.7943 0.3237 0.0129 course_fail_rate_clipped 1577 41219 0.1939 0.1465 0.6318 0.6318 higher=failure 0.3982 0.0748 0.7927 0.3187 0.0129 hist_target_course_mean_grade10 1577 41219 6.2176 6.5971 0.3729 0.6271 lower=failure -0.4459 -0.0837 0.7903 0.3041 0.0129 target_semester_average_course_difficulty 1680 43615 1.2995 1.2485 0.5960 0.5960 higher=failure 0.3331 0.0628 0.8513 0.1527 0.0072 target_semester_unseen_course_rate 1742 45169 0.1075 0.1170 0.4726 0.5274 lower=failure -0.0391 -0.0074 0.9504 0.0370 0.0063 hist_component_grade_std 1762 45527 2.0429 1.7400 0.6641 0.6641 higher=failure 0.5982 0.1126 0.7210 0.4928 0.0028 recent3_component_grade_std 1762 45527 2.1458 1.8174 0.6616 0.6616 higher=failure 0.5939 0.1118 0.7200 0.4531 0.0028 hist_course_grade10_std 1762 45527 1.9415 1.4080 0.7037 0.7037 higher=failure 0.8596 0.1607 0.6537 0.7635 0.0028 recent3_course_grade10_std 1762 45527 1.9627 1.4199 0.7015 0.7015 higher=failure 0.8246 0.1543 0.6530 0.6932 0.0028 ... 246 additional rows saved to CSV. Best single-feature directionless AUC: 0.7965 Features with directionless AUC >= 0.60: 65 / 276 Low univariate separation does not prove a feature is useless; interactions may still matter. These tables are evidence for review, not automatic deletion rules. ========================================================================================== 6. TEMPORAL FEATURE DRIFT AND FEATURE-TARGET STABILITY ========================================================================================== Top 30 features by maximum adjacent-semester PSI feature adjacent_pairs psi_median psi_max psi_max_pair standardized_mean_shift_max mean_shift_max_pair abs_missing_change_max missing_change_max_pair is_summer_target 15 0.0000 27.6310 20243->20251 0.0000 20181->20182 0.0000 20181->20182 isDKCung 15 0.0000 27.6310 20192->20201 0.0000 20181->20182 0.9840 20243->20251 target_semester_average_course_difficulty 15 1.0400 15.5977 20182->20191 1.2305 20242->20243 0.6077 20182->20191 reg_after_deadline_count 15 6.0784 11.7808 20231->20232 7.1794 20222->20231 0.9997 20212->20221 hist_component_grade_max 15 0.0000 11.4963 20182->20191 3.5178 20182->20191 0.0003 20243->20251 hist_component_grade_std 15 0.1185 11.4599 20182->20191 3.3893 20182->20191 0.0010 20231->20232 recent3_component_grade_max 15 0.0038 11.4385 20182->20191 3.5076 20182->20191 0.0003 20243->20251 recent3_component_grade_std 15 0.0683 11.4363 20182->20191 2.9947 20182->20191 0.0010 20231->20232 hist_component_high_rate 15 0.1334 9.9812 20182->20191 2.0139 20182->20191 0.0003 20243->20251 hist_target_course_pass_rate 15 1.5631 9.8644 20242->20243 1.2132 20243->20251 0.4849 20182->20191 reg_last_days_from_open 15 6.6599 9.5261 20222->20231 108.6467 20211->20212 0.9997 20212->20221 target_semester_registered_credits 15 0.5596 9.1831 20242->20243 3.2200 20243->20251 0.0000 20181->20182 hist_component_count 15 1.0771 8.8661 20192->20201 21.2259 20182->20191 0.0000 20181->20182 course_fail_rate_clipped 15 1.8535 8.4171 20242->20243 1.2069 20243->20251 0.4849 20182->20191 reg_first_days_from_open 15 7.2413 8.3039 20222->20231 123.9958 20211->20212 0.9997 20212->20221 hist_semester_count 15 1.0016 8.0138 20182->20191 0.4502 20242->20243 0.0208 20182->20191 hist_component_courses 15 1.7162 7.9775 20192->20201 11.5869 20181->20182 0.0000 20181->20182 hist_ssvhk_semester_count 15 0.1094 7.8004 20182->20191 0.6270 20191->20192 0.0000 20181->20182 hist_target_course_count 15 1.4567 7.6800 20242->20243 3.6849 20243->20251 0.0000 20181->20182 target_semester_difficulty_weighted_workload 15 0.6550 7.4367 20242->20243 2.7387 20243->20251 0.0000 20181->20182 hist_same_course_best_grade10 15 0.0917 7.1431 20181->20182 0.7514 20182->20191 0.2775 20242->20243 hist_same_course_component_mean 15 0.1637 7.1431 20181->20182 2.1031 20182->20191 0.2775 20242->20243 hist_same_course_component_min 15 0.0857 7.1431 20181->20182 2.4826 20182->20191 0.2775 20242->20243 hist_same_course_last_grade10 15 0.0972 7.1431 20181->20182 0.7514 20182->20191 0.2775 20242->20243 hist_same_course_mean_grade10 15 0.1144 7.1431 20181->20182 0.8019 20182->20191 0.2775 20242->20243 hist_component_K2_count 15 0.6972 6.9562 20192->20201 42.4946 20182->20191 0.0000 20181->20182 hist_target_course_mean_grade10 15 2.0208 6.9296 20242->20243 0.9304 20243->20251 0.4849 20182->20191 hist_component_grade_count 15 1.1738 6.7725 20192->20201 12.8683 20181->20182 0.0000 20181->20182 hist_component_K1_count 15 0.6557 5.9752 20192->20201 42.5022 20182->20191 0.0000 20181->20182 hist_component_T1_count 15 1.5264 5.8736 20211->20212 8.6624 20181->20182 0.0000 20181->20182 ... 246 additional rows saved to CSV. Top 30 features by standardized mean shift feature adjacent_pairs psi_median psi_max psi_max_pair standardized_mean_shift_max mean_shift_max_pair abs_missing_change_max missing_change_max_pair reg_first_days_from_open 15 7.2413 8.3039 20222->20231 123.9958 20211->20212 0.9997 20212->20221 reg_last_days_from_open 15 6.6599 9.5261 20222->20231 108.6467 20211->20212 0.9997 20212->20221 hist_component_K1_count 15 0.6557 5.9752 20192->20201 42.5022 20182->20191 0.0000 20181->20182 hist_component_K2_count 15 0.6972 6.9562 20192->20201 42.4946 20182->20191 0.0000 20181->20182 recent3_component_grade_count 15 0.1619 5.7918 20192->20201 28.6419 20182->20191 0.0000 20181->20182 hist_component_count 15 1.0771 8.8661 20192->20201 21.2259 20182->20191 0.0000 20181->20182 prev_semester_NHHK 15 0.0000 0.1330 20202->20211 18.8508 20192->20201 0.0208 20182->20191 hist_component_grade_count 15 1.1738 6.7725 20192->20201 12.8683 20181->20182 0.0000 20181->20182 hist_component_courses 15 1.7162 7.9775 20192->20201 11.5869 20181->20182 0.0000 20181->20182 prev_semester_ordinal 15 0.0000 0.1330 20202->20211 11.1275 20191->20192 0.0208 20182->20191 student_prior_course_count_log 15 1.7030 5.6643 20211->20212 8.7814 20181->20182 0.0000 20181->20182 hist_course_grade10_count 15 1.7024 5.6660 20211->20212 8.6648 20181->20182 0.0000 20181->20182 hist_component_T1_count 15 1.5264 5.8736 20211->20212 8.6624 20181->20182 0.0000 20181->20182 hist_same_course_component_count 15 0.0881 0.2086 20243->20251 7.6026 20182->20191 0.2775 20242->20243 reg_after_deadline_count 15 6.0784 11.7808 20231->20232 7.1794 20222->20231 0.9997 20212->20221 hist_registered_credits_mean 15 0.4259 1.5077 20212->20221 6.1414 20182->20191 0.0208 20182->20191 hist_hp_special_rate 15 0.0000 0.0000 20181->20182 5.5619 20243->20251 0.0000 20181->20182 hist_passed_credits_sum 15 2.0761 4.5191 20192->20201 4.8245 20181->20182 0.0208 20182->20191 recent3_registered_credits_mean 15 0.0777 0.5723 20243->20251 4.5914 20182->20191 0.0208 20182->20191 target_semester_unseen_course_rate 15 0.0910 2.3927 20182->20191 4.5775 20182->20191 0.0354 20243->20251 recent3_course_grade10_count 15 0.1060 3.9720 20192->20201 4.5535 20182->20191 0.0000 20181->20182 course_status_PML ||| pháp_luật_đại_cương ||| General Law 15 0.0000 0.2454 20222->20231 4.1166 20212->20221 0.0000 20181->20182 course_status_ESP ||| thực_hành_tiếng_b2 ||| English Language Skills B2 15 0.0000 3.9846 20243->20251 4.0398 20232->20241 0.0000 20181->20182 hist_component_K2_mean 15 0.0508 4.7790 20182->20191 3.8790 20182->20191 0.9343 20181->20182 hist_target_course_count 15 1.4567 7.6800 20242->20243 3.6849 20243->20251 0.0000 20181->20182 hist_component_grade_max 15 0.0000 11.4963 20182->20191 3.5178 20182->20191 0.0003 20243->20251 recent3_component_grade_max 15 0.0038 11.4385 20182->20191 3.5076 20182->20191 0.0003 20243->20251 hist_component_grade_std 15 0.1185 11.4599 20182->20191 3.3893 20182->20191 0.0010 20231->20232 target_semester_registered_credits 15 0.5596 9.1831 20242->20243 3.2200 20243->20251 0.0000 20181->20182 course_status_FIT ||| trí_tuệ_nhân_tạo ||| Artificial Intelligence 15 0.0000 0.0000 20181->20182 3.0735 20222->20231 0.0000 20181->20182 ... 246 additional rows saved to CSV. Top 30 features by semester missingness change feature adjacent_pairs psi_median psi_max psi_max_pair standardized_mean_shift_max mean_shift_max_pair abs_missing_change_max missing_change_max_pair reg_span_days 15 0.9666 3.8422 20222->20231 2.2931 20211->20212 0.9997 20212->20221 reg_last_days_from_open 15 6.6599 9.5261 20222->20231 108.6467 20211->20212 0.9997 20212->20221 reg_first_days_from_open 15 7.2413 8.3039 20222->20231 123.9958 20211->20212 0.9997 20212->20221 reg_after_deadline_count 15 6.0784 11.7808 20231->20232 7.1794 20222->20231 0.9997 20212->20221 isDKCung 15 0.0000 27.6310 20192->20201 0.0000 20181->20182 0.9840 20243->20251 hist_component_K1_low_rate 15 0.0930 0.4179 20222->20231 0.8178 20222->20231 0.9343 20181->20182 hist_component_K1_mean 15 0.0427 0.9604 20212->20221 0.9806 20212->20221 0.9343 20181->20182 hist_component_K2_low_rate 15 0.0317 0.4094 20243->20251 0.1694 20192->20201 0.9343 20181->20182 hist_component_B1_low_rate 15 0.0000 0.2186 20192->20201 0.3836 20192->20201 0.9343 20181->20182 hist_component_K2_mean 15 0.0508 4.7790 20182->20191 3.8790 20182->20191 0.9343 20181->20182 hist_component_B1_mean 15 0.0749 0.9370 20192->20201 1.0484 20192->20201 0.9343 20181->20182 target_semester_average_course_difficulty 15 1.0400 15.5977 20182->20191 1.2305 20242->20243 0.6077 20182->20191 hist_target_course_mean_grade10 15 2.0208 6.9296 20242->20243 0.9304 20243->20251 0.4849 20182->20191 hist_target_course_pass_rate 15 1.5631 9.8644 20242->20243 1.2132 20243->20251 0.4849 20182->20191 course_fail_rate_clipped 15 1.8535 8.4171 20242->20243 1.2069 20243->20251 0.4849 20182->20191 hist_same_course_attempts 15 0.0000 0.1698 20243->20251 0.3424 20243->20251 0.2775 20242->20243 hist_same_course_component_min 15 0.0857 7.1431 20181->20182 2.4826 20182->20191 0.2775 20242->20243 hist_same_course_component_count 15 0.0881 0.2086 20243->20251 7.6026 20182->20191 0.2775 20242->20243 hist_same_course_best_grade10 15 0.0917 7.1431 20181->20182 0.7514 20182->20191 0.2775 20242->20243 hist_same_course_VT_count 15 0.0000 0.0000 20181->20182 2.2361 20182->20191 0.2775 20242->20243 hist_same_course_CT_count 15 0.0000 0.0000 20181->20182 0.0000 20181->20182 0.2775 20242->20243 hist_same_course_mean_grade10 15 0.1144 7.1431 20181->20182 0.8019 20182->20191 0.2775 20242->20243 hist_same_course_last_grade10 15 0.0972 7.1431 20181->20182 0.7514 20182->20191 0.2775 20242->20243 hist_same_course_pass_rate 15 0.0000 0.0000 20181->20182 0.4082 20181->20182 0.2775 20242->20243 hist_same_course_component_mean 15 0.1637 7.1431 20181->20182 2.1031 20182->20191 0.2775 20242->20243 target_semester_unseen_course_rate 15 0.0910 2.3927 20182->20191 4.5775 20182->20191 0.0354 20243->20251 prev_semester_NHHK 15 0.0000 0.1330 20202->20211 18.8508 20192->20201 0.0208 20182->20191 recent3_semester_count 15 0.0006 4.0179 20243->20251 0.7421 20242->20243 0.0208 20182->20191 recent3_registered_credits_mean 15 0.0777 0.5723 20243->20251 4.5914 20182->20191 0.0208 20182->20191 prev_semester_gpa10 15 0.1050 0.6628 20182->20191 0.5913 20182->20191 0.0208 20182->20191 ... 246 additional rows saved to CSV. Top 30 temporally strong feature-target relationships feature valid_semesters auc_directionless_mean auc_directionless_std auc_directionless_min auc_directionless_max predictive_direction_changes cohens_d_abs_mean cohens_d_abs_std hist_same_course_best_grade10 10 0.8108 0.0526 0.7330 0.8995 0.0000 1.2018 0.3498 hist_same_course_mean_grade10 10 0.8047 0.0588 0.7223 0.8956 0.0000 1.1920 0.3561 hist_same_course_last_grade10 10 0.8001 0.0557 0.7204 0.8925 0.0000 1.1434 0.3474 prev_semester_gpa10 17 0.7345 0.0645 0.5822 0.8363 0.0000 1.1074 0.4350 hist_component_grade_mean 17 0.7245 0.0650 0.5332 0.8232 0.0000 0.9382 0.3329 hist_course_grade10_mean 17 0.7221 0.0595 0.5577 0.8107 2.0000 1.0104 0.3064 hist_component_K1_mean 15 0.7198 0.0667 0.5533 0.8084 0.0000 0.9567 0.2743 recent3_component_grade_mean 17 0.7188 0.0726 0.5262 0.8239 0.0000 0.9474 0.3737 hist_course_grade10_std 17 0.7166 0.0499 0.5784 0.8091 1.0000 0.8320 0.2547 recent3_course_grade10_mean 17 0.7152 0.0676 0.5612 0.8200 2.0000 1.0175 0.3499 prev_cumulative_gpa10 17 0.7146 0.0509 0.6101 0.8058 0.0000 0.9186 0.3252 hist_semester_gpa10_mean 17 0.7144 0.0566 0.5752 0.8218 0.0000 0.9284 0.3150 hist_component_K2_mean 15 0.7139 0.0669 0.6191 0.8176 0.0000 0.9001 0.3004 recent3_semester_gpa10_mean 17 0.7110 0.0596 0.5752 0.8042 2.0000 1.0040 0.3629 recent3_course_grade10_std 17 0.7076 0.0536 0.5784 0.8131 1.0000 0.7755 0.2668 recent3_component_grade_median 17 0.7067 0.0610 0.5367 0.7869 0.0000 0.8708 0.3250 recent3_course_grade10_median 17 0.7027 0.0545 0.5949 0.7786 2.0000 0.9897 0.3511 hist_course_pass_rate 17 0.7014 0.0738 0.5295 0.8797 1.0000 1.0334 0.4098 hist_component_grade_median 17 0.6976 0.0524 0.5472 0.7783 2.0000 0.8116 0.2759 prev_passed_credits 17 0.6975 0.0806 0.5551 0.8265 2.0000 0.9235 0.4013 hist_course_grade10_median 17 0.6962 0.0447 0.6164 0.7770 2.0000 0.8987 0.2552 hist_component_low_rate 17 0.6822 0.0752 0.5434 0.8296 3.0000 0.8431 0.3821 prev_outstanding_failed_credits 17 0.6772 0.0818 0.5221 0.8194 1.0000 1.0130 0.4844 hist_component_K1_low_rate 14 0.6757 0.0588 0.5778 0.8074 0.0000 0.8753 0.2492 hist_component_high_rate 17 0.6746 0.0620 0.5757 0.7704 0.0000 0.6199 0.2519 recent3_course_grade10_min 17 0.6727 0.0585 0.5455 0.7705 2.0000 0.6574 0.2307 prev_failed_credits 17 0.6678 0.0915 0.5364 0.8778 1.0000 1.0612 0.5881 hist_component_grade_std 17 0.6674 0.0566 0.5717 0.7986 1.0000 0.5982 0.2163 hist_course_grade10_min 17 0.6624 0.0598 0.5070 0.7362 2.0000 0.6311 0.2197 hist_failed_credits_sum 17 0.6616 0.0824 0.5224 0.8024 1.0000 0.8853 0.4572 ... 208 additional rows saved to CSV. Top 30 temporally unstable or direction-changing relationships feature valid_semesters auc_directionless_mean auc_directionless_std auc_directionless_min auc_directionless_max predictive_direction_changes cohens_d_abs_mean cohens_d_abs_std course_status_FIT ||| khai_phá_dữ_liệu_lớn ||| Big Data Mining 13 0.5314 0.0273 0.5034 0.6118 11.0000 0.2145 0.2337 course_status_FIT ||| hệ_thống_nhúng ||| Embedded system 15 0.5252 0.0137 0.5003 0.5454 10.0000 0.1351 0.0851 prev_semester_NHHK 15 0.5452 0.0655 0.5002 0.7343 8.0000 0.2840 0.3346 prev_semester_ordinal 15 0.5452 0.0655 0.5002 0.7343 8.0000 0.2992 0.3239 course_status_FIT ||| tương_tác_người_máy ||| Human-Computer Interaction 13 0.5181 0.0164 0.5001 0.5556 8.0000 0.1071 0.0998 course_status_FIT ||| phát_triển_phần_mềm_java ||| Java Software Development 11 0.5089 0.0097 0.5006 0.5349 8.0000 0.1093 0.0875 course_status_FIT ||| học_máy_và_ứng_dụng ||| Machine Learning and Applications 12 0.5119 0.0115 0.5014 0.5347 7.0000 0.1778 0.1732 hist_component_DC_count 15 0.5064 0.0078 0.5000 0.5262 7.0000 0.1202 0.1446 hist_component_T1_DC_count 15 0.5064 0.0078 0.5000 0.5261 7.0000 0.1101 0.1123 prev_ssvhk_HienDienSV 13 0.5041 0.0075 0.5003 0.5299 7.0000 0.1246 0.1931 prev_conduct_score 17 0.5811 0.0727 0.5013 0.7982 6.0000 0.3228 0.2383 hist_hp_special_rate 17 0.5318 0.0724 0.5001 0.8129 6.0000 0.2204 0.2469 target_semester_unseen_course_rate 15 0.5422 0.0456 0.5005 0.6321 6.0000 0.1962 0.1574 hist_component_B1_count 15 0.5504 0.0363 0.5002 0.6174 6.0000 0.2346 0.1427 course_status_PML ||| những_nguyên_lý_cơ_bản_của_chủ_nghĩa_mác_lênin_2 ||| Fundamental Principles of Marxism-Leninism 2 16 0.5281 0.0287 0.5002 0.6115 6.0000 0.1759 0.1325 hist_hp_VT_count 17 0.5191 0.0278 0.5000 0.6049 6.0000 0.2278 0.2313 hist_hp_special_count 17 0.5196 0.0276 0.5000 0.6049 6.0000 0.2315 0.2218 recent3_hp_VT_count 12 0.5206 0.0253 0.5006 0.5857 6.0000 0.2477 0.2443 recent3_hp_special_count 12 0.5206 0.0253 0.5006 0.5857 6.0000 0.2477 0.2443 recent3_component_DC_count 14 0.5059 0.0070 0.5002 0.5217 6.0000 0.1023 0.0954 course_status_FIT ||| thực_tập_tốt_nghiệp ||| Internship 11 0.5110 0.0069 0.5005 0.5219 6.0000 0.1097 0.0741 course_status_ESP ||| thực_hành_tiếng_b2 ||| English Language Skills B2 12 0.5422 0.0433 0.5002 0.6418 5.0000 0.2178 0.1658 course_status_ESP ||| thực_hành_tiếng_b1 ||| English Language Skills B1 12 0.5364 0.0390 0.5002 0.6396 5.0000 0.2240 0.1964 course_status_ESP ||| thực_hành_tiếng_a2 ||| English Language Skills A2 13 0.5345 0.0372 0.5004 0.6377 5.0000 0.2397 0.1886 course_status_FIT ||| chuyên_đề_1 ||| Special Subject in Information Technology 1 13 0.5383 0.0283 0.5048 0.6093 5.0000 0.1881 0.1048 course_status_FIT ||| kinh_doanh_điện_tử ||| E-Business 13 0.5194 0.0243 0.5049 0.5985 5.0000 0.1320 0.1280 reg_last_days_from_open 8 0.5372 0.0232 0.5095 0.5751 5.0000 0.1304 0.1064 course_history_missing_flag 15 0.5193 0.0171 0.5003 0.5636 5.0000 0.1366 0.0762 course_status_FIT ||| trí_tuệ_nhân_tạo ||| Artificial Intelligence 13 0.5187 0.0149 0.5002 0.5468 5.0000 0.1850 0.1865 course_status_FIT ||| lập_trình_cho_thiết_bị_di_động ||| Mobile Programming 11 0.5183 0.0145 0.5001 0.5401 5.0000 0.1606 0.0774 ... 208 additional rows saved to CSV. ========================================================================================== 7. FEATURE CORRELATION, REDUNDANCY, AND POSSIBLE LEAKAGE REVIEW ========================================================================================== Feature pairs with |Pearson correlation| >= 0.95 feature_a feature_b pearson_corr abs_corr hist_component_numeric_rate hist_component_special_rate -1.0000 1.0000 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 1.0000 1.0000 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching course_status_VIP ||| tiếng_việt_trong_hành_chức ||| Vietnamese in Use 1.0000 1.0000 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching course_status_VIP ||| hà_nội_học ||| Hanoi Studies 1.0000 1.0000 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching course_status_FIT ||| ứng_dụng_công_nghệ_thông_tin ||| Computer Skills 1.0000 1.0000 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design 1.0000 1.0000 course_status_ENG ||| kiến_tập ||| Practicum course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 1.0000 1.0000 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 course_status_VIP ||| hà_nội_học ||| Hanoi Studies 1.0000 1.0000 course_status_FIT ||| ứng_dụng_công_nghệ_thông_tin ||| Computer Skills course_status_VIP ||| tiếng_việt_trong_hành_chức ||| Vietnamese in Use 1.0000 1.0000 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design 1.0000 1.0000 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 course_status_VIP ||| tiếng_việt_trong_hành_chức ||| Vietnamese in Use 1.0000 1.0000 course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design course_status_VIP ||| tiếng_việt_trong_hành_chức ||| Vietnamese in Use 1.0000 1.0000 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 course_status_FIT ||| ứng_dụng_công_nghệ_thông_tin ||| Computer Skills 1.0000 1.0000 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a1 ||| Second Foreign Language - French A1 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a2 ||| Second Foreign Language - French A2 1.0000 1.0000 course_status_ENG ||| kỹ_năng_viết_2_b1 ||| Writing skills 2 course_status_ENG ||| kỹ_năng_đọc_2_b1 ||| Reading skills 2 1.0000 1.0000 course_status_ENG ||| kỹ_năng_viết_3_b2 ||| Writing skills 3 course_status_ENG ||| kỹ_năng_đọc_3_b2 ||| Reading skills 3 1.0000 1.0000 course_status_ENG ||| nhập_môn_biên_phiên_dịch ||| Introductory Translation & Interpreting course_status_ENG ||| phiên_dịch_2 ||| Interpreting Practice 2 1.0000 1.0000 course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design course_status_FIT ||| ứng_dụng_công_nghệ_thông_tin ||| Computer Skills 1.0000 1.0000 course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design course_status_VIP ||| hà_nội_học ||| Hanoi Studies 1.0000 1.0000 course_status_FIT ||| ứng_dụng_công_nghệ_thông_tin ||| Computer Skills course_status_VIP ||| hà_nội_học ||| Hanoi Studies 1.0000 1.0000 course_status_VIP ||| hà_nội_học ||| Hanoi Studies course_status_VIP ||| tiếng_việt_trong_hành_chức ||| Vietnamese in Use 1.0000 1.0000 course_status_ENG ||| kiến_tập ||| Practicum course_status_VIP ||| tiếng_việt_trong_hành_chức ||| Vietnamese in Use 1.0000 1.0000 course_status_ENG ||| kỹ_năng_viết_1_a2_b1 ||| Writing skills 1 course_status_ENG ||| kỹ_năng_đọc_1_a2_b1 ||| Reading Skills 1 1.0000 1.0000 course_status_ENG ||| kỹ_năng_nghe_1_a2_b1 ||| Listening skills 1 course_status_ENG ||| kỹ_năng_đọc_1_a2_b1 ||| Reading Skills 1 1.0000 1.0000 course_status_ENG ||| kỹ_năng_nghe_1_a2_b1 ||| Listening skills 1 course_status_ENG ||| kỹ_năng_nói_1_a2_b1 ||| Speaking skills 1 1.0000 1.0000 course_status_ENG ||| kỹ_năng_nghe_1_a2_b1 ||| Listening skills 1 course_status_ENG ||| kỹ_năng_viết_1_a2_b1 ||| Writing skills 1 1.0000 1.0000 course_status_ENG ||| kỹ_năng_nói_1_a2_b1 ||| Speaking skills 1 course_status_ENG ||| kỹ_năng_viết_1_a2_b1 ||| Writing skills 1 1.0000 1.0000 course_status_ENG ||| kỹ_năng_nói_1_a2_b1 ||| Speaking skills 1 course_status_ENG ||| kỹ_năng_đọc_1_a2_b1 ||| Reading Skills 1 1.0000 1.0000 course_status_ENG ||| kỹ_năng_nghe_3_b2 ||| Listening skills 3 course_status_ENG ||| kỹ_năng_đọc_3_b2 ||| Reading skills 3 1.0000 1.0000 course_status_ENG ||| kỹ_năng_nghe_3_b2 ||| Listening skills 3 course_status_ENG ||| kỹ_năng_viết_3_b2 ||| Writing skills 3 1.0000 1.0000 course_status_ENG ||| biên_dịch_2 ||| Translation Practice 2 course_status_ENG ||| nhập_môn_biên_phiên_dịch ||| Introductory Translation & Interpreting 1.0000 1.0000 course_status_ENG ||| biên_dịch_2 ||| Translation Practice 2 course_status_ENG ||| phiên_dịch_2 ||| Interpreting Practice 2 1.0000 1.0000 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching course_status_ENG ||| kiến_tập ||| Practicum 1.0000 1.0000 course_status_ENG ||| kiến_tập ||| Practicum course_status_VIP ||| hà_nội_học ||| Hanoi Studies 1.0000 1.0000 hist_component_K1_DC_count hist_component_K2_DC_count 1.0000 1.0000 recent3_hp_VT_count recent3_hp_special_count 1.0000 1.0000 hist_component_B1_DC_count hist_component_K1_DC_count 1.0000 1.0000 hist_component_B1_DC_count hist_component_K2_DC_count 1.0000 1.0000 course_status_ENG ||| kiến_tập ||| Practicum course_status_FIT ||| ứng_dụng_công_nghệ_thông_tin ||| Computer Skills 1.0000 1.0000 course_status_ENG ||| kiến_tập ||| Practicum course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design 1.0000 1.0000 hist_target_course_pass_rate course_fail_rate_clipped -0.9998 0.9998 hist_warning_count hist_warning_credit_debt_count 0.9997 0.9997 hist_hp_VT_count hist_hp_special_count 0.9990 0.9990 hist_component_K2_count hist_component_K1_count 0.9990 0.9990 prev_semester_NHHK prev_semester_ordinal 0.9983 0.9983 hist_component_count hist_component_grade_count 0.9977 0.9977 course_status_VIP ||| cơ_sở_văn_hóa_việt_nam ||| Fundamentals of Vietnamese Culture course_status_VIP ||| dẫn_luận_ngôn_ngữ_học ||| Introduction to Linguistics 0.9976 0.9976 prev_ssvhk_NHHK prev_ssvhk_semester_ordinal 0.9974 0.9974 prev_ssvhk_NHHK prev_semester_NHHK 0.9967 0.9967 course_status_ENG ||| kỹ_năng_nói_2_b1 ||| Speaking skills 2 course_status_ENG ||| kỹ_năng_đọc_2_b1 ||| Reading skills 2 0.9961 0.9961 course_status_ENG ||| kỹ_năng_nói_2_b1 ||| Speaking skills 2 course_status_ENG ||| kỹ_năng_viết_2_b1 ||| Writing skills 2 0.9961 0.9961 hist_component_grade_count hist_component_K1_count 0.9960 0.9960 course_status_ESP ||| thực_hành_tiếng_a2 ||| English Language Skills A2 course_status_ESP ||| thực_hành_tiếng_b1 ||| English Language Skills B1 0.9955 0.9955 hist_component_grade_count hist_component_K2_count 0.9953 0.9953 hist_component_count hist_component_K2_count 0.9953 0.9953 hist_component_K2_CT_count hist_component_K2_special_count 0.9948 0.9948 prev_ssvhk_NHHK prev_semester_ordinal 0.9945 0.9945 hist_component_count hist_component_K1_count 0.9943 0.9943 hist_component_courses hist_component_T1_count 0.9931 0.9931 prev_ssvhk_semester_ordinal prev_semester_ordinal 0.9931 0.9931 prev_ssvhk_semester_ordinal prev_semester_NHHK 0.9929 0.9929 course_status_ENG ||| kỹ_năng_nói_3_b2 ||| Speaking skills 3 course_status_ENG ||| kỹ_năng_đọc_3_b2 ||| Reading skills 3 0.9927 0.9927 course_status_ENG ||| kỹ_năng_nói_3_b2 ||| Speaking skills 3 course_status_ENG ||| kỹ_năng_viết_3_b2 ||| Writing skills 3 0.9927 0.9927 course_status_ENG ||| kỹ_năng_nghe_3_b2 ||| Listening skills 3 course_status_ENG ||| kỹ_năng_nói_3_b2 ||| Speaking skills 3 0.9927 0.9927 reg_first_days_from_open reg_last_days_from_open 0.9924 0.9924 course_status_ENG ||| kỹ_năng_nghe_2_b1 ||| Listening skills 2 course_status_ENG ||| kỹ_năng_viết_2_b1 ||| Writing skills 2 0.9923 0.9923 course_status_ENG ||| kỹ_năng_nghe_2_b1 ||| Listening skills 2 course_status_ENG ||| kỹ_năng_đọc_2_b1 ||| Reading skills 2 0.9923 0.9923 course_status_ENG ||| kỹ_năng_nói_4_c1 ||| Speaking skills 4 course_status_ENG ||| kỹ_năng_viết_4_c1 ||| Writing skills 4 0.9909 0.9909 course_status_ENG ||| kỹ_năng_viết_4_c1 ||| Writing skills 4 course_status_ENG ||| kỹ_năng_đọc_4_c1 ||| Reading skills 4 0.9909 0.9909 course_status_ENG ||| kỹ_năng_nghe_2_b1 ||| Listening skills 2 course_status_ENG ||| kỹ_năng_nói_2_b1 ||| Speaking skills 2 0.9884 0.9884 course_status_ENG ||| kỹ_năng_nói_4_c1 ||| Speaking skills 4 course_status_ENG ||| kỹ_năng_đọc_4_c1 ||| Reading skills 4 0.9879 0.9879 course_status_ENG ||| ngữ_âm_âm_vị_học_tiếng_anh ||| English Phonetics and Phonology course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a1 ||| Second Foreign Language - French A1 0.9877 0.9877 course_status_ENG ||| ngữ_âm_âm_vị_học_tiếng_anh ||| English Phonetics and Phonology course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a2 ||| Second Foreign Language - French A2 0.9877 0.9877 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_1 ||| English Language Teaching Methodology 1 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a1 ||| Second Foreign Language - French A1 0.9877 0.9877 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_1 ||| English Language Teaching Methodology 1 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a2 ||| Second Foreign Language - French A2 0.9877 0.9877 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_1b1 ||| Second Foreign Language - French 1B1 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a2 ||| Second Foreign Language - French A2 0.9877 0.9877 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_1b1 ||| Second Foreign Language - French 1B1 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a1 ||| Second Foreign Language - French A1 0.9877 0.9877 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_2b1 ||| Second Foreign Language - French 2B1 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a2 ||| Second Foreign Language - French A2 0.9877 0.9877 course_status_ENG ||| tâm_lý_học_trong_giảng_dạy_ngôn_ngữ ||| Psychology in Language Teaching course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a1 ||| Second Foreign Language - French A1 0.9877 0.9877 course_status_ENG ||| tâm_lý_học_trong_giảng_dạy_ngôn_ngữ ||| Psychology in Language Teaching course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a2 ||| Second Foreign Language - French A2 0.9877 0.9877 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_2b1 ||| Second Foreign Language - French 2B1 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a1 ||| Second Foreign Language - French A1 0.9877 0.9877 course_status_ENG ||| nhập_môn_nghiên_cứu ||| Introductory Research course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a1 ||| Second Foreign Language - French A1 0.9877 0.9877 course_status_ENG ||| nhập_môn_nghiên_cứu ||| Introductory Research course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a2 ||| Second Foreign Language - French A2 0.9877 0.9877 course_status_ENG ||| lý_thuyết_học_ngoại_ngữ ||| Second Language Acquisition Theory course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a2 ||| Second Foreign Language - French A2 0.9877 0.9877 course_status_ENG ||| lý_thuyết_học_ngoại_ngữ ||| Second Language Acquisition Theory course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a1 ||| Second Foreign Language - French A1 0.9877 0.9877 course_status_ENG ||| kiểm_tra_và_đánh_giá_ngôn_ngữ ||| Language Testing and Assessment course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a1 ||| Second Foreign Language - French A1 0.9877 0.9877 course_status_ENG ||| kiểm_tra_và_đánh_giá_ngôn_ngữ ||| Language Testing and Assessment course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a2 ||| Second Foreign Language - French A2 0.9877 0.9877 hist_course_grade10_count hist_component_courses 0.9867 0.9867 hist_course_grade10_count hist_component_T1_count 0.9866 0.9866 course_status_ENG ||| kỹ_năng_viết_3_b2 ||| Writing skills 3 course_status_VIP ||| nhập_môn_việt_ngữ_học ||| Introductory Vietnamese Linguistics 0.9856 0.9856 course_status_ENG ||| kỹ_năng_nghe_3_b2 ||| Listening skills 3 course_status_VIP ||| nhập_môn_việt_ngữ_học ||| Introductory Vietnamese Linguistics 0.9856 0.9856 course_status_ENG ||| kỹ_năng_đọc_3_b2 ||| Reading skills 3 course_status_VIP ||| nhập_môn_việt_ngữ_học ||| Introductory Vietnamese Linguistics 0.9856 0.9856 hist_component_grade_min recent3_component_grade_min 0.9837 0.9837 hist_component_grade_count hist_component_T1_count 0.9836 0.9836 hist_component_grade_max recent3_component_grade_max 0.9833 0.9833 hist_warning_count hist_warning_consecutive_max 0.9827 0.9827 course_status_ENG ||| biên_dịch_2 ||| Translation Practice 2 course_status_ENG ||| phiên_dịch_1 ||| Interpreting Practice 1 0.9826 0.9826 course_status_ENG ||| phiên_dịch_1 ||| Interpreting Practice 1 course_status_ENG ||| phiên_dịch_2 ||| Interpreting Practice 2 0.9826 0.9826 course_status_ENG ||| nhập_môn_biên_phiên_dịch ||| Introductory Translation & Interpreting course_status_ENG ||| phiên_dịch_1 ||| Interpreting Practice 1 0.9826 0.9826 course_status_ENG ||| biên_dịch_1 ||| Translation Practice 1 course_status_ENG ||| phiên_dịch_2 ||| Interpreting Practice 2 0.9826 0.9826 ... 74 additional rows saved to CSV. High-correlation pair count: 174 Highly correlated pairs are redundancy candidates, but retain domain meaning and temporal stability when choosing which member to keep. ========================================================================================== 8. COURSE, STUDENT, COLD-START, AND COHORT ANALYSES ========================================================================================== Highest-risk courses with at least 50 rows (smoothed rate) IDMH rows unique_students semesters failures failure_rate mean_grade median_grade smoothed_failure_rate -7066899376620845560 292 292 5 79 0.2705 5.3301 5.8000 0.2365 -7486891101082335117 232 232 4 36 0.1552 5.9026 6.1000 0.1343 -6732178074841306111 261 261 7 38 0.1456 6.1330 6.4000 0.1282 -6753444769929144915 174 174 3 22 0.1264 5.8925 5.8000 0.1066 -6844597061195793389 146 146 3 19 0.1301 5.7473 5.9000 0.1065 -8528697341869679249 409 409 6 47 0.1149 6.2509 6.4000 0.1065 -7497021832674080904 267 267 4 30 0.1124 6.4180 6.4000 0.1005 -6945717004766910629 89 89 2 12 0.1348 5.8978 5.9000 0.0998 -6595805319696904699 402 402 8 43 0.1070 6.3184 6.4000 0.0993 -7622655133131764720 545 545 7 54 0.0991 5.8207 5.8000 0.0939 -6978929672458594541 77 77 1 10 0.1299 5.8519 6.2000 0.0934 -6973368832853710253 315 315 5 29 0.0921 6.6337 7.0000 0.0846 -6464034234071632974 90 90 2 9 0.1000 6.0611 6.1000 0.0776 -6604515711416540036 195 195 3 17 0.0872 6.4405 6.3000 0.0770 -8167260538029441912 1137 1137 6 89 0.0783 6.2868 6.3000 0.0766 -9160097993556876667 179 179 3 15 0.0838 6.5408 6.7000 0.0737 -8143822708707987824 156 156 3 13 0.0833 5.8212 6.0000 0.0722 -7621615115124617144 507 507 5 38 0.0750 6.5598 6.8000 0.0716 -6562030416588580895 181 181 3 14 0.0773 6.6006 6.6000 0.0687 -8424754675397619136 109 109 2 9 0.0826 7.1789 8.0000 0.0684 -6101708384355096959 1368 1368 7 92 0.0673 6.3920 6.4000 0.0662 -8776322650704814910 265 265 5 18 0.0679 6.8015 7.2000 0.0631 -9088418470856647364 313 312 13 21 0.0671 5.9185 6.0000 0.0630 -7471832910709462421 195 195 3 13 0.0667 6.4913 6.6000 0.0607 -4769148685292518758 194 194 3 11 0.0567 6.6711 6.8000 0.0527 -6803390587147569593 293 293 4 15 0.0512 7.2410 7.5000 0.0492 -6186262631968957840 274 274 4 14 0.0511 6.9445 7.0000 0.0490 -4987053497434541251 925 925 8 45 0.0486 6.6732 6.7000 0.0481 -8153125790010061919 94 94 2 5 0.0532 6.7340 6.9000 0.0477 -7743366567936131831 157 157 4 8 0.0510 6.7369 6.9000 0.0477 ... 76 additional rows saved to CSV. Lowest-risk courses with at least 50 rows (smoothed rate) IDMH rows unique_students semesters failures failure_rate mean_grade median_grade smoothed_failure_rate -5977661400883872353 275 275 4 0 0.0000 7.9425 7.9000 0.0057 -6327322292462302639 622 622 7 3 0.0048 7.8201 8.0000 0.0072 -5449021701070263937 201 201 3 0 0.0000 8.2299 8.4000 0.0074 -8828716096689801861 193 193 3 0 0.0000 7.8404 7.8000 0.0077 -7308231843868298462 192 192 3 0 0.0000 8.6016 8.7000 0.0077 -5843160830709850025 183 183 3 0 0.0000 7.7148 7.8000 0.0080 -8973717878209934842 298 298 5 1 0.0034 7.9154 8.0000 0.0082 -8243633583847402973 170 170 4 0 0.0000 8.2559 8.3000 0.0085 -8131619154575945766 268 268 4 1 0.0037 7.6978 7.8000 0.0090 -6252945979477264986 265 265 4 1 0.0038 7.6755 7.7000 0.0091 -5632428654764181019 265 265 4 1 0.0038 7.8645 8.1000 0.0091 -5782984033859216685 145 145 2 0 0.0000 8.3634 8.5000 0.0096 -6528927923294377408 1173 1173 12 10 0.0085 6.9570 7.0000 0.0097 -7783610892775970106 135 135 2 0 0.0000 7.2519 7.2000 0.0101 -8331513043103475629 134 134 3 0 0.0000 8.1739 8.2000 0.0102 -7293136590972278448 207 207 4 1 0.0048 7.7768 7.8000 0.0112 -5236165804446403137 200 200 3 1 0.0050 7.7950 7.7000 0.0115 -5098156373886959537 342 342 5 3 0.0088 8.0564 8.1000 0.0124 -7186990880529964463 177 177 3 1 0.0056 7.6610 7.7000 0.0126 -5190120511789470283 172 172 3 1 0.0058 7.6483 7.7000 0.0129 -5828737779676470924 94 94 3 0 0.0000 7.6128 7.5500 0.0130 -5606614407852048028 938 938 6 11 0.0117 7.5222 7.6000 0.0130 -6423216531718506602 451 451 6 5 0.0111 7.8927 8.1000 0.0137 -7335302513069388975 588 588 5 8 0.0136 6.3767 6.3000 0.0155 -5286435867046160286 66 66 1 0 0.0000 8.4242 8.2500 0.0161 -7140048625803371561 66 66 1 0 0.0000 9.0000 9.1000 0.0161 -6151167526061984152 63 63 1 0 0.0000 7.6302 7.6000 0.0165 -7680407181690185784 762 762 7 12 0.0157 7.7522 7.8000 0.0171 -4932025735817005907 116 116 2 1 0.0086 8.1009 8.2000 0.0173 -5599007005258048275 1079 1079 8 18 0.0167 7.8996 8.1000 0.0176 ... 76 additional rows saved to CSV. Courses with the largest semester-to-semester failure-rate variation IDMH valid_semesters total_rows_in_valid_semesters failure_rate_mean failure_rate_std failure_rate_min failure_rate_max failure_rate_range -4987053497434541251 8 1081 0.1476 0.1927 0.0136 0.6286 0.6149 -7486891101082335117 5 298 0.1386 0.2060 0.0152 0.5490 0.5339 -8528697341869679249 7 516 0.1707 0.1670 0.0115 0.5234 0.5119 -7622655133131764720 7 751 0.1613 0.1322 0.0104 0.4571 0.4467 -6753444769929144915 4 274 0.2224 0.1654 0.0635 0.5000 0.4365 -6101708384355096959 9 1654 0.1230 0.1245 0.0129 0.3750 0.3621 -7956525716689348324 8 1544 0.0809 0.1068 0.0101 0.3552 0.3451 -5158299939746987981 8 667 0.0664 0.0944 0.0000 0.3084 0.3084 -6732178074841306111 6 300 0.1563 0.0970 0.0000 0.2857 0.2857 -6595805319696904699 7 455 0.1040 0.0899 0.0000 0.2778 0.2778 -7497021832674080904 5 291 0.1267 0.1209 0.0179 0.2917 0.2738 -4769148685292518758 4 290 0.1156 0.1001 0.0161 0.2812 0.2651 -5964357857774878518 7 604 0.0576 0.0802 0.0000 0.2479 0.2479 -7066899376620845560 6 337 0.2735 0.0804 0.1111 0.3556 0.2444 -6425430661411751543 7 1530 0.0521 0.0688 0.0038 0.2163 0.2125 -8424754675397619136 3 197 0.1442 0.0834 0.0462 0.2500 0.2038 -5650367903493016606 2 129 0.1544 0.0989 0.0556 0.2533 0.1978 -5827057186439696570 8 1280 0.0472 0.0568 0.0000 0.1897 0.1897 -6844597061195793389 4 249 0.1818 0.0740 0.1039 0.2913 0.1874 -7436795334542176359 8 1383 0.0581 0.0533 0.0000 0.1762 0.1762 -6005179843215164526 8 1710 0.0687 0.0593 0.0052 0.1810 0.1757 -8053378417483436770 9 1570 0.0465 0.0545 0.0078 0.1822 0.1744 -6186262631968957840 5 300 0.0796 0.0595 0.0189 0.1923 0.1734 -9160097993556876667 4 278 0.1254 0.0680 0.0732 0.2424 0.1693 -6973368832853710253 5 383 0.1123 0.0653 0.0476 0.2029 0.1553 -6313615929115732326 9 997 0.0494 0.0470 0.0091 0.1560 0.1469 -8143822708707987824 4 240 0.1143 0.0612 0.0385 0.1818 0.1434 -8776322650704814910 6 319 0.0759 0.0468 0.0306 0.1724 0.1418 -6089911646155973355 7 1240 0.0597 0.0418 0.0155 0.1517 0.1361 -7421574478627523996 8 1458 0.0599 0.0380 0.0191 0.1520 0.1328 ... 79 additional rows saved to CSV. Registrations per student — development snapshot stat registrations count 2010.0000 mean 23.5294 std 11.2890 min 1.0000 25% 15.0000 50% 30.0000 75% 33.0000 90% 34.0000 95% 34.0000 99% 35.0000 max 69.0000 Failure rate grouped by student_gpa_history_missing_flag analysis_feature student_gpa_history_missing_flag rows failures failure_rate mean_grade median_grade student_gpa_history_missing_flag 0.0000 47196 1761 0.0373 6.9948 7.1000 student_gpa_history_missing_flag 1.0000 98 6 0.0612 6.8061 7.2000 Failure rate grouped by course_history_missing_flag analysis_feature course_history_missing_flag rows failures failure_rate mean_grade median_grade course_history_missing_flag 0.0000 42796 1577 0.0368 6.9778 7.1000 course_history_missing_flag 1.0000 4498 190 0.0422 7.1520 7.4000 Failure rate grouped by is_summer_target analysis_feature is_summer_target rows failures failure_rate mean_grade median_grade is_summer_target 0 47251 1756 0.0372 6.9960 7.1000 is_summer_target 1 43 11 0.2558 5.2140 6.7000 Failure rate grouped by hist_warning_in_last_semester analysis_feature hist_warning_in_last_semester rows failures failure_rate mean_grade median_grade hist_warning_in_last_semester 0.0000 44855 1263 0.0282 7.0606 7.2000 hist_warning_in_last_semester 1.0000 2341 498 0.2127 5.7331 6.1000 hist_warning_in_last_semester NaN 98 6 0.0612 6.8061 7.2000 Failure rate grouped by hist_warning_in_last2_consecutive analysis_feature hist_warning_in_last2_consecutive rows failures failure_rate mean_grade median_grade hist_warning_in_last2_consecutive 0.0000 46220 1505 0.0326 7.0263 7.1000 hist_warning_in_last2_consecutive 1.0000 976 256 0.2623 5.5035 6.0000 hist_warning_in_last2_consecutive NaN 98 6 0.0612 6.8061 7.2000 Failure rate grouped by isDKCung analysis_feature isDKCung rows failures failure_rate mean_grade median_grade isDKCung 0.0000 43022 1581 0.0367 6.9965 7.1000 isDKCung 1.0000 3228 172 0.0533 6.7131 6.8000 isDKCung NaN 1044 14 0.0134 7.7747 8.0000 Binned failure relationship: prev_semester_gpa10 feature bin rows failures failure_rate mean_grade prev_semester_gpa10 (-0.001, 5.44] 4722 732 0.1550 6.0643 prev_semester_gpa10 (5.44, 6.1] 4742 231 0.0487 6.6637 prev_semester_gpa10 (6.1, 6.44] 4730 210 0.0444 6.7500 prev_semester_gpa10 (6.44, 6.7] 4998 169 0.0338 6.9074 prev_semester_gpa10 (6.7, 6.9] 4572 94 0.0206 7.0566 prev_semester_gpa10 (6.9, 7.12] 4593 91 0.0198 7.0922 prev_semester_gpa10 (7.12, 7.34] 4697 89 0.0189 7.1407 prev_semester_gpa10 (7.34, 7.58] 4732 34 0.0072 7.2971 prev_semester_gpa10 (7.58, 7.9] 5080 70 0.0138 7.3139 prev_semester_gpa10 (7.9, 9.5] 4330 41 0.0095 7.7084 Binned failure relationship: prev_cumulative_gpa10 feature bin rows failures failure_rate mean_grade prev_cumulative_gpa10 (-0.001, 6.19] 4769 698 0.1464 6.0905 prev_cumulative_gpa10 (6.19, 6.5] 4835 285 0.0589 6.6107 prev_cumulative_gpa10 (6.5, 6.71] 4681 181 0.0387 6.8335 prev_cumulative_gpa10 (6.71, 6.89] 4631 141 0.0304 6.8913 prev_cumulative_gpa10 (6.89, 7.06] 4779 92 0.0193 7.0735 prev_cumulative_gpa10 (7.06, 7.24] 4894 106 0.0217 7.0945 prev_cumulative_gpa10 (7.24, 7.4] 4520 88 0.0195 7.1550 prev_cumulative_gpa10 (7.4, 7.58] 4736 50 0.0106 7.3034 prev_cumulative_gpa10 (7.58, 7.8] 4649 68 0.0146 7.3364 prev_cumulative_gpa10 (7.8, 9.28] 4702 52 0.0111 7.5827 Binned failure relationship: hist_semester_count feature bin rows failures failure_rate mean_grade hist_semester_count (0.999, 2.0] 11117 440 0.0396 7.0253 hist_semester_count (2.0, 3.0] 8806 341 0.0387 6.7737 hist_semester_count (3.0, 5.0] 16762 578 0.0345 7.0473 hist_semester_count (5.0, 7.0] 9032 258 0.0286 7.1807 hist_semester_count (7.0, 15.0] 1479 144 0.0974 6.3505 Binned failure relationship: hist_course_grade10_count feature bin rows failures failure_rate mean_grade hist_course_grade10_count (0.999, 4.0] 6213 252 0.0406 7.1241 hist_course_grade10_count (14.0, 20.0] 6211 262 0.0422 6.9358 hist_course_grade10_count (20.0, 22.0] 4450 115 0.0258 7.2084 hist_course_grade10_count (22.0, 25.0] 3346 86 0.0257 7.1722 hist_course_grade10_count (25.0, 32.0] 4336 201 0.0464 6.8469 hist_course_grade10_count (32.0, 38.0] 4776 107 0.0224 7.2677 hist_course_grade10_count (38.0, 89.0] 4654 209 0.0449 6.9671 hist_course_grade10_count (4.0, 5.0] 4009 121 0.0302 6.8494 hist_course_grade10_count (5.0, 7.0] 4403 165 0.0375 6.8475 hist_course_grade10_count (7.0, 14.0] 4896 249 0.0509 6.7286 Binned failure relationship: hist_course_grade10_mean feature bin rows failures failure_rate mean_grade hist_course_grade10_mean (1.5990000000000002, 5.807] 4736 710 0.1499 6.1064 hist_course_grade10_mean (5.807, 6.219] 4725 278 0.0588 6.6128 hist_course_grade10_mean (6.219, 6.507] 4734 194 0.0410 6.7941 hist_course_grade10_mean (6.507, 6.735] 4730 154 0.0326 6.9304 hist_course_grade10_mean (6.735, 6.94] 4813 88 0.0183 7.0796 hist_course_grade10_mean (6.94, 7.129] 4667 63 0.0135 7.1427 hist_course_grade10_mean (7.129, 7.3] 4739 51 0.0108 7.2253 hist_course_grade10_mean (7.3, 7.533] 4715 46 0.0098 7.3204 hist_course_grade10_mean (7.533, 7.82] 4714 91 0.0193 7.3901 hist_course_grade10_mean (7.82, 9.433] 4721 92 0.0195 7.3458 Binned failure relationship: hist_same_course_attempts feature bin rows failures failure_rate mean_grade hist_same_course_attempts (0.999, 5.0] 4026 218 0.0541 6.3688 Binned failure relationship: hist_failed_credits_sum feature bin rows failures failure_rate mean_grade hist_failed_credits_sum (-0.001, 3.0] 30939 757 0.0245 7.1326 hist_failed_credits_sum (18.0, 115.0] 4484 601 0.1340 6.1878 hist_failed_credits_sum (3.0, 6.0] 4043 85 0.0210 7.1169 hist_failed_credits_sum (6.0, 9.0] 2873 89 0.0310 6.9606 hist_failed_credits_sum (9.0, 18.0] 4857 229 0.0471 6.7802 Binned failure relationship: prev_failed_credits feature bin rows failures failure_rate mean_grade prev_failed_credits (-0.001, 3.0] 40716 983 0.0241 7.1075 prev_failed_credits (3.0, 6.0] 3211 174 0.0542 6.6634 prev_failed_credits (6.0, 27.0] 3269 604 0.1848 5.9162 Binned failure relationship: course_fail_rate_clipped feature bin rows failures failure_rate mean_grade course_fail_rate_clipped (0.009000000000000001, 0.0249] 4325 29 0.0067 7.6640 course_fail_rate_clipped (0.0249, 0.0365] 4350 57 0.0131 7.3961 course_fail_rate_clipped (0.0365, 0.062] 4249 114 0.0268 7.3110 course_fail_rate_clipped (0.062, 0.0897] 4373 124 0.0284 7.0436 course_fail_rate_clipped (0.0897, 0.116] 4194 160 0.0381 6.9371 course_fail_rate_clipped (0.116, 0.156] 4268 183 0.0429 6.9824 course_fail_rate_clipped (0.156, 0.203] 4376 209 0.0478 6.6982 course_fail_rate_clipped (0.203, 0.253] 4158 183 0.0440 6.7411 course_fail_rate_clipped (0.253, 0.316] 4365 295 0.0676 6.4398 course_fail_rate_clipped (0.316, 0.592] 4138 223 0.0539 6.5468 Binned failure relationship: target_semester_registered_credits feature bin rows failures failure_rate mean_grade target_semester_registered_credits (-0.001, 7.0] 5310 167 0.0315 7.2028 target_semester_registered_credits (11.0, 12.0] 2535 104 0.0410 7.0563 target_semester_registered_credits (12.0, 14.0] 3864 169 0.0437 6.8580 target_semester_registered_credits (14.0, 16.0] 4581 183 0.0399 6.9010 target_semester_registered_credits (16.0, 17.0] 5833 189 0.0324 7.0116 target_semester_registered_credits (17.0, 19.0] 4906 212 0.0432 6.8043 target_semester_registered_credits (19.0, 20.0] 3368 145 0.0431 6.9335 target_semester_registered_credits (20.0, 35.0] 4696 203 0.0432 6.8707 target_semester_registered_credits (7.0, 9.0] 4497 195 0.0434 7.0513 target_semester_registered_credits (9.0, 11.0] 7704 200 0.0260 7.1310 Binned failure relationship: target_semester_average_course_difficulty feature bin rows failures failure_rate mean_grade target_semester_average_course_difficulty (0.799, 1.025] 4667 96 0.0206 7.3094 target_semester_average_course_difficulty (1.025, 1.125] 4908 80 0.0163 7.1202 target_semester_average_course_difficulty (1.125, 1.2] 6861 230 0.0335 7.0713 target_semester_average_course_difficulty (1.2, 1.233] 2115 63 0.0298 7.1447 target_semester_average_course_difficulty (1.233, 1.267] 4166 168 0.0403 6.9797 target_semester_average_course_difficulty (1.267, 1.314] 4657 160 0.0344 6.9752 target_semester_average_course_difficulty (1.314, 1.343] 4398 178 0.0405 6.9463 target_semester_average_course_difficulty (1.343, 1.38] 4612 219 0.0475 6.8476 target_semester_average_course_difficulty (1.38, 1.429] 4403 249 0.0566 6.7865 target_semester_average_course_difficulty (1.429, 1.5] 4508 237 0.0526 6.7860 Binned failure relationship: target_semester_unseen_course_rate feature bin rows failures failure_rate mean_grade target_semester_unseen_course_rate (-0.001, 0.2] 37909 1482 0.0391 6.9602 target_semester_unseen_course_rate (0.2, 0.4] 4333 66 0.0152 7.3853 target_semester_unseen_course_rate (0.4, 1.0] 4669 194 0.0416 6.8886 Binned failure relationship: hist_warning_rate feature bin rows failures failure_rate mean_grade hist_warning_rate (-0.001, 0.125] 42720 1115 0.0261 7.0832 hist_warning_rate (0.125, 1.0] 4476 646 0.1443 6.1504 Binned failure relationship: prev_conduct_score feature bin rows failures failure_rate mean_grade prev_conduct_score (-0.001, 78.0] 5938 391 0.0658 6.7049 prev_conduct_score (78.0, 80.0] 5794 288 0.0497 6.9013 prev_conduct_score (80.0, 82.0] 5007 130 0.0260 7.0938 prev_conduct_score (82.0, 83.0] 2315 102 0.0441 6.9728 prev_conduct_score (83.0, 85.0] 15158 557 0.0367 6.9618 prev_conduct_score (85.0, 88.0] 5216 136 0.0261 7.1050 prev_conduct_score (88.0, 90.0] 4145 101 0.0244 7.2014 prev_conduct_score (90.0, 99.0] 3715 62 0.0167 7.2291 ========================================================================================== 9. FEATURE-FAMILY SUMMARY AND FEATURE-ENGINEERING CANDIDATES ========================================================================================== Feature-family summary family n_features numeric_missing_rate dominant_value_rate_nonmissing auc_directionless information_value abs_missing_rate_gap psi_max best_auc_directionless same_course_history 10 0.9154 0.4800 0.6298 0.3412 0.0364 3.6759 0.7965 previous_semester 11 0.0015 0.1978 0.5429 0.1640 0.0014 0.3923 0.7551 assessment_component_history 54 0.0064 0.7338 0.6099 0.2285 0.0000 0.2429 0.7478 other_historical 11 0.0186 0.0951 0.5973 0.3041 0.0014 4.5191 0.7430 recent_three_semesters 12 0.0005 0.1158 0.5757 0.1356 0.0000 1.0192 0.7427 student_course_history 8 0.0000 0.0848 0.6881 0.5905 0.0000 1.7524 0.7427 academic_warning_history 9 0.0021 0.9136 0.6445 0.0000 0.0014 0.0582 0.6499 course_context 3 0.0317 0.4159 0.5869 0.1729 0.0000 4.4718 0.6318 conduct_history 3 0.0001 0.2818 0.5943 0.1350 0.0001 0.7062 0.6147 course_status_one_hot 140 0.0000 0.9986 0.5004 0.0000 0.0000 0.0000 0.6102 target_semester_workload 4 0.0126 0.0937 0.5331 0.0432 0.0031 8.3099 0.5960 registration_timing 4 0.3224 0.4019 0.5182 0.0825 0.0149 8.9150 0.5416 other 3 0.0074 0.9979 0.5028 0.0000 0.0000 27.6310 0.5147 historical_course_components 4 0.0000 0.9872 0.5086 0.0000 0.0000 0.0000 0.5087 Candidates High Missing feature numeric_missing_rate numeric_unique dominant_value_rate_nonmissing auc_directionless cohens_d_failure_minus_normal information_value abs_missing_rate_gap valid_semesters auc_directionless_mean auc_directionless_std predictive_direction_changes psi_max abs_missing_change_max skew hist_same_course_mean_grade10 0.9161 163 0.0600 0.7927 -1.1603 1.2985 0.0322 10 0.8047 0.0588 0.0000 7.1431 0.2775 -1.1591 hist_same_course_best_grade10 0.9161 65 0.0726 0.7965 -1.1635 1.3216 0.0322 10 0.8108 0.0526 0.0000 7.1431 0.2775 -1.2755 hist_same_course_last_grade10 0.9161 65 0.0673 0.7893 -1.1162 1.2337 0.0322 10 0.8001 0.0557 0.0000 7.1431 0.2775 -1.1742 hist_same_course_component_min 0.9158 74 0.2573 0.6160 -0.3012 0.2712 0.0331 10 0.6017 0.0497 1.0000 7.1431 0.2775 0.3624 hist_same_course_component_mean 0.9158 429 0.0568 0.6585 -0.6487 0.4112 0.0331 10 0.6589 0.0771 0.0000 7.1431 0.2775 -1.0238 hist_same_course_attempts 0.9149 5 0.8708 0.5030 0.0015 0.0001 0.0397 10 0.5209 0.0122 2.0000 0.1698 0.2775 3.1590 hist_same_course_VT_count 0.9149 2 0.9856 0.5288 0.4855 0.0000 0.0397 3 0.5074 0.0084 1.0000 0.0000 0.2775 8.1534 hist_same_course_pass_rate 0.9149 3 0.9888 0.5059 -0.1121 0.0000 0.0397 8 0.5084 0.0057 0.0000 0.0000 0.2775 9.3566 hist_same_course_CT_count 0.9149 1 1.0000 0.5000 0.0000 0.0062 0.0397 0 NaN NaN NaN 0.0000 0.2775 0.0000 hist_same_course_component_count 0.9145 13 0.7027 0.6435 -0.4422 0.4796 0.0405 11 0.6267 0.0717 2.0000 0.2086 0.2775 1.6154 Candidates Near Constant feature numeric_missing_rate numeric_unique dominant_value_rate_nonmissing auc_directionless cohens_d_failure_minus_normal information_value abs_missing_rate_gap valid_semesters auc_directionless_mean auc_directionless_std predictive_direction_changes psi_max abs_missing_change_max skew hist_same_course_CT_count 0.9149 1 1.0000 0.5000 0.0000 0.0062 0.0397 0 NaN NaN NaN 0.0000 0.2775 0.0000 recent3_hp_CT_count 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_1b1 ||| Second Foreign Language - Chinese 1B1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_a2 ||| Second Foreign Language - Chinese A2 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_a1 ||| Second Foreign Language - Chinese A1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_2b1 ||| Second Foreign Language - Chinese 2B1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_MME ||| hệ_thống_thông_tin_doanh_nghiệp ||| Enterprise Information Systems 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5035 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_ENG ||| thực_hành_tiếng_c1 ||| Language skills C1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5003 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_ESP ||| thực_hành_tiếng_anh_b2 ||| English Language Skills - Level B2 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5729 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_ESP ||| thực_hành_tiếng_anh_b1 ||| English Language Skills - Level B1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5729 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_JAP ||| thực_hành_tiếng_nhật_a1 ||| Japanese Language Skills A1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_MME ||| quản_trị_khủng_hoảng_truyền_thông ||| Communication Crisis Management 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5042 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_ENG ||| thực_hành_tiếng_anh_b2 ||| English Language Skills B2 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_ENG ||| phiên_dịch_3 ||| Interpreting Practice 3 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_ENG ||| thực_hành_tiếng_anh_b1 ||| English Language Skills B1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_MAT ||| toán_cao_cấp_và_ứng_dụng_trong_kinh_tế_kinh_doanh ||| Mathematics for Economics and Business 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_FIT ||| ứng_dụng_công_nghệ_thông_tin ||| Computer Skills 0.0000 2 1.0000 0.5000 -0.0048 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 217.4718 course_status_ENG ||| biên_tập_và_hiệu_đính_bản_dịch ||| Reviewing and Editing of Translated Texts 0.0000 2 1.0000 0.5000 -0.0048 0.0000 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 217.4718 course_status_VNS ||| thực_hành_tiếng_việt_a1 ||| Vietnamese Language Skills A1 0.0000 2 1.0000 0.5000 -0.0048 0.0000 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 217.4718 course_status_ENG ||| phương_pháp_học_tập_và_nghiên_cứu_khoa_học ||| Study and Research Skills 0.0000 2 1.0000 0.5000 -0.0048 0.0000 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 217.4718 course_status_ENG ||| biên_dịch_3 ||| Translation Practice 3 0.0000 2 1.0000 0.5000 -0.0048 0.0000 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 217.4718 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| thực_tập_tốt_nghiệp ||| Internship 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 3 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| kiến_tập ||| Practicum 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 3 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 hist_component_B1_DC_count 0.0000 2 1.0000 0.5003 0.0837 0.0000 0.0000 2 0.5036 0.0027 1.0000 0.0000 0.0000 153.7709 hist_component_K1_DC_count 0.0000 2 1.0000 0.5003 0.0837 0.0000 0.0000 2 0.5036 0.0027 1.0000 0.0000 0.0000 153.7709 hist_component_K2_DC_count 0.0000 2 1.0000 0.5003 0.0837 0.0000 0.0000 2 0.5036 0.0027 1.0000 0.0000 0.0000 153.7709 course_status_MGT ||| quản_trị_học ||| Introduction to Management 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 3 0.5002 0.0002 1.0000 0.0000 0.0000 175.0585 ... 65 additional rows saved to CSV. Candidates Univariate Weak feature numeric_missing_rate numeric_unique dominant_value_rate_nonmissing auc_directionless cohens_d_failure_minus_normal information_value abs_missing_rate_gap valid_semesters auc_directionless_mean auc_directionless_std predictive_direction_changes psi_max abs_missing_change_max skew recent3_hp_CT_count 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_1b1 ||| Second Foreign Language - Chinese 1B1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_2b1 ||| Second Foreign Language - Chinese 2B1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_a1 ||| Second Foreign Language - Chinese A1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_CHI ||| ngoại_ngữ_2_tiếng_trung_quốc_a2 ||| Second Foreign Language - Chinese A2 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_ENG ||| phiên_dịch_3 ||| Interpreting Practice 3 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_ENG ||| thực_hành_tiếng_anh_b1 ||| English Language Skills B1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_ENG ||| thực_hành_tiếng_anh_b2 ||| English Language Skills B2 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 0 NaN NaN NaN 0.0000 0.0000 0.0000 course_status_ENG ||| thực_hành_tiếng_c1 ||| Language skills C1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5003 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_ESP ||| thực_hành_tiếng_anh_b1 ||| English Language Skills - Level B1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5729 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_ESP ||| thực_hành_tiếng_anh_b2 ||| English Language Skills - Level B2 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5729 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_JAP ||| thực_hành_tiếng_nhật_a1 ||| Japanese Language Skills A1 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_MAT ||| toán_cao_cấp_và_ứng_dụng_trong_kinh_tế_kinh_doanh ||| Mathematics for Economics and Business 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_MME ||| hệ_thống_thông_tin_doanh_nghiệp ||| Enterprise Information Systems 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5035 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_MME ||| quản_trị_khủng_hoảng_truyền_thông ||| Communication Crisis Management 0.0000 1 1.0000 0.5000 0.0000 0.0009 0.0000 1 0.5042 0.0000 0.0000 0.0000 0.0000 0.0000 course_status_ENG ||| biên_dịch_3 ||| Translation Practice 3 0.0000 2 1.0000 0.5000 -0.0048 0.0000 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 217.4718 course_status_ENG ||| biên_tập_và_hiệu_đính_bản_dịch ||| Reviewing and Editing of Translated Texts 0.0000 2 1.0000 0.5000 -0.0048 0.0000 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 217.4718 course_status_ENG ||| phương_pháp_học_tập_và_nghiên_cứu_khoa_học ||| Study and Research Skills 0.0000 2 1.0000 0.5000 -0.0048 0.0000 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 217.4718 course_status_FIT ||| ứng_dụng_công_nghệ_thông_tin ||| Computer Skills 0.0000 2 1.0000 0.5000 -0.0048 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 217.4718 course_status_VNS ||| thực_hành_tiếng_việt_a1 ||| Vietnamese Language Skills A1 0.0000 2 1.0000 0.5000 -0.0048 0.0000 0.0000 1 0.5001 0.0000 0.0000 0.0000 0.0000 217.4718 hist_component_B1_DC_count 0.0000 2 1.0000 0.5003 0.0837 0.0000 0.0000 2 0.5036 0.0027 1.0000 0.0000 0.0000 153.7709 hist_component_K1_DC_count 0.0000 2 1.0000 0.5003 0.0837 0.0000 0.0000 2 0.5036 0.0027 1.0000 0.0000 0.0000 153.7709 hist_component_K2_DC_count 0.0000 2 1.0000 0.5003 0.0837 0.0000 0.0000 2 0.5036 0.0027 1.0000 0.0000 0.0000 153.7709 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| kiến_tập ||| Practicum 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 3 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| thực_tập_tốt_nghiệp ||| Internship 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 3 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_MGT ||| quản_trị_học ||| Introduction to Management 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 3 0.5002 0.0002 1.0000 0.0000 0.0000 175.0585 course_status_VIP ||| tiếng_việt_trong_hành_chức ||| Vietnamese in Use 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 ... 102 additional rows saved to CSV. Candidates Strong Stable feature numeric_missing_rate numeric_unique dominant_value_rate_nonmissing auc_directionless cohens_d_failure_minus_normal information_value abs_missing_rate_gap valid_semesters auc_directionless_mean auc_directionless_std predictive_direction_changes psi_max abs_missing_change_max skew hist_same_course_best_grade10 0.9161 65 0.0726 0.7965 -1.1635 1.3216 0.0322 10 0.8108 0.0526 0.0000 7.1431 0.2775 -1.2755 hist_same_course_mean_grade10 0.9161 163 0.0600 0.7927 -1.1603 1.2985 0.0322 10 0.8047 0.0588 0.0000 7.1431 0.2775 -1.1591 hist_same_course_last_grade10 0.9161 65 0.0673 0.7893 -1.1162 1.2337 0.0322 10 0.8001 0.0557 0.0000 7.1431 0.2775 -1.1742 prev_semester_gpa10 0.0021 610 0.0160 0.7551 -1.2978 0.9236 0.0014 17 0.7345 0.0645 0.0000 0.6628 0.0208 -1.8033 hist_component_grade_mean 0.0000 5238 0.0028 0.7478 -1.0539 0.8491 0.0000 17 0.7245 0.0650 0.0000 1.1986 0.0003 -0.5914 hist_component_K1_mean 0.0146 3051 0.0085 0.7350 -0.9744 0.7511 0.0172 15 0.7198 0.0667 0.0000 0.9604 0.9343 -0.6275 recent3_component_grade_mean 0.0000 4265 0.0028 0.7436 -1.0744 0.8262 0.0000 17 0.7188 0.0726 0.0000 1.4174 0.0003 -0.7502 prev_cumulative_gpa10 0.0021 416 0.0095 0.7449 -1.0658 0.8139 0.0014 17 0.7146 0.0509 0.0000 0.3923 0.0208 -1.3152 hist_semester_gpa10_mean 0.0021 3144 0.0034 0.7430 -1.0607 0.8287 0.0014 17 0.7144 0.0566 0.0000 0.3745 0.0208 -1.2694 hist_component_K2_mean 0.0146 2842 0.0300 0.7256 -0.9166 0.7281 0.0172 15 0.7139 0.0669 0.0000 4.7790 0.9343 -0.8093 recent3_component_grade_median 0.0000 204 0.1522 0.7274 -0.9888 0.7409 0.0000 17 0.7067 0.0610 0.0000 1.4759 0.0003 -0.6943 hist_component_K1_low_rate 0.0146 367 0.3666 0.6755 0.8790 0.6337 0.0172 14 0.6757 0.0588 0.0000 0.4179 0.9343 1.3534 hist_component_high_rate 0.0000 1607 0.0326 0.6892 -0.6303 0.4949 0.0000 17 0.6746 0.0620 0.0000 9.9812 0.0003 -0.2814 hist_component_T1_mean 0.0000 3818 0.0072 0.6488 -0.5558 0.3935 0.0000 17 0.6592 0.0491 0.0000 0.2672 0.0003 -0.0087 hist_same_course_component_mean 0.9158 429 0.0568 0.6585 -0.6487 0.4112 0.0331 10 0.6589 0.0771 0.0000 7.1431 0.2775 -1.0238 hist_cumulative_gpa10_mean 0.0021 3215 0.0026 0.6753 -0.7388 0.4165 0.0014 17 0.6557 0.0507 0.0000 0.3139 0.0208 -1.3438 hist_component_numeric_rate 0.0000 639 0.7338 0.6810 -1.1189 0.6161 0.0000 17 0.6540 0.0638 0.0000 0.1345 0.0000 -4.9892 hist_component_special_rate 0.0000 639 0.7338 0.6810 1.1189 0.6120 0.0000 17 0.6540 0.0638 0.0000 0.1722 0.0000 4.9892 hist_component_K2_low_rate 0.0146 261 0.6377 0.6511 0.8906 0.4225 0.0172 15 0.6430 0.0469 0.0000 0.4094 0.9343 3.6727 course_status_PML ||| triết_học_mác_lênin ||| Philosophy of Marxism-Leninism 0.0000 3 0.5514 0.6102 -0.4451 0.0000 0.0000 10 0.6424 0.0532 0.0000 0.0205 0.0000 0.2300 recent3_component_VT_count 0.0000 14 0.8269 0.6592 1.2001 0.4266 0.0000 17 0.6393 0.0545 0.0000 0.0538 0.0000 5.0394 hist_component_VT_count 0.0000 17 0.8038 0.6587 1.0886 0.3949 0.0000 17 0.6359 0.0506 0.0000 0.0963 0.0000 5.1015 hist_warning_consecutive_max 0.0021 8 0.8989 0.6486 1.0447 0.5309 0.0014 17 0.6238 0.0618 0.0000 0.0629 0.0208 5.2964 hist_warning_count 0.0021 9 0.8989 0.6483 1.0221 0.5309 0.0014 17 0.6233 0.0618 0.0000 0.0768 0.0208 5.3536 hist_warning_credit_debt_count 0.0021 9 0.8991 0.6481 1.0218 0.5300 0.0014 17 0.6231 0.0620 0.0000 0.0768 0.0208 5.3582 recent3_warning_count 0.0021 4 0.9136 0.6445 1.1096 0.0000 0.0014 17 0.6200 0.0588 0.0000 0.0582 0.0208 4.2121 hist_component_T1_VT_count 0.0000 12 0.8447 0.6396 0.9811 0.3656 0.0000 17 0.6191 0.0527 0.0000 0.0634 0.0000 4.8568 hist_component_K1_VT_count 0.0000 10 0.9020 0.6113 0.9022 0.0000 0.0000 14 0.6119 0.0297 0.0000 0.0662 0.0000 5.9775 hist_passed_credits_sum 0.0021 131 0.0852 0.5973 -0.3131 0.5255 0.0014 17 0.6093 0.0503 0.0000 4.5191 0.0208 0.3238 recent3_course_grade10_max 0.0000 49 0.2281 0.5887 -0.3571 0.1264 0.0000 17 0.6077 0.0586 0.0000 3.5355 0.0000 -0.4198 ... 1 additional rows saved to CSV. Candidates Temporally Unstable feature numeric_missing_rate numeric_unique dominant_value_rate_nonmissing auc_directionless cohens_d_failure_minus_normal information_value abs_missing_rate_gap valid_semesters auc_directionless_mean auc_directionless_std predictive_direction_changes psi_max abs_missing_change_max skew prev_conduct_score 0.0001 47 0.2818 0.5943 -0.3454 0.1350 0.0001 17 0.5811 0.0727 6.0000 1.3969 0.0007 -3.3228 student_prior_course_count_log 0.0000 72 0.0849 0.5025 0.0081 0.1202 0.0000 17 0.5969 0.0879 4.0000 5.6643 0.0000 -0.3511 hist_course_grade10_count 0.0000 72 0.0848 0.5083 0.0059 0.1018 0.0000 17 0.5906 0.0821 4.0000 5.6660 0.0000 0.5751 hist_component_grade_max 0.0000 64 0.8463 0.5225 -0.2083 0.0083 0.0000 17 0.5669 0.0782 4.0000 11.4963 0.0003 -2.8342 recent3_course_grade10_count 0.0000 32 0.1077 0.5271 -0.0819 0.0656 0.0000 17 0.5921 0.0747 4.0000 3.9720 0.0000 -0.0785 recent3_component_grade_max 0.0000 64 0.8403 0.5384 -0.2488 0.0114 0.0000 17 0.5679 0.0647 4.0000 11.4385 0.0003 -2.7803 hist_component_K1_count 0.0000 70 0.1376 0.5408 -0.0897 0.1384 0.0000 16 0.5761 0.0633 4.0000 5.9752 0.0000 0.6097 course_status_PML ||| những_nguyên_lý_cơ_bản_của_chủ_nghĩa_mác_lênin_1 ||| Fundamental Principles of Marxism-Leninism 1 0.0000 3 0.7169 0.5467 -0.2105 0.0000 0.0000 16 0.5611 0.0508 4.0000 0.0006 0.0000 0.9810 target_semester_average_course_difficulty 0.0423 121 0.0640 0.5960 0.3331 0.1527 0.0072 14 0.5966 0.0400 4.0000 15.5977 0.6077 -0.5554 hist_registered_credits_mean 0.0021 330 0.0954 0.5627 0.0238 0.1506 0.0014 17 0.5978 0.0860 3.0000 1.5077 0.0208 2.2195 hist_component_low_rate 0.0000 1237 0.1945 0.6985 0.9701 0.6925 0.0000 17 0.6822 0.0752 3.0000 1.6536 0.0003 1.1219 course_cluster_id 0.0000 5 0.4159 0.5869 -0.3192 0.1729 0.0000 16 0.5779 0.0488 3.0000 4.4718 0.0000 0.4031 target_semester_registered_credits 0.0000 33 0.1233 0.5237 0.0761 0.0380 0.0000 16 0.5620 0.0418 3.0000 9.1831 0.0000 -0.0677 hist_component_grade_count 0.0000 190 0.0694 0.5405 -0.1001 0.1709 0.0000 17 0.6072 0.1027 2.0000 6.7725 0.0000 0.5659 recent3_component_grade_count 0.0000 86 0.1019 0.5723 -0.2161 0.2416 0.0000 17 0.6206 0.0898 2.0000 5.7918 0.0000 -0.0372 hist_component_count 0.0000 193 0.0718 0.5203 -0.0225 0.1202 0.0000 17 0.5948 0.0877 2.0000 8.8661 0.0000 0.6065 hist_component_courses 0.0000 57 0.0736 0.5165 -0.0575 0.1058 0.0000 17 0.5997 0.0857 2.0000 7.9775 0.0000 0.4051 prev_registered_credits 0.0021 32 0.2368 0.5429 -0.1329 0.0667 0.0014 16 0.5808 0.0842 2.0000 1.5341 0.0208 -0.2326 recent3_registered_credits_mean 0.0021 102 0.1179 0.5626 -0.0858 0.1449 0.0014 17 0.6001 0.0823 2.0000 0.5723 0.0208 0.6417 prev_passed_credits 0.0021 30 0.3140 0.7405 -1.0571 0.8787 0.0014 17 0.6975 0.0806 2.0000 3.7381 0.0208 -0.9361 hist_course_grade10_max 0.0000 45 0.3847 0.5747 -0.2860 0.0789 0.0000 17 0.6092 0.0720 2.0000 3.3799 0.0000 -0.6912 hist_same_course_component_count 0.9145 13 0.7027 0.6435 -0.4422 0.4796 0.0405 11 0.6267 0.0717 2.0000 0.2086 0.2775 1.6154 recent3_course_grade10_mean 0.0000 2908 0.0082 0.7368 -1.1183 0.8759 0.0000 17 0.7152 0.0676 2.0000 1.0486 0.0000 -0.8503 course_fail_rate_clipped 0.0951 313 0.0597 0.6318 0.3982 0.3187 0.0129 16 0.6205 0.0659 2.0000 8.4171 0.4849 0.9857 hist_target_course_pass_rate 0.0951 335 0.0469 0.6318 -0.4000 0.3237 0.0129 16 0.6205 0.0659 2.0000 9.8644 0.4849 -0.9652 hist_component_T1_count 0.0000 68 0.0740 0.5399 -0.1380 0.1229 0.0000 17 0.6004 0.0654 2.0000 5.8736 0.0000 0.5299 hist_component_B1_mean 0.1424 235 0.0199 0.6061 -0.3914 0.1853 0.0337 15 0.6123 0.0647 2.0000 0.9370 0.9343 -1.1876 hist_warning_in_last_semester 0.0021 2 0.9504 0.6211 1.1414 0.0000 0.0014 17 0.6002 0.0626 2.0000 0.0000 0.0208 4.1490 hist_warning_rate 0.0021 28 0.8989 0.6499 1.0861 0.5316 0.0014 17 0.6246 0.0625 2.0000 0.0835 0.0208 4.4282 hist_component_K2_count 0.0000 71 0.1387 0.5345 -0.0564 0.1322 0.0000 16 0.5753 0.0624 2.0000 6.9562 0.0000 0.6315 ... 37 additional rows saved to CSV. Candidates Possible Leakage Review [No rows] Candidates Log Transform Review feature numeric_missing_rate numeric_unique dominant_value_rate_nonmissing auc_directionless cohens_d_failure_minus_normal information_value abs_missing_rate_gap valid_semesters auc_directionless_mean auc_directionless_std predictive_direction_changes psi_max abs_missing_change_max skew course_status_ENG ||| kiến_tập ||| Practicum 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 3 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| công_nghệ_trong_giảng_dạy_ngôn_ngữ ||| Integrating ICT in Language Teaching 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_VIP ||| tiếng_việt_trong_hành_chức ||| Vietnamese in Use 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| thiết_kế_và_xây_dựng_chương_trình_giảng_dạy ||| Syllabus and Curriculum Design 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_2 ||| English Language Teaching Methodology 2 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_MGT ||| quản_trị_học ||| Introduction to Management 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 3 0.5002 0.0002 1.0000 0.0000 0.0000 175.0585 course_status_ENG ||| thực_tập_tốt_nghiệp ||| Internship 0.0000 3 1.0000 0.5000 -0.0064 0.0000 0.0000 3 0.5001 0.0000 0.0000 0.0000 0.0000 175.0585 course_status_ENG ||| chuyên_đề_giao_tiếp_liên_văn_hóa ||| Intercultural Communication Project 0.0000 3 0.9999 0.5000 -0.0078 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 147.9655 course_status_VIP ||| hà_nội_học ||| Hanoi Studies 0.0000 3 0.9999 0.5000 -0.0078 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 147.9655 course_status_ENG ||| ngôn_ngữ_học_đối_chiếu ||| Contrastive Linguistics 0.0000 3 0.9999 0.5000 -0.0078 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 147.9655 course_status_ENG ||| ngữ_pháp_học_tiếng_anh_2 ||| English Grammar 2 0.0000 3 0.9999 0.5000 -0.0078 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 147.9655 course_status_ENG ||| chuyên_đề_hướng_nghiệp ||| Career Mentoring Project 0.0000 3 0.9999 0.5000 -0.0078 0.0000 0.0000 2 0.5001 0.0000 0.0000 0.0000 0.0000 147.9655 course_status_ENG ||| biên_dịch_2 ||| Translation Practice 2 0.0000 3 0.9998 0.5002 0.0271 0.0000 0.0000 3 0.5004 0.0003 2.0000 0.0000 0.0000 70.5190 course_status_ENG ||| biên_dịch_1 ||| Translation Practice 1 0.0000 3 0.9998 0.5002 0.0271 0.0000 0.0000 3 0.5004 0.0003 2.0000 0.0000 0.0000 70.5190 course_status_ENG ||| phiên_dịch_2 ||| Interpreting Practice 2 0.0000 3 0.9998 0.5002 0.0271 0.0000 0.0000 3 0.5004 0.0003 2.0000 0.0000 0.0000 70.5190 course_status_ENG ||| phiên_dịch_1 ||| Interpreting Practice 1 0.0000 3 0.9998 0.5002 0.0271 0.0000 0.0000 3 0.5004 0.0003 2.0000 0.0000 0.0000 70.5190 course_status_ENG ||| nhập_môn_biên_phiên_dịch ||| Introductory Translation & Interpreting 0.0000 3 0.9998 0.5002 0.0271 0.0000 0.0000 3 0.5004 0.0003 2.0000 0.0000 0.0000 70.5190 course_status_ENG ||| kỹ_năng_nghe_1_a2_b1 ||| Listening skills 1 0.0000 3 0.9998 0.5001 -0.0157 0.0000 0.0000 5 0.5002 0.0002 0.0000 0.0000 0.0000 67.0782 course_status_ENG ||| kỹ_năng_đọc_1_a2_b1 ||| Reading Skills 1 0.0000 3 0.9998 0.5001 -0.0157 0.0000 0.0000 5 0.5002 0.0002 0.0000 0.0000 0.0000 67.0782 course_status_ENG ||| kỹ_năng_viết_1_a2_b1 ||| Writing skills 1 0.0000 3 0.9998 0.5001 -0.0157 0.0000 0.0000 5 0.5002 0.0002 0.0000 0.0000 0.0000 67.0782 course_status_ENG ||| kỹ_năng_nói_1_a2_b1 ||| Speaking skills 1 0.0000 3 0.9998 0.5001 -0.0157 0.0000 0.0000 5 0.5002 0.0002 0.0000 0.0000 0.0000 67.0782 course_status_ENG ||| từ_vựng_học_tiếng_anh ||| English Lexicology 0.0000 3 0.9997 0.5002 0.0232 0.0000 0.0000 3 0.5004 0.0002 2.0000 0.0000 0.0000 65.4945 course_status_ENG ||| nhập_môn_ngôn_ngữ_học ||| Introductory Linguistics 0.0000 3 0.9997 0.5002 0.0232 0.0000 0.0000 3 0.5004 0.0002 2.0000 0.0000 0.0000 65.4945 course_status_ENG ||| chuyên_đề_văn_học_mỹ ||| American Literature Project 0.0000 3 0.9997 0.5002 0.0232 0.0000 0.0000 3 0.5004 0.0002 2.0000 0.0000 0.0000 65.4945 course_status_ENG ||| kiểm_tra_và_đánh_giá_ngôn_ngữ ||| Language Testing and Assessment 0.0000 3 0.9995 0.5003 -0.0238 0.0000 0.0000 4 0.5006 0.0005 0.0000 0.0000 0.0000 43.9014 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_a1 ||| Second Foreign Language - French A1 0.0000 3 0.9995 0.5003 -0.0238 0.0000 0.0000 4 0.5006 0.0005 0.0000 0.0000 0.0000 43.9014 course_status_ENG ||| nhập_môn_nghiên_cứu ||| Introductory Research 0.0000 3 0.9995 0.5003 -0.0238 0.0000 0.0000 4 0.5006 0.0005 0.0000 0.0000 0.0000 43.9014 course_status_ENG ||| phương_pháp_giảng_dạy_tiếng_anh_1 ||| English Language Teaching Methodology 1 0.0000 3 0.9995 0.5003 -0.0238 0.0000 0.0000 4 0.5006 0.0005 0.0000 0.0000 0.0000 43.9014 course_status_ENG ||| lý_thuyết_học_ngoại_ngữ ||| Second Language Acquisition Theory 0.0000 3 0.9995 0.5003 -0.0238 0.0000 0.0000 4 0.5006 0.0005 0.0000 0.0000 0.0000 43.9014 course_status_FRE ||| ngoại_ngữ_2_tiếng_pháp_1b1 ||| Second Foreign Language - French 1B1 0.0000 3 0.9995 0.5003 -0.0238 0.0000 0.0000 4 0.5006 0.0005 0.0000 0.0000 0.0000 43.9014 ... 68 additional rows saved to CSV. ========================================================================================== 10. AUTOMATED BIG-PICTURE FINDINGS ========================================================================================== Failure prevalence changes from 9.96% in fold 6 to 15.13% in fold 7. Development features with >=90% missingness: 10 Development near-zero-variance features: 102 Development high-correlation pairs (|r|>=0.95): 174 Features with univariate directionless AUC >=0.60: 65 Features with at least one predictive-direction change across semesters: 183 Features with maximum adjacent-semester PSI >=0.25: 86 Interpretation order for the next research step: 1. Validate special/tiny semesters and extraction completeness. 2. Identify whether failures are concentrated in courses, cold-start students, or missing-history cohorts. 3. Prefer features with stable class separation across development semesters. 4. Review highly missing, near-constant, redundant, and direction-changing features; do not remove them automatically. 5. Form one feature-engineering hypothesis at a time and re-evaluate with the unchanged temporal backtest. ========================================================================================== EDA COMPLETE ========================================================================================== Runtime: 200.6 seconds Text report: /root/disk_3tb/earlywarning/eda_outputs/khoa_cong_nghe_thong_tin/eda_report.txt Detailed CSV/JSON outputs: /root/disk_3tb/earlywarning/eda_outputs/khoa_cong_nghe_thong_tin