============================================================================================================== EXPERIMENT 2 — RELATIONAL FACTORIZATION EXPERT ============================================================================================================== pure_relational: val AP/AUC=0.4088/0.8700 ep=6 | test AP/AUC=0.4599/0.8653 hybrid_relational: val AP/AUC=0.3726/0.8478 ep=28 | test AP/AUC=0.2073/0.8190 cold start: new student=37.6% new course=9.4% pure_relational: val AP/AUC=0.4445/0.8511 ep=7 | test AP/AUC=0.6111/0.9369 hybrid_relational: val AP/AUC=0.2154/0.8178 ep=11 | test AP/AUC=0.3744/0.9116 cold start: new student=0.1% new course=9.1% pure_relational: val AP/AUC=0.6586/0.9445 ep=4 | test AP/AUC=0.3587/0.8557 hybrid_relational: val AP/AUC=0.5046/0.9040 ep=48 | test AP/AUC=0.3436/0.8514 cold start: new student=31.1% new course=4.3% pure_relational: val AP/AUC=0.3889/0.8736 ep=22 | test AP/AUC=0.4388/0.8607 hybrid_relational: val AP/AUC=0.3547/0.8623 ep=37 | test AP/AUC=0.3939/0.8652 cold start: new student=0.2% new course=4.2% pure_relational: val AP/AUC=0.4452/0.8516 ep=4 | test AP/AUC=0.2293/0.7956 hybrid_relational: val AP/AUC=0.3974/0.8683 ep=37 | test AP/AUC=0.2550/0.8103 cold start: new student=29.8% new course=5.9% DEV blend pure_relational: alpha=0.75 AP=0.3699 AUC=0.8305 DEV blend hybrid_relational: alpha=0.30 AP=0.3516 AUC=0.8687 pure_relational: val AP/AUC=0.2507/0.7927 ep=21 | test AP/AUC=0.3739/0.7882 hybrid_relational: val AP/AUC=0.2733/0.8276 ep=25 | test AP/AUC=0.3705/0.7990 cold start: new student=0.0% new course=1.5% pure_relational: val AP/AUC=0.3713/0.7854 ep=3 | test AP/AUC=0.2994/0.7155 hybrid_relational: val AP/AUC=0.3867/0.8053 ep=16 | test AP/AUC=0.3885/0.7716 cold start: new student=31.0% new course=11.2% DEVELOPMENT pure_relational blend alpha=0.75 AP/AUC=0.3699/0.8305 DEVELOPMENT hybrid_relational blend alpha=0.30 AP/AUC=0.3516/0.8687 HOLDOUT pure_relational blend alpha=0.75 AP/AUC=0.3695/0.7671 HOLDOUT hybrid_relational blend alpha=0.30 AP/AUC=0.4234/0.8192