Causality Causality Workbench                                                             Challenges in Machine Learning Causality

Active Learning Challenge

Results

This page displays only the final challenge results. The platform is still open for post-challenge submissions; the results on new entries are displayed in the Leaderboard. Note that, during the challenge, to detect eventual violations of the rule that forbid exchange of information on the labels, each team worked on a different set of labels for dataset A, without knowing it. We show the results of the post-challenge verification (verifA results), which are all on the same labels.

Team name Global Score (Rank)
ABCDEF
IdealAnalytics, Intel 0.52727 (5)  0.317263 (5)  0.380571 (2)  0.639676 (8)  0.473056 (5)  0.801799 (1) 
ROFU 0.553255 (3)  0.375695 (1)  0.199416 (11)  0.661793 (4)  0.583783 (2)  0.669048 (9) 
IDE 0.60402 (2)  0.375421 (2)  0.334092 (4)  0.0927093 (22)  0.532886 (3)  0.771424 (4) 
test 0.347193 (11)  0.338292 (4)    0.657557 (5)  0.448321 (6)  0.700722 (7) 
TUCIS 0.470094 (7)  0.261346 (8)  0.239304 (7)  0.651853 (6)  0.442952 (7)  0.673625 (8) 
brainsignals 0.297094 (18)  0.348064 (3)  0.427295 (1)  0.737286 (3)  0.526695 (4)  0.482005 (14) 
NDSU 0.385111 (8)  0.288922 (6)  0.358319 (3)  0.513088 (17)  0.377316 (10)  0.791172 (2) 
DSL 0.360888 (9)  0.129696 (12)  0.187637 (12)  0.53904 (15)  0.626624 (1)  0.785308 (3) 
Juggernaut.3DQ 0.540994 (4)  0.0222605 (18)  0.227273 (9)  0.649844 (7)  0.399536 (9)   
uq 0.344891 (12)  0.283423 (7)  0.237824 (8)  0.602077 (13)  0.368941 (11)  0.651738 (10) 
odranipse 0.511863 (6)  0.0983659 (15)         
flyingsky 0.628873 (1)      0.231477 (21)     
MUL 0.200183 (21)  0.233882 (9)  0.283974 (5)  0.373675 (20)  0.413434 (8)  0.648175 (11) 
DMteam 0.31664 (14)  0.108407 (14)    0.617891 (10)  0.325356 (14)   
SISTSYSU 0.278579 (20)  0.219305 (10)      0.193609 (16)  0.702364 (6) 
Laconi Team 0.350593 (10)  0.196047 (11)      0.202591 (15)  0.27323 (17) 
mai 0.306991 (16)      0.616342 (12)     
utai 0.167318 (22)    0.277839 (6)  0.494078 (18)  0.361157 (12)  0.525096 (13) 
ShirazU 0.283748 (19)  0.0850716 (16)  0.226193 (10)  0.583807 (14)  0.111727 (20)  0.612986 (12) 
DIT AI Group 0.0709987 (23)  0.00283678 (19)  0.135763 (14)  0.517218 (16)  0.125132 (19)  0.721565 (5) 
Datam1n 0.0418628 (25)  -0.0043657 (21)    0.860975 (2)  5.11308e-05 (22)  0.380704 (16) 
Monga 0.299625 (17)  0.0650195 (17)  0.187392 (13)  0.389998 (19)  0.128868 (18)   
SysHealth         0.187348 (17)