File tree Expand file tree Collapse file tree 2 files changed +1552
-622
lines changed
Expand file tree Collapse file tree 2 files changed +1552
-622
lines changed Original file line number Diff line number Diff line change @@ -21,16 +21,16 @@ All you need is graph-structured data.
2121
2222# Benchmarks
2323
24- Dataset | accuracy | ROC-AUC | SOTA accuracy | SOTA ROC-AUC
25- --------------------------|---------- |---------|---------------|-------------
26- ** AntiFraud Amazon** | 0.9828 | 0.9617 | - | 0.9750
27- ** AntiFraud YelpChi ** | 0.9050 | 0.9176 | - | 0.9498
28- ** Multitarget 10k ** | 0.8651 | 0.7415 | - | -
29- ** Multitarget 50k ** | 0.8637 | 0.7973 | - | -
30- ** Penn94 ** | 0.7829 | 0.8714 | 0.8609 | -
31- ** Genius ** | 0.8405 | 0.9016 | 0.9145 | -
32- ** S_FFSD ** | 0.8961 | 0.8932 | - | 0.8461
33- ** OgbnProteins ** | 0.8967 | 0.8058 | - | 0.8942
24+ | * Dataset* | * Main Metric * | * Train * | * Valid * | * Test * | * Runner Score * | * HypeRunner Score * | * SOTA* | * Rank * |
25+ | ----------------------| --------------- | ---------| --------- | ---------| ---------------- | -------------------- | -------- | -------- |
26+ | ** Amazon Computers ** | accuracy | 0.6 | 0.2 | 0.2 | 0.918 | 0.915 | 0.939 | 3 |
27+ | ** Amazon Photo ** | accuracy | 0.6 | 0.2 | 0.2 | 0.959 | 0.961 | 0.967 | 3 |
28+ | ** Amzon-Fraud ** | roc-auc | 0.4 | 0.2 | 0.4 | 0.956 | 0.960 | 0.975 | 4 |
29+ | ** YelpChi ** | roc-auc | 0.4 | 0.2 | 0.4 | 0.856 | 0.890 | 0.950 | 5 |
30+ | ** Multitarget 10k ** | roc-auc | 0.6 | 0.2 | 0.2 | 0.730 | 0.838 | | |
31+ | ** Multitarget 50k ** | roc-auc | 0.6 | 0.2 | 0.2 | 0.756 | 0.841 | | |
32+ | ** Penn94 ** | accuracy | 0.6 | 0.2 | 0.2 | 0.791 | 0.829 | 0.861 | 12 |
33+ | ** Genius ** | roc-auc | 0.6 | 0.2 | 0.2 | 0.902 | 0.902 | 0.915 | 12 |
3434
3535
3636# Installation
You can’t perform that action at this time.
0 commit comments