Skip to content

Commit 0fefac7

Browse files
author
Kuznetsov Vladislav Pavlovich
committed
update benchmarks
1 parent 6291feb commit 0fefac7

File tree

2 files changed

+1552
-622
lines changed

2 files changed

+1552
-622
lines changed

README.md

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -21,16 +21,16 @@ All you need is graph-structured data.
2121

2222
# Benchmarks
2323

24-
Dataset | accuracy | ROC-AUC | SOTA accuracy | SOTA ROC-AUC
25-
--------------------------|----------|---------|---------------|-------------
26-
**AntiFraud Amazon** | 0.9828 | 0.9617 | - | 0.9750
27-
**AntiFraud YelpChi** | 0.9050 | 0.9176 | - | 0.9498
28-
**Multitarget 10k** | 0.8651 | 0.7415 | - | -
29-
**Multitarget 50k** | 0.8637 | 0.7973 | - | -
30-
**Penn94** | 0.7829 | 0.8714 | 0.8609 | -
31-
**Genius** | 0.8405 | 0.9016 | 0.9145 | -
32-
**S_FFSD** | 0.8961 | 0.8932 | - | 0.8461
33-
**OgbnProteins** | 0.8967 | 0.8058 | - | 0.8942
24+
| *Dataset* | *Main Metric* | *Train* | *Valid* | *Test* | *Runner Score* | *HypeRunner Score* | *SOTA* | *Rank* |
25+
|----------------------|---------------|---------|---------|---------|----------------|--------------------|--------|--------|
26+
| **Amazon Computers** | accuracy | 0.6 | 0.2 | 0.2 | 0.918 | 0.915 | 0.939 | 3 |
27+
| **Amazon Photo** | accuracy | 0.6 | 0.2 | 0.2 | 0.959 | 0.961 | 0.967 | 3 |
28+
| **Amzon-Fraud** | roc-auc | 0.4 | 0.2 | 0.4 | 0.956 | 0.960 | 0.975 | 4 |
29+
| **YelpChi** | roc-auc | 0.4 | 0.2 | 0.4 | 0.856 | 0.890 | 0.950 | 5 |
30+
| **Multitarget 10k** | roc-auc | 0.6 | 0.2 | 0.2 | 0.730 | 0.838 | | |
31+
| **Multitarget 50k** | roc-auc | 0.6 | 0.2 | 0.2 | 0.756 | 0.841 | | |
32+
| **Penn94** | accuracy | 0.6 | 0.2 | 0.2 | 0.791 | 0.829 | 0.861 | 12 |
33+
| **Genius** | roc-auc | 0.6 | 0.2 | 0.2 | 0.902 | 0.902 | 0.915 | 12 |
3434

3535

3636
# Installation

0 commit comments

Comments
 (0)