Skip to content

RESULTS.md

Latest commit

 

History

History
84 lines (80 loc) · 7.87 KB

RESULTS.md

File metadata and controls

84 lines (80 loc) · 7.87 KB

Transactions

Method Acc. mAP MAE OTD Val / Test T-mAP Val / Test
MostPopular 32.69 1.09 0.649 7.03 / 7.05 2.86 / 3.10
HistoryDensity 32.78 0.85 1.063 7.42 / 7.44 7.92 / 7.51
IFTPP (GRU) 38.27 4.65 0.637 6.79 / 6.81 6.20 / 6.08
IFTPP (transformer) 37.68 4.30 0.640 6.84 / 6.85 5.80 / 5.55
IFTPP-K 37.71 4.17 0.642 7.12 / 7.14 4.29 / 4.26
RMTPP 38.28 4.64 0.693 6.68 / 6.70 7.41 / 7.12
RMTPP-K 37.74 4.26 0.700 7.03 / 7.05 5.74 / 5.69
NHP 35.47 3.36 0.693 6.99 / 6.99 5.66 / 5.48
AttNHP 30.68 1.09 0.749 7.47 / 7.48 1.50 / 1.49
ODE 35.60 3.34 0.695 6.96 / 6.97 5.53 / 5.52
HYPRO 22.50 4.62 0.694 7.62 / 7.62 8.20 / 7.54
Diffusion 36.05 3.66 0.650 6.86 / 6.88 5.95 / 6.04
DeTPP 38.29 4.67 0.638 6.68 / 6.70 9.59 / 9.26

MIMIC-IV

Method Acc. mAP MAE OTD Val / Test T-mAP Val / Test
MostPopular 4.80 2.75 14.52 19.75 / 19.75 1.63 / 1.56
HistoryDensity 0.74 2.63 3.23 18.94 / 18.92 4.25 / 4.19
IFTPP (GRU) 58.52 46.04 3.00 11.53 / 11.55 22.56 / 22.31
IFTPP (transformer) 58.57 47.96 3.03 11.46 / 11.48 24.07 / 23.68
IFTPP-K 57.95 44.57 3.06 13.18 / 13.19 22.46 / 22.30
RMTPP 58.24 45.62 3.93 13.69 / 13.76 22.00 / 21.62
RMTPP-K 57.41 43.31 3.62 14.69 / 14.73 20.87 / 20.56
NHP 23.19 11.67 4.71 17.92 / 17.92 9.76 / 9.80
AttNHP 44.99 31.88 2.95 14.30 / 14.31 19.98 / 19.74
ODE 44.16 27.48 2.91 14.36 / 14.39 16.37 / 16.19
HYPRO 45.69 45.54 3.98 14.68 / 14.75 16.41 / 16.13
Diffusion 46.22 33.67 2.99 13.25 / 13.28 22.90 / 22.82
DeTPP 58.66 46.56 3.01 12.94 / 12.95 30.73 / 30.35

Retweet

Method Acc. mAP MAE OTD Val / Test T-mAP Val / Test
MostPopular 58.50 39.85 18.82 141.7 / 139.1 29.72 / 30.02
HistoryDensity 58.62 39.86 20.68 178.5 / 177.0 44.48 / 44.60
IFTPP (GRU) 59.75 46.23 18.27 165.8 / 164.8 43.93 / 40.59
IFTPP (transformer) 59.88 46.07 18.47 167.4 / 166.1 43.73 / 40.05
IFTPP-K 58.35 43.75 19.07 164.5 / 163.4 48.05 / 46.22
RMTPP 60.01 46.81 18.60 169.2 / 168.0 49.03 / 45.60
RMTPP-K 59.92 46.45 18.46 168.0 / 167.5 51.27 / 48.55
NHP 60.05 46.84 18.39 167.0 / 165.7 49.25 / 45.64
AttNHP 60.06 46.66 18.32 174.7 / 172.9 26.74 / 24.24
ODE 59.93 46.36 18.53 168.2 / 166.7 48.95 / 45.45
HYPRO 50.84 46.84 18.61 161.8 / 160.4 50.58 / 46.87
Diffusion 57.72 42.96 18.60 159.0 / 158.0 54.24 / 52.24
DeTPP 60.04 46.76 18.35 136.4 / 132.9 61.47 / 57.93

Amazon

Method Acc. mAP MAE OTD Val / Test T-mAP Val / Test
MostPopular 33.46 9.58 0.304 6.33 / 6.30 10.10 / 9.72
HistoryDensity 32.68 9.63 0.325 7.29 / 7.27 28.25 / 27.53
IFTPP (GRU) 35.54 16.72 0.250 6.70 / 6.64 23.05 / 23.79
IFTPP (transformer) 35.27 16.46 0.245 6.64 / 6.59 22.81 / 23.42
IFTPP-K 34.93 15.85 0.250 6.72 / 6.70 22.36 / 22.83
RMTPP 35.85 17.21 0.292 6.67 / 6.62 19.65 / 19.99
RMTPP-K 34.97 15.93 0.299 6.88 / 6.85 18.87 / 19.17
NHP 16.58 11.19 0.438 8.54 / 8.52 27.19 / 26.95
AttNHP 22.21 8.22 0.526 7.63 / 7.61 19.29 / 18.59
ODE 10.44 10.28 0.473 9.23 / 9.23 23.73 / 23.13
HYPRO 21.47 17.14 0.288 6.95 / 6.95 20.47 / 20.28
Diffusion 30.57 13.36 0.247 6.56 / 6.52 30.08 / 30.29
DeTPP 35.77 17.27 0.237 6.03 / 5.98 37.08 / 37.20

StackOverflow

Method Acc. mAP MAE OTD Val / Test T-mAP Val / Test
MostPopular 42.90 5.45 0.602 13.12 / 13.15 8.97 / 8.16
HistoryDensity 42.51 5.61 0.669 17.30 / 17.29 16.23 / 14.90
IFTPP (GRU) 45.31 11.59 0.646 13.56 / 13.66 9.68 / 8.87
IFTPP (transformer) 45.40 12.78 0.639 13.51 / 13.61 9.62 / 8.81
IFTPP-K 44.32 9.18 0.652 13.30 / 13.43 13.91 / 12.97
RMTPP 45.30 12.61 0.717 13.00 / 13.25 13.81 / 13.35
RMTPP-K 44.59 10.41 0.694 12.96 / 13.17 15.45 / 14.74
NHP 44.12 9.90 0.735 13.27 / 13.46 13.12 / 12.41
AttNHP 45.17 12.56 0.703 13.10 / 13.31 11.95 / 11.15
ODE 44.19 9.08 0.728 13.12 / 13.35 11.48 / 10.75
HYPRO 30.54 12.61 0.718 14.00 / 14.12 15.25 / 14.84
Diffusion 37.03 7.48 0.668 12.87 / 13.01 15.80 / 15.07
DeTPP 45.53 14.00 0.639 12.04 / 12.14 23.80 / 22.72