Skip to content

Commit 714c963

Browse files
Update score
1 parent 196f5d7 commit 714c963

File tree

2 files changed

+7
-6
lines changed

2 files changed

+7
-6
lines changed

README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -84,11 +84,11 @@ $\text{Acc.}$ is the accuracy of models trained on different samples. Samples' m
8484
- $\text{syn-any}$: Synthetic dataset with personalized evaluation methods (hard or soft labels);
8585
- $\text{rdm-any}$: Randomly selected dataset (under the same compression ratio) with the same personalized evaluation methods.
8686

87-
DD-Ranking uses a weight sum of $-\text{IOR}$ and $\text{HLR}$ to rank different methods:
87+
DD-Ranking uses a weight sum of $\text{IOR}$ and $-\text{HLR}$ to rank different methods:
8888
$$
89-
\text{Rank\_Score} = w_1 (-\text{IOR}) + w_2 \text{HLR}, \quad w_1 + w_2 = 1
89+
\text{Rank\_Score} = \frac{e^{w \text{IOR} - (1-w) \text{HLR}} - e^{-1}}{e - e^{-1}}, \quad w \in [0, 1]
9090
$$
91-
By default, we set $w_1 = w_2 = 0.5$ on the leaderboard, meaning that both $\text{IOR}$ and $\text{HLR}$ are equally important. Users can adjust the weights to emphasize one aspect on the leaderboard.
91+
By default, we set $w = 0.5$ on the leaderboard, meaning that both $\text{IOR}$ and $\text{HLR}$ are equally important. Users can adjust the weights to emphasize one aspect on the leaderboard.
9292

9393
</details>
9494

doc/introduction.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,8 @@ The evaluation method for DD-Ranking is grounded in the essence of dataset disti
5656
- \\(\text{syn-any}\\): Synthetic dataset with personalized evaluation methods (hard or soft labels);
5757
- \\(\text{rdm-any}\\): Randomly selected dataset (under the same compression ratio) with the same personalized evaluation methods.
5858

59-
DD-Ranking uses a weight sum of \\(-\text{IOR}\\) and \\(\text{HLR}\\) to rank different methods:
60-
\\[\text{Rank\_Score} = w_1 (-\text{IOR}) + w_2 \text{HLR}, \quad w_1 + w_2 = 1\\]
61-
By default, we set \\(w_1 = w_2 = 0.5\\) on the leaderboard, meaning that both \\(\text{IOR}\\) and \\(\text{HLR}\\) are equally important. Users can adjust the weights to emphasize one aspect on the leaderboard.
59+
DD-Ranking uses a weight sum of \\\text{IOR}\\) and \\(-\text{HLR}\\) to rank different methods:
60+
\\[\text{Rank\_Score} = \frac{e^{w \text{IOR}) - (1-w) \text{HLR}} - e^{-1}}{e - e^{-1}}, \quad w \in [0, 1]\\]
61+
62+
By default, we set \\(w = 0.5\\) on the leaderboard, meaning that both \\(\text{IOR}\\) and \\(\text{HLR}\\) are equally important. Users can adjust the weights to emphasize one aspect on the leaderboard.
6263

0 commit comments

Comments
 (0)