Skip to content

Commit 74b9513

Browse files
committed
Add hierarchical merging results
1 parent 328b83d commit 74b9513

File tree

1 file changed

+10
-1
lines changed

1 file changed

+10
-1
lines changed

README.md

Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -177,13 +177,22 @@ Several work make use of additional features. For now, only the distance between
177177
The following table presents the results we obtained by training this model (for now, it has only one entry !). Note that:
178178

179179
- the reported results use `max_span_size=5` instead of `max_span_size=10` as in training.
180-
- the reported results were obtained by splitting documents for performance reasons, with subdocuments having a maximum length of 11 sentences. They may not be accurate with the performance on full documents
180+
- the reported results were obtained by splitting documents for performance reasons, with subdocuments having a maximum length of 11 sentences. They may not be accurate with the performance on full documents.
181181
- the reported results can not be directly compared to the performance in [the original Litbank paper](https://arxiv.org/abs/1912.01140) since we only compute performance on one split of the datas
182182

183183
| Dataset | Base model | MUC | B3 | CEAF | CoNLL F1 |
184184
|---------|-------------------|-------|-------|-------|----------|
185185
| Litbank | `bert-base-cased` | 77.35 | 67.63 | 56.66 | 67.21 |
186186

187+
## Results on full documents
188+
189+
The following table reports our results on the full Litbank documents (~2000 tokens each). We use `max_span_size=10`. HM stand for "Hierarchical Merging":
190+
191+
| Dataset | Base model | HM | MUC | B3 | CEAF | BLANC | LEA |
192+
|---------|-------------------|-----|-------|-------|-------|-------|-------|
193+
| Litbank | `bert-base-cased` | no | 72.97 | 48.26 | 46.64 | 47.16 | 27.33 |
194+
| Litbank | `bert-base-cased` | yes | 72.29 | 51.73 | 46.36 | 55.67 | 35.14 |
195+
187196

188197
# Citation
189198

0 commit comments

Comments
 (0)