Sentence Similarity
Safetensors
roberta
zdanGL commited on
Commit
4d77f2c
·
verified ·
1 Parent(s): b7cd708

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -113,8 +113,8 @@ for i, definition in enumerate(definitions):
113
  - **Max Sequence Length:** 256 tokens (both mentions and descriptions)
114
 
115
  ### Benchmark Results
116
- - **Dataset:** Zero-Shot Entity Linking [(Logeswaran et al., 2019)](https://arxiv.org/abs/1906.07348) test set. More details [here](https://github.com/lajanugen/zeshel/blob/master/README.md)
117
- - **Metric:** Recall@64
118
  - **Score:** 80.29%
119
  - **Comparison:** [Meta AI's BLINK](https://arxiv.org/pdf/1911.03814) achieves 82.06% on the same test set - slightly higher than ours, however, their model was trained on the training set but ours was not.
120
  - **Conclusion:** Our model has strong zero-shot performance
 
113
  - **Max Sequence Length:** 256 tokens (both mentions and descriptions)
114
 
115
  ### Benchmark Results
116
+ - **Dataset:** Zero-Shot Entity Linking [(Logeswaran et al., 2019)](https://arxiv.org/abs/1906.07348) test set.
117
+ - **Metric:** Recall@64 (Average performance across the set of test worlds was computed by macroaveraging - we followed the same pattern as in [Meta AI's BLINK paper](https://arxiv.org/pdf/1911.03814))
118
  - **Score:** 80.29%
119
  - **Comparison:** [Meta AI's BLINK](https://arxiv.org/pdf/1911.03814) achieves 82.06% on the same test set - slightly higher than ours, however, their model was trained on the training set but ours was not.
120
  - **Conclusion:** Our model has strong zero-shot performance