Update README.md
Browse files
README.md
CHANGED
@@ -52,7 +52,7 @@ MLX:
|
|
52 |
# Usage
|
53 |
- Use Mistral v7 Tekken.
|
54 |
- It is **highly recommended** (if your framework supports it) to use the official Mistral tokenization code instead of Huggingface's. This is possible in vLLM with `--tokenizer-mode mistral`.
|
55 |
-
- Recommended samplers (from CURSE and
|
56 |
- We recommend *a* system prompt, but its contents only faintly matter (I accidentally had an assistant system prompt during the entire time I was testing)
|
57 |
|
58 |
# Training Process
|
|
|
52 |
# Usage
|
53 |
- Use Mistral v7 Tekken.
|
54 |
- It is **highly recommended** (if your framework supports it) to use the official Mistral tokenization code instead of Huggingface's. This is possible in vLLM with `--tokenizer-mode mistral`.
|
55 |
+
- Recommended samplers (from CURSE and corroborated by me, Fizz) are 1.2 temperature, 0.1 min_p, and 1.05 repetition penalty.
|
56 |
- We recommend *a* system prompt, but its contents only faintly matter (I accidentally had an assistant system prompt during the entire time I was testing)
|
57 |
|
58 |
# Training Process
|