eaddario
/

Dolphin-Mistral-24B-Venice-Edition-pruned-GGUF

Text Generation

Model card Files Files and versions

Dolphin-Mistral-24B-Venice-Edition-pruned-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 23 commits

eaddario's picture

Update README.md

c2d8908 verified 2 months ago

imatrix
Generate imatrices 2 months ago
logits
Generate base model logits 2 months ago
scores
Add GGUF internal file structure 2 months ago
.gitattributes

1.6 kB

Update .gitattributes 2 months ago
.gitignore

6.78 kB

Add .gitignore 2 months ago
Dolphin-Mistral-24B-Venice-Edition-F16.gguf

47.2 GB
xet

Convert safetensor to GGUF @ F16 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-IQ3_M.gguf

9.55 GB
xet

Layer-wise & pruned quantization IQ3_M 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-IQ3_S.gguf

9.26 GB
xet

Layer-wise & pruned quantization IQ3_S 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-IQ4_NL.gguf

11.6 GB
xet

Layer-wise & pruned quantization IQ4_NL 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-Q3_K_L.gguf

10.8 GB
xet

Layer-wise & pruned quantization Q3_K_L 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-Q3_K_M.gguf

9.93 GB
xet

Layer-wise & pruned quantization Q3_K_M 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-Q3_K_S.gguf

8.86 GB
xet

Layer-wise & pruned quantization Q3_K_S 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-Q4_K_M.gguf

12.4 GB
xet

Layer-wise & pruned quantization Q4_K_M 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-Q4_K_S.gguf

11.7 GB
xet

Layer-wise & pruned quantization Q4_K_S 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-Q5_K_M.gguf

14.3 GB
xet

Layer-wise & pruned quantization Q5_K_M 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-Q5_K_S.gguf

13.9 GB
xet

Layer-wise & pruned quantization Q5_K_S 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-Q6_K.gguf

16.8 GB
xet

Layer-wise & pruned quantization Q6_K 2 months ago
Dolphin-Mistral-24B-Venice-Edition-pruned-Q8_0.gguf

21.9 GB
xet

Layer-wise & pruned quantization Q8_0 2 months ago
README.md

25.4 kB

Update README.md 2 months ago