PowerInfer
/

SmallThinker-21BA3B-Instruct-GGUF

Text Generation

Model card Files Files and versions

SmallThinker-21BA3B-Instruct-GGUF

Ctrl+K

Ctrl+K

3 contributors

History: 16 commits

yixinsong's picture

Upload SmallThinker-21B-A3B-Instruct-QAT.Q4_0.gguf with huggingface_hub

bedfd02 verified 29 days ago

.gitattributes

3.51 kB

Upload SmallThinker-21B-A3B-Instruct-QAT.Q4_0.gguf with huggingface_hub 29 days ago
README.md

6.04 kB

Update README.md about 1 month ago
SmallThinker-21B-A3B-Instruct-QAT.Q4_0.gguf

12.2 GB
xet

Upload SmallThinker-21B-A3B-Instruct-QAT.Q4_0.gguf with huggingface_hub 29 days ago
SmallThinker-21B-A3B-Instruct.F16.gguf

43 GB
xet

Upload SmallThinker-21B-A3B-Instruct.F16.gguf with huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.IQ4_NL.gguf

12.3 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.IQ4_XS.gguf

11.7 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.IQ4_XS.imatrix.gguf

11.6 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q3_K.gguf

10.4 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q3_K.imatrix.gguf

10.4 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q3_K_S.gguf

9.43 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q3_K_S.imatrix.gguf

9.43 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q4_0.gguf

12.2 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q4_0.gguf with huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q4_0.imatrix.gguf

12.3 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q4_0.powerinfer.gguf

12.1 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q4_0.powerinfer.gguf with huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q4_1.gguf

13.6 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q4_1.gguf with huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q4_1.imatrix.gguf

13.6 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q4_K.gguf

13.1 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q4_K.gguf with huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q4_K.imatrix.gguf

13.1 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q4_K_S.gguf

12.3 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q4_K_S.imatrix.gguf

12.3 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q5_K.gguf

15.3 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q5_K.imatrix.gguf

15.3 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q6_K.gguf

17.7 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q6_K.gguf with huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q6_K.imatrix.gguf

17.7 GB
xet

Upload folder using huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q8_0.gguf

22.9 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q8_0.gguf with huggingface_hub about 1 month ago
SmallThinker-21B-A3B-Instruct.Q8_0.imatrix.gguf

22.9 GB
xet

Upload folder using huggingface_hub about 1 month ago
zh-21b-imatrix.dat

81.3 MB
xet

Upload folder using huggingface_hub about 1 month ago