Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
QuantTrio
/
DeepSeek-V3.1-AWQ-Fp16Mix
like
1
Follow
QuantTrio
77
Text Generation
Transformers
Safetensors
Chinese
English
deepseek_v3
vLLM
GPTQ
conversational
custom_code
text-generation-inference
4-bit precision
awq
arxiv:
2412.19437
License:
mit
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
3168a80
DeepSeek-V3.1-AWQ-Fp16Mix
Ctrl+K
Ctrl+K
1 contributor
History:
9 commits
JunHowie
Upload model-00006-of-00157.safetensors with huggingface_hub
3168a80
verified
20 days ago
assets
Upload folder using huggingface_hub
20 days ago
.gitattributes
Safe
1.58 kB
Upload folder using huggingface_hub
20 days ago
LICENSE
Safe
1.06 kB
Upload folder using huggingface_hub
20 days ago
README.md
Safe
12.8 kB
Upload folder using huggingface_hub
20 days ago
awq_marlin.py
Safe
21.8 kB
Upload folder using huggingface_hub
20 days ago
config.json
Safe
1.9 kB
Upload folder using huggingface_hub
20 days ago
configuration.json
Safe
48 Bytes
Upload folder using huggingface_hub
20 days ago
configuration_deepseek.py
Safe
9.9 kB
Upload folder using huggingface_hub
20 days ago
deepseek_v2.py
Safe
40 kB
Upload folder using huggingface_hub
20 days ago
generation_config.json
Safe
171 Bytes
Upload folder using huggingface_hub
20 days ago
model-00001-of-00157.safetensors
Safe
2.94 GB
xet
Upload model-00001-of-00157.safetensors with huggingface_hub
20 days ago
model-00002-of-00157.safetensors
Safe
3 GB
xet
Upload model-00002-of-00157.safetensors with huggingface_hub
20 days ago
model-00004-of-00157.safetensors
Safe
2.99 GB
xet
Upload model-00004-of-00157.safetensors with huggingface_hub
20 days ago
model-00006-of-00157.safetensors
Safe
2.99 GB
xet
Upload model-00006-of-00157.safetensors with huggingface_hub
20 days ago
model-00007-of-00157.safetensors
Safe
2.99 GB
xet
Upload model-00007-of-00157.safetensors with huggingface_hub
20 days ago
model-00008-of-00157.safetensors
Safe
2.99 GB
xet
Upload model-00008-of-00157.safetensors with huggingface_hub
20 days ago
model-00011-of-00157.safetensors
Safe
2.99 GB
xet
Upload model-00011-of-00157.safetensors with huggingface_hub
20 days ago
model.safetensors.index.json
Safe
11.7 MB
xet
Upload folder using huggingface_hub
20 days ago
modeling_deepseek.py
Safe
75.7 kB
Upload folder using huggingface_hub
20 days ago
tokenizer.json
Safe
7.85 MB
Upload folder using huggingface_hub
20 days ago
tokenizer_config.json
Safe
3.75 kB
Upload folder using huggingface_hub
20 days ago
