Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
QuantTrio
/
DeepSeek-V3.1-AWQ-Fp16Mix
like
1
Follow
QuantTrio
77
Text Generation
Transformers
Safetensors
Chinese
English
deepseek_v3
vLLM
GPTQ
conversational
custom_code
text-generation-inference
4-bit precision
awq
arxiv:
2412.19437
License:
mit
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
4eca44d
DeepSeek-V3.1-AWQ-Fp16Mix
/
generation_config.json
JunHowie
Upload folder using huggingface_hub
8c42def
verified
18 days ago
raw
Copy download link
history
blame
Safe
171 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
0
,
"eos_token_id"
:
1
,
"do_sample"
:
true
,
"temperature"
:
0.6
,
"top_p"
:
0.95
,
"transformers_version"
:
"4.46.3"
}