File size: 525 Bytes
5c49cbe 147d73a 5c49cbe 147d73a 5c49cbe d5adfc2 5c49cbe |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 |
---
base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct
library_name: transformers
license_link: https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct/blob/main/LICENSE
license: apache-2.0
tags:
- qwen3
- qwen
- gptq
- 4 Bit
---
# 4-bit Quantization of the Qwen3 30B A3B Thinking 2507 Model
Quantized using GPTQModel
quantiziation config:
```
quant_config = QuantizeConfig(
bits=4,
group_size=32,
sym=True,
desc_act=False,
true_sequential=True,
pack_dtype=torch.int32,
damp_percent=0.1
)
``` |