-
-
-
-
-
-
Inference Providers
Active filters:
gptq
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
4B
•
Updated
•
1.21k
•
583
TheBloke/MythoMax-L2-13B-GPTQ
Text Generation
•
2B
•
Updated
•
3.43k
•
214
QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact
Text Generation
•
Updated
•
1.2k
•
3
baichuan-inc/Baichuan-M2-32B-GPTQ-Int4
Text Generation
•
6B
•
Updated
•
1.09k
•
7
TheBloke/WizardLM-13B-V1.0-Uncensored-GPTQ
Text Generation
•
2B
•
Updated
•
1.22k
•
30
TheBlokeAI/jackfram_llama-68m-GPTQ
Text Generation
•
0.1B
•
Updated
•
13
•
1
TheBloke/storytime-13B-GPTQ
Text Generation
•
2B
•
Updated
•
1.12k
•
40
TheBloke/EstopianMaid-13B-GPTQ
Text Generation
•
2B
•
Updated
•
43
•
19
TheBloke/Tess-34B-v1.5b-GPTQ
Text Generation
•
5B
•
Updated
•
12
•
8
TechxGenus/starcoder2-7b-instruct-GPTQ
Text Generation
•
1B
•
Updated
•
14
•
2
RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
1B
•
Updated
•
76k
•
20
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4
Text Generation
•
2B
•
Updated
•
29.6k
•
37
shuyuej/Llama-3.2-1B-Instruct-GPTQ
0.4B
•
Updated
•
7.89k
•
3
jakiAJK/DeepSeek-R1-Distill-Qwen-1.5B_GPTQ-int4
Text Generation
•
0.6B
•
Updated
•
60
•
3
kaitchup/Llama-3.3-70B-Instruct-AutoRoundGPTQ-8bit
Text Generation
•
20B
•
Updated
•
46
•
1
kaitchup/Qwen3-0.6B-autoround-4bit-gptq
0.2B
•
Updated
•
16
•
3
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
5B
•
Updated
•
77.3k
•
25
tencent/Hunyuan-A13B-Instruct-GPTQ-Int4
Text Generation
•
11B
•
Updated
•
28.8k
•
48
QuantTrio/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8
Text Generation
•
8B
•
Updated
•
4.16k
•
5
xiangxinai/Xiangxin-Guardrails-Text
Text Generation
•
3B
•
Updated
•
169
•
4
mediainbox/MiMo-VL-7B-RL-2508-gptq-q4
Image-to-Text
•
3B
•
Updated
•
110
•
1
Delnith/Sugoi-14B-Ultra-HF-gptqmodel-4bit
Text Generation
•
3B
•
Updated
•
48
•
1
Delnith/Sugoi-14B-Ultra-HF-gptqmodel-8bit
Text Generation
•
5B
•
Updated
•
68
•
1
elinas/alpaca-13b-lora-int4
Text Generation
•
Updated
•
18
•
41
elinas/alpaca-30b-lora-int4
Text Generation
•
Updated
•
17
•
68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
41
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
19
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
16
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
15
•
2
elinas/vicuna-13b-4bit
Text Generation
•
Updated
•
19
•
45