-
-
-
-
-
-
Inference Providers
Active filters:
3-bit
mlx-community/GLM-4.5-Air-3bit
Text Generation
•
107B
•
Updated
•
4.22k
•
21
mlx-community/GLM-4.5-Air-3bit-DWQ
Text Generation
•
107B
•
Updated
•
1.97k
•
4
MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF
Text Generation
•
1B
•
Updated
•
153k
•
16
MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
184k
•
16
MaziyarPanahi/Qwen3-1.7B-GGUF
Text Generation
•
2B
•
Updated
•
154k
•
4
MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF
Text Generation
•
8B
•
Updated
•
168k
•
94
MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF
Text Generation
•
12B
•
Updated
•
161k
•
49
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
•
8B
•
Updated
•
151k
•
23
MaziyarPanahi/solar-pro-preview-instruct-GGUF
Text Generation
•
22B
•
Updated
•
148k
•
26
MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF
Text Generation
•
2B
•
Updated
•
149k
•
7
MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF
Text Generation
•
3B
•
Updated
•
149k
•
14
MaziyarPanahi/MistralNemoTiny-GGUF
Text Generation
•
5B
•
Updated
•
64
•
2
MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF
Text Generation
•
123B
•
Updated
•
148k
•
2
MaziyarPanahi/Phi-4-mini-instruct-GGUF
Text Generation
•
4B
•
Updated
•
153k
•
7
MaziyarPanahi/gemma-3-1b-it-GGUF
Text Generation
•
1.0B
•
Updated
•
162k
•
7
MaziyarPanahi/gemma-3-4b-it-GGUF
Text Generation
•
4B
•
Updated
•
155k
•
10
MaziyarPanahi/Qwen3-4B-GGUF
Text Generation
•
4B
•
Updated
•
164k
•
5
mlx-community/Qwen3-235B-A22B-Thinking-2507-3bit-DWQ
Text Generation
•
235B
•
Updated
•
511
•
5
fengpeisheng1/The-Omega-Directive-M-12B-Unslop-v2.0-mlx-3Bit
Text Generation
•
2B
•
Updated
•
22
•
1
kaitchup/Llama-2-7b-gptq-3bit
Text Generation
•
Updated
•
4
clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit
Text Generation
•
Updated
•
5
•
3
clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit
Text Generation
•
Updated
•
5
•
3
MiNeves-TensorOps/opt-125m-gptq-3bit
Text Generation
•
Updated
•
4
Kimata/opt-125m-3bit
Text Generation
•
Updated
•
4
LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2
Text Generation
•
Updated
•
4
danny0122/Llama-2-7b-hf-gptq-3bits
Text Generation
•
0.9B
•
Updated
•
5
danny0122/Llama-2-7b-hf-gptq-3bitssafe
Text Generation
•
0.9B
•
Updated
•
8
danny0122/stablelm-base-alpha-3b-gptq-3bits
Text Generation
•
0.7B
•
Updated
•
4
danny0122/stablelm-base-alpha-3b-gptq-3bitssafe
Text Generation
•
0.7B
•
Updated
•
4
SicariusSicariiStuff/Tenebra_PreAlpha_128g_3BIT
Text Generation
•
4B
•
Updated
•
9