Gemma 3
Collection
4 items
•
Updated
•
17
Multimodal GGUFs
Vision and audio models compatible with llama-server and llama-mtmd-cli
-
-
ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF
Image-Text-to-Text • 24B • Updated • 318 • 4 -
ggml-org/moondream2-20250414-GGUF
0.5B • Updated • 3.23k • 3
ggml-org/pixtral-12b-GGUF
12B • Updated • 785 • 4Note . ------------ Below are audio models
-
ggml-org/ultravox-v0_5-llama-3_2-1b-GGUF
Audio-Text-to-Text • 1B • Updated • 553 • 4
ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF
8B • Updated • 292 • 3Note . ------------ Below are vision+audio models
-
ggml-org/Qwen2.5-Omni-3B-GGUF
Any-to-Any • 3B • Updated • 4.67k • 7 -
ggml-org/Qwen2.5-Omni-7B-GGUF
Any-to-Any • 8B • Updated • 2.23k • 11 -
ggml-org/Voxtral-Mini-3B-2507-GGUF
4B • Updated • 786 • 2