ggml-org
/

Qwen2.5-Omni-3B-GGUF

Model card Files Files and versions

Qwen2.5-Omni-3B-GGUF

Original model: https://huggingface.co/Qwen/Qwen2.5-Omni-3B

Modalities:

✅ Text input
✅ Audio input
✅ Image input
❌ Video input
❌ Audio generation

Ref PR: https://github.com/ggml-org/llama.cpp/pull/13784

Downloads last month: 4,547

GGUF

Model size

3.4B params

Architecture

qwen2vl

Hardware compatibility

Log In to view the estimation

4-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/Qwen2.5-Omni-3B-GGUF

Base model

Qwen/Qwen2.5-Omni-3B

Quantized

(5)

this model

Collection including ggml-org/Qwen2.5-Omni-3B-GGUF

Multimodal GGUFs

Vision and audio models compatible with llama-server and llama-mtmd-cli • 12 items • Updated 8 days ago • 6