GPT OSS 120B GGUF

Recommended way to run this model:

llama-server -hf ggml-org/gpt-oss-120b-GGUF -c 0 -fa --jinja --reasoning-format none

# Then, access http://localhost:8080

GGUF

Model size

117B params

Architecture

gpt-oss

Hardware compatibility

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/gpt-oss-120b-GGUF

Base model

Quantized

(21)

this model