Edit Models filters

Model Tree

PowerInfer/SmallThinker-3B-Preview

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

23

Full-text search

Active filters: PowerInfer/SmallThinker-3B-Preview

NikolayKozloff/SmallThinker-3B-Preview-Q8_0-GGUF

3B • Updated Dec 30, 2024 • 16 • 1

bartowski/SmallThinker-3B-Preview-GGUF

Text Generation • 3B • Updated Dec 30, 2024 • 1.12k • 29

lace1/SmallThinker-3B-Preview-Q8_0-GGUF

3B • Updated Dec 30, 2024 • 3

mradermacher/SmallThinker-3B-Preview-GGUF

3B • Updated Jan 1 • 106

mradermacher/SmallThinker-3B-Preview-i1-GGUF

3B • Updated Jan 1 • 315 • 1

adriabama06/SmallThinker-3B-Preview-AWQ

Text Generation • Updated Jan 3 • 2 • 1

tensorblock/SmallThinker-3B-Preview-GGUF

3B • Updated Jul 9 • 113

QuantFactory/SmallThinker-3B-Preview-abliterated-GGUF

3B • Updated Jan 2 • 60 • 4

DevQuasar/PowerInfer.SmallThinker-3B-Preview-GGUF

Text Generation • 3B • Updated 12 days ago • 358 • 1

itlwas/SmallThinker-3B-Preview-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 8 • 2

ubaitur5/SmallThinker-3B-Preview-Q4-mlx

Text Generation • 0.5B • Updated Jan 4 • 8

onnx-community/SmallThinker-3B-Preview-ONNX

Text Generation • Updated Mar 6 • 3

IntelligentEstate/Tangu-3B-Qwenstar-Q8-GGUF

Text Generation • 3B • Updated Jan 27 • 2 • 2

mlx-community/smallthinker-3b-preview-q8

Text Generation • 0.9B • Updated Jan 5 • 11

mlx-community/smallthinker-3b-preview-q4

Text Generation • 0.5B • Updated Jan 5 • 7

yasserrmd/SmallThinker-3B-Preview-gguf

3B • Updated Jan 5 • 12

OPEA/SmallThinker-3B-Preview-int4-sym-gguf-q4-0-inc

3B • Updated Jan 14 • 17 • 1

mlx-community/SmallThinker-3B-Preview-4bit

Text Generation • 0.5B • Updated Jan 7 • 47 • 1

onnx-community/SmallThinker-3B-Preview-DML-ONNX

Text Generation • Updated Mar 6 • 2

onnx-community/SmallThinker-3B-Preview-MHA-ONNX

Text Generation • Updated Mar 6 • 2

PrunaAI/PowerInfer-SmallThinker-3B-Preview-GGUF-smashed

3B • Updated Feb 19 • 15

mlx-community/SmallThinker-3B-Preview-6bit

Text Generation • 0.7B • Updated Feb 27 • 7

mku64/SmallThinker-3B-Preview-mlx-4Bit

Text Generation • 0.5B • Updated Mar 28 • 25