Hugging Face's logo

RedHatAI
/
Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation
Transformers
Safetensors
llama
facebook
meta
llama-3
int8
vllm
chat
neuralmagic
llmcompressor
conversational
8-bit precision
compressed-tensors
text-generation-inference
8-bit precision
Model card Files
xet
Community
3
Meta-Llama-3.1-8B-Instruct-quantized.w8a8 / model-00002-of-00002.safetensors

Commit History

Upload folder using huggingface_hub
25b9a14
verified

alexmarques commited on