Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Llama-3.2-1B-GGUF
like
3
Text Generation
Transformers
GGUF
PyTorch
8 languages
facebook
meta
llama
llama-3
imatrix
arxiv:
2204.05149
arxiv:
2405.16406
License:
llama3.2
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
main
Llama-3.2-1B-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
40 commits
Mungert
Delete file(s) containing ['q2_k_l.gguf', 'q3_k_l.gguf', 'q4_k_l.gguf', 'q5_k_l.gguf', 'q6_k_l.gguf', 'q4_0_l.gguf', 'q5_0_l.gguf', 'q4_1_l.gguf', 'q5_1_l.gguf', 'bf16_q6_k.gguf']
09fdc4b
verified
about 1 month ago
.gitattributes
Safe
3.17 kB
Upload Llama-3.2-1B-bf16.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-bf16-q4_k.gguf
Safe
1.12 GB
xet
Upload Llama-3.2-1B-bf16-q4_k.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-bf16-q6_k.gguf
Safe
1.33 GB
xet
Upload Llama-3.2-1B-bf16-q6_k.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-bf16-q8_0.gguf
Safe
1.57 GB
xet
Upload Llama-3.2-1B-bf16-q8_0.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-bf16.gguf
Safe
2.48 GB
xet
Upload Llama-3.2-1B-bf16.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-f16-q4_k.gguf
Safe
1.12 GB
xet
Upload Llama-3.2-1B-f16-q4_k.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-f16-q6_k.gguf
Safe
1.33 GB
xet
Upload Llama-3.2-1B-f16-q6_k.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-f16-q8_0.gguf
Safe
1.57 GB
xet
Upload Llama-3.2-1B-f16-q8_0.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-iq3_xs.gguf
Safe
621 MB
xet
Upload Llama-3.2-1B-iq3_xs.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-iq4_nl.gguf
Safe
773 MB
xet
Upload Llama-3.2-1B-iq4_nl.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-iq4_xs.gguf
Safe
743 MB
xet
Upload Llama-3.2-1B-iq4_xs.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-q3_k_m.gguf
Safe
691 MB
xet
Upload Llama-3.2-1B-q3_k_m.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-q3_k_s.gguf
Safe
642 MB
xet
Upload Llama-3.2-1B-q3_k_s.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-q4_0.gguf
Safe
835 MB
xet
Upload Llama-3.2-1B-q4_0.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-q4_1.gguf
Safe
895 MB
xet
Upload Llama-3.2-1B-q4_1.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-q4_k_m.gguf
Safe
808 MB
xet
Upload Llama-3.2-1B-q4_k_m.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-q4_k_s.gguf
Safe
776 MB
xet
Upload Llama-3.2-1B-q4_k_s.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-q5_k_m.gguf
Safe
911 MB
xet
Upload Llama-3.2-1B-q5_k_m.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-q5_k_s.gguf
Safe
893 MB
xet
Upload Llama-3.2-1B-q5_k_s.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-q6_k_m.gguf
Safe
1.02 GB
xet
Upload Llama-3.2-1B-q6_k_m.gguf with huggingface_hub
6 months ago
Llama-3.2-1B-q8_0.gguf
Safe
1.32 GB
xet
Upload Llama-3.2-1B-q8_0.gguf with huggingface_hub
6 months ago
Llama-3.2-1B.imatrix
Safe
1.31 MB
xet
Upload Llama-3.2-1B.imatrix with huggingface_hub
6 months ago
Llama-3.2-1B.imatrix.at_100
Safe
1.31 MB
xet
Upload Llama-3.2-1B.imatrix.at_100 with huggingface_hub
6 months ago
README.md
Safe
41.2 kB
Upload README.md with huggingface_hub
6 months ago
