Lmxyy commited on
Commit
ef1a773
·
verified ·
1 Parent(s): 4a3c716

Upload ./README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +77 -0
README.md ADDED
@@ -0,0 +1,77 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: black-forest-labs/FLUX.1-Krea-dev
3
+ base_model_relation: quantized
4
+ datasets:
5
+ - mit-han-lab/svdquant-datasets
6
+ language:
7
+ - en
8
+ library_name: diffusers
9
+ license: other
10
+ license_link: https://huggingface.co/black-forest-labs/FLUX.1-Krea-dev/blob/main/LICENSE.md
11
+ license_name: flux-1-dev-non-commercial-license
12
+ pipeline_tag: text-to-image
13
+ tags:
14
+ - text-to-image
15
+ - SVDQuant
16
+ - FLUX.1-Krea-dev
17
+ - FLUX.1
18
+ - Diffusion
19
+ - Quantization
20
+ - ICLR2025
21
+
22
+ ---
23
+ <p align="center" style="border-radius: 10px">
24
+ <img src="https://huggingface.co/datasets/nunchaku-tech/cdn/resolve/main/nunchaku/assets/nunchaku.svg" width="30%" alt="Nunchaku Logo"/>
25
+ </p>
26
+
27
+ # Model Card for nunchaku-flux.1-krea-dev
28
+
29
+ ![visual](https://huggingface.co/datasets/nunchaku-tech/cdn/resolve/main/ComfyUI-nunchaku/workflows/nunchaku-flux.1-krea-dev.png)
30
+ This repository contains Nunchaku-quantized versions of [FLUX.1-Krea-dev](https://huggingface.co/black-forest-labs/FLUX.1-Krea-dev), designed to generate high-quality images from text prompts. It is optimized for efficient inference while maintaining minimal loss in performance.
31
+
32
+ ## Model Details
33
+
34
+ ### Model Description
35
+
36
+ - **Developed by:** Nunchaku Team
37
+ - **Model type:** text-to-image
38
+ - **License:** [flux-1-krea-dev-non-commercial-license](https://huggingface.co/black-forest-labs/FLUX.1-Krea-dev/blob/main/LICENSE.md)
39
+ - **Quantized from model:** [FLUX.1-Krea-dev](https://huggingface.co/black-forest-labs/FLUX.1-Krea-dev)
40
+
41
+ ### Model Files
42
+
43
+ - [`svdq-int4_r32-flux.1-krea-dev.safetensors`](./svdq-int4_r32-flux.1-krea-dev.safetensors): SVDQuant quantized INT4 FLUX.1-Krea-dev model. For users with non-Blackwell GPUs (pre-50-series).
44
+ - [`svdq-fp4_r32-flux.1-krea-dev.safetensors`](./svdq-fp4_r32-flux.1-krea-dev.safetensors): SVDQuant quantized NVFP4 FLUX.1-Krea-dev model. For users with Blackwell GPUs (50-series).
45
+
46
+
47
+ ### Model Sources
48
+
49
+ - **Inference Engine:** [nunchaku](https://github.com/nunchaku-tech/nunchaku)
50
+ - **Quantization Library:** [deepcompressor](https://github.com/nunchaku-tech/deepcompressor)
51
+ - **Paper:** [SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models](http://arxiv.org/abs/2411.05007)
52
+ - **Demo:** [svdquant.mit.edu](https://svdquant.mit.edu)
53
+
54
+ ## Usage
55
+
56
+ - Diffusers Usage: See [flux.1-krea-dev.py](https://github.com/nunchaku-tech/nunchaku/blob/main/examples/flux.1-krea-dev.py). Just replace the safetensors with the ones from this repository. Check our [tutorial](https://nunchaku.tech/docs/nunchaku/usage/basic_usage.html) for more advanced usage.
57
+ - ComfyUI Usage: See [nunchaku-flux.1-dev.json](https://nunchaku.tech/docs/ComfyUI-nunchaku/workflows/t2i.html#nunchaku-flux-1-dev-json). Just replace the safetensors with the ones from this repository.
58
+
59
+ ## Performance
60
+
61
+ ![performance](https://huggingface.co/datasets/nunchaku-tech/cdn/resolve/main/nunchaku/assets/efficiency.jpg)
62
+
63
+ ## Citation
64
+
65
+ ```bibtex
66
+ @inproceedings{
67
+ li2024svdquant,
68
+ title={SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models},
69
+ author={Li*, Muyang and Lin*, Yujun and Zhang*, Zhekai and Cai, Tianle and Li, Xiuyu and Guo, Junxian and Xie, Enze and Meng, Chenlin and Zhu, Jun-Yan and Han, Song},
70
+ booktitle={The Thirteenth International Conference on Learning Representations},
71
+ year={2025}
72
+ }
73
+ ```
74
+
75
+ ## Attribution Notice
76
+
77
+ The FLUX.1 [dev] Model is licensed by Black Forest Labs Inc. under the FLUX.1 [dev] Non-Commercial License. Copyright Black Forest Labs Inc. IN NO EVENT SHALL BLACK FOREST LABS INC. BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.