Fp8 and fp4 pls
#2
by
Timmek
- opened
Can I have compiled versions of FP8 and FP4, please?
If you are using comftyui there are already gguf conversion for it.
If you are using comftyui there are already gguf conversion for it.
I don't use Comfy. I prefer to run through HuggingFace Piplines and TensorRt