exl2/gptq quants
#10
by
PlatonicSkeptic
- opened
hello, is it possible to have the dynamic quants in these formats?
Thanks.
We just did it! You can read our blog on Dynamic v2.0: https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-ggufs