iMatrix?
#1
by
rkh661
- opened
Hi Dan and fan of your work and thanks for all you do for the community sincerely! Anyways I am getting a jinja error with Bartowski's quant and was gonna try yours, but do you not use an iMatrix it seems and if so why and if you had a 4080 like we what is the best quant to use of quality trumps speed? Thanks again man!
@rkh661 We just uploaded imatrix Dynamic v2.0 quants! Hope you like it! https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-ggufs