IQ4_XS is optimal 4Bits model for me
#5
by
jweb
- opened
I have 36GB VRAM + 128GB CPU RAM.
I have tested some 4 Bits models.
Finally I select IQ4_XS.
Medium foot print and less hallucination.
Recommended.
Thank you.