Quantize to 4 bits with bitsandbytesconfig

#7
by Day1Kim - opened

Would it be okay to quantize to 4 bits with bitsandbytesconfig?

Sign up or log in to comment