Invalid Prompt Template in LM Studio on MLX

#1
by blbraner - opened

Hello

I am hoping to run this on my Mac Studio M3 Ultra. I have the ram to fit it but I am getting an error for the prompt template in LM Studio.
I had it fixed but things didn't seem to be working right so I deleted the model and redownloaded it hoping it would magically fix itself.

image.png

Any idea where I could get a corrected prompt template?

Thanks

LM Studio Community org

Hello @blbraner !

Can you make sure you're updated to the latest version of the LM Studio App? The 0.3.20 version includes some fixes for chat template issues in this model.

Looking at your screen shot, it looks like you're using an MLX model 4bit model. If updating the app does not fix the issue, go to the downloaded model's source (My Models tab > qwen3-coder-480b > Actions > Reveal in Finder) and confirm that the chat_template.jinja matches this file.

Ah updating fixed it. I wasn't being prompted for an update so didn't even think of it. Thanks

blbraner changed discussion status to closed

Sign up or log in to comment