fine-tuning

#1
by bordy - opened

Can the model be fine-tuned?

bordy changed discussion title from fine-tunin to fine-tuning

Hi @bordy ,

Welcome to Gemma models, yes you can able to do the tuning on top of the available checkpoints of the model. However there are few things needs to be consider to fine-tune the models especially instruction tuned models they follow a certain type of formate required to tune it.

To know more about the google/t5gemma-2b-2b-prefixlm-it before fine-tune please go through the following page. To know about how to fine tune Gemma models please find the following blog and part2 for a similar Gemma model.

Thanks.

Sign up or log in to comment