Unexpected error: recompile_limit reached with one_graph=True.
While I run inference gemma 3n, I got the following error. How to resolve this error?
Unexpected error: recompile_limit reached with one_graph=True. Excessive recompilations can degrade performance due to the compilation overhead of each recompilation. To monitor recompilations, enable TORCH_LOGS=recompiles. If recompilations are expected, consider increasing torch._dynamo.config.cache_size_limit to an appropriate value.
Hi @kkjh0723 ,
Apologies for the late reply, I can able to run the 3n models in my local without any issue at inference stage. The above issue seems to be due to the older versions of libraries or libraries version compatibilities issues. Could you please try again after upgrading the libraries to latest version. To know more please find the attached gist file. Thanks for your patience and interest in Gemma models.
Thanks.