Does it run only on CUDA enabled device?
#3
by
catbit1
- opened
I run it on Mac and it raises the following error:
raise AssertionError("Torch not compiled with CUDA enabled")
AssertionError: Torch not compiled with CUDA enabled
The model supports using CPU inference, and the device parameter needs to be modified to "cpu":predictor = KronosPredictor(model, tokenizer, device="cpu", max_context=512)
The model supports using CPU inference, and the device parameter needs to be modified to "cpu":
predictor = KronosPredictor(model, tokenizer, device="cpu", max_context=512)
Thanks a lot!