Microsoft's Phi-2 for RK3588
This is a conversion from https://huggingface.co/microsoft/phi-2 to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
Current update as of commit 834565c due to incompatibilities from RKLLM library.
Latest update: April 2024. Converted with RKLLM runtime 1.0.0.
Main repo
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
License
Same as the original LLM, in this case MIT:
- Downloads last month
- -
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support