airockchip/rknn-llm
A software stack for converting and running large language models on Rockchip NPUs.
Not currently ranked — collecting fresh signals.
star history
RKLLM provides tools to convert and quantize trained AI models into RKLLM format on a PC, then deploy and run them on Rockchip development boards using a C/C++ runtime API. It supports a wide range of LLMs including Qwen, Llama, ChatGLM, Phi, Gemma, InternLM, and vision-language models, targeting Rockchip SoCs like RK3588, RK3576, RK3562, and RV1126.
Frequently asked
- What is airockchip/rknn-llm?
- A software stack for converting and running large language models on Rockchip NPUs.
- Is rknn-llm open source?
- Yes — airockchip/rknn-llm is an open-source project tracked on heatdrop.
- What language is rknn-llm written in?
- airockchip/rknn-llm is primarily written in Python.
- How popular is rknn-llm?
- airockchip/rknn-llm has 1.6k stars on GitHub.
- Where can I find rknn-llm?
- airockchip/rknn-llm is on GitHub at https://github.com/airockchip/rknn-llm.