josStorer/RWKV-Runner
A lightweight tool that automates RWKV language model deployment with OpenAI API compatibility.

Velocity · 7d
+5.7
★ / day
Trend
→steady
star history
RWKV-Runner is a compact executable that automates the setup and launching of the RWKV large language model. It provides an interface compatible with the OpenAI API, allowing any ChatGPT-compatible client to function as an RWKV client. The project aims to reduce barriers to running LLMs locally or on servers through streamlined deployment automation.