← all repositories

josStorer/RWKV-Runner

A lightweight tool that automates RWKV language model deployment with OpenAI API compatibility.

6.4k stars TypeScript Inference · ServingLLMOps · Eval
RWKV-Runner
Velocity · 7d
+5.7
★ / day
Trend
steady
star history

RWKV-Runner is a compact executable that automates the setup and launching of the RWKV large language model. It provides an interface compatible with the OpenAI API, allowing any ChatGPT-compatible client to function as an RWKV client. The project aims to reduce barriers to running LLMs locally or on servers through streamlined deployment automation.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.