ajndkr/lanarky
A Python web framework for deploying and serving LLM-powered microservices.

Velocity · 7d
+0.9
★ / day
Trend
→steady
star history
Lanarky is a Python web framework built on FastAPI specifically for developers constructing LLM microservices. It provides an LLM-first approach that is unopinionated about LLM tooling vendors, offering zero lock-in for integrating various LLM frameworks and cloud providers. While now in maintenance mode, the project targeted the llmops space by simplifying the deployment of language model applications as scalable services.