anarchy-ai/LLM-VM
An open-source AGI server providing backend infrastructure for running open-source LLMs with tool usage, stateful memory, and fine-tuning capabilities.

LLM-VM is a backend server framework designed to give LLMs advanced capabilities including tool usage, persistent stateful memory, and live data augmentation. It supports running models locally or via API, offers a web playground and API endpoints, and provides student-teacher distillation for model optimization. The system acts as middleware between users and LLMs, enabling agent-like behavior through function calling and memory management.
Frequently asked
- What is anarchy-ai/LLM-VM?
- An open-source AGI server providing backend infrastructure for running open-source LLMs with tool usage, stateful memory, and fine-tuning capabilities.
- Is LLM-VM open source?
- Yes — anarchy-ai/LLM-VM is open source, released under the MIT license.
- What language is LLM-VM written in?
- anarchy-ai/LLM-VM is primarily written in Python.
- How popular is LLM-VM?
- anarchy-ai/LLM-VM has 491 stars on GitHub.
- Where can I find LLM-VM?
- anarchy-ai/LLM-VM is on GitHub at https://github.com/anarchy-ai/LLM-VM.