Self-hosted agents that refuse to phone home
Build AI agents that run entirely on your own hardware and expose an OpenAI-compatible API.

What it does
LocalAGI is a Go-based platform for building AI agents, automations, and chatbots that stay entirely on your hardware. You configure agents through a web UI, and each one automatically exposes an OpenAI-compatible Responses API endpoint. It targets users who want to avoid cloud APIs and run on consumer-grade CPUs or GPUs.
The interesting bit
It does not handle inference itself; instead, it layers agentic orchestration atop LocalAI and embeds LocalRecall for RAG memory and knowledge bases. The standout details are interpreted Go scripts for custom actions—no compilation needed—and built-in connectors that wire agents straight into Discord, Slack, Telegram, GitHub Issues, and IRC.
Key highlights
- Every agent acts as a drop-in replacement for the OpenAI Responses API.
- Built-in knowledge base and semantic search via embedded LocalRecall libraries.
- No-code agent teaming, cron-like periodic tasks, and multimodal support in the web UI.
- Ready-made connectors for Discord, Slack, Telegram, GitHub Issues, and IRC.
- Custom agent actions can be written in Go and interpreted at runtime; skills can be synced from git.
Caveats
- CPU-only mode supports text models only; multimodal and image generation need a discrete GPU (NVIDIA, Intel, or AMD).
- The project is deeply integrated with the LocalAI stack, so this is an orchestration and UI layer rather than a standalone inference engine.
Verdict
Pick this up if you need self-hosted, private agents with chat integrations and prefer a no-code web UI over Python notebooks. Pass if you require cloud-scale elasticity or want to bring your own inference server without LocalAI in the stack.
Frequently asked
- What is mudler/LocalAGI?
- Build AI agents that run entirely on your own hardware and expose an OpenAI-compatible API.
- Is LocalAGI open source?
- Yes — mudler/LocalAGI is open source, released under the MIT license.
- What language is LocalAGI written in?
- mudler/LocalAGI is primarily written in Go.
- How popular is LocalAGI?
- mudler/LocalAGI has 1.9k stars on GitHub.
- Where can I find LocalAGI?
- mudler/LocalAGI is on GitHub at https://github.com/mudler/LocalAGI.