josStorer/selfhostedAI
A downloadable package bundle for running various open-source LLMs and Stable Diffusion locally with OpenAI-compatible APIs.

Velocity · 7d
+0.4
★ / day
Trend
→steady
star history
This project packages open-source AI models including ChatGLM-6B Int4, Llama, RWKV, and Stable Diffusion into one-click executable bundles for local deployment. It provides OpenAI-compatible API interfaces, allowing integration with existing applications that support OpenAI’s API format. Users can download pre-packaged releases or host models via Hugging Face Spaces, with support for exposing APIs to the internet via ngrok.