← all repositories

josStorer/selfhostedAI

A downloadable package bundle for running various open-source LLMs and Stable Diffusion locally with OpenAI-compatible APIs.

selfhostedAI
Velocity · 7d
+0.4
★ / day
Trend
steady
star history

This project packages open-source AI models including ChatGLM-6B Int4, Llama, RWKV, and Stable Diffusion into one-click executable bundles for local deployment. It provides OpenAI-compatible API interfaces, allowing integration with existing applications that support OpenAI’s API format. Users can download pre-packaged releases or host models via Hugging Face Spaces, with support for exposing APIs to the internet via ngrok.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.