← all repositories

ykhli/local-ai-stack

A local-only document Q&A starter kit using Ollama for inference, pgvector for embeddings, and Langchain.js for LLM orchestration.

1.4k stars TypeScript RAG · SearchLLMOps · Eval
local-ai-stack
Velocity · 7d
+1.5
★ / day
Trend
steady
star history

This repository provides a complete starter kit for building document question-and-answer applications that run entirely locally at no cost. It combines Ollama for local LLM inference, Supabase pgvector for vector storage and similarity search, and Langchain.js for orchestrating LLM interactions. Embeddings are generated using Transformers.js with the all-MiniLM-L6-v2 model, and the frontend is built with Next.js. The system indexes documents locally and retrieves relevant context to power conversational AI responses.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.