hegelai/prompttools
Open-source Python library for experimenting with, testing, and evaluating prompts, LLMs, and vector databases via code, notebooks, and a local playground.
Not currently ranked — collecting fresh signals.
star history
The repository provides developer tooling for running prompt experiments across multiple LLM providers and vector databases. It exposes Python APIs like OpenAIChatExperiment that let developers programmatically test prompts against different models, compare outputs, and evaluate retrieval accuracy. The tool supports major providers including OpenAI, Anthropic, and LLaMA, and integrates with vector databases such as Chroma, Weaviate, and LanceDB for semantic search evaluation.
Frequently asked
- What is hegelai/prompttools?
- Open-source Python library for experimenting with, testing, and evaluating prompts, LLMs, and vector databases via code, notebooks, and a local playground.
- Is prompttools open source?
- Yes — hegelai/prompttools is open source, released under the Apache-2.0 license.
- What language is prompttools written in?
- hegelai/prompttools is primarily written in Python.
- How popular is prompttools?
- hegelai/prompttools has 3k stars on GitHub.
- Where can I find prompttools?
- hegelai/prompttools is on GitHub at https://github.com/hegelai/prompttools.