chain-ml/council
An open-source Python platform for building AI agent applications using multiple LLM providers with built-in monitoring and quality control.

Council provides a unified interface for working with different LLM providers, allowing developers to switch between OpenAI, Anthropic, Google Gemini, and local models via Ollama while maintaining consistent APIs. The platform includes built-in usage monitoring, consumption tracking, error handling and retry mechanisms, and flexible configuration management for LLM parameters like temperature and max tokens. It aims to provide enterprise-grade quality control for production LLM applications.