bricks-cloud/BricksLLM
Cloud-native API gateway for managing, monitoring, and securing LLM API access in production environments.

BricksLLM is an enterprise-grade API gateway written in Go that sits in front of LLM providers to provide fine-grained access control, rate limiting, and cost management per API key or user. It supports OpenAI, Anthropic, Azure OpenAI, and vLLM backends, offering features including PII detection and masking, request caching, failovers and retries, and comprehensive usage analytics. The system enables organizations to distribute API keys with configurable rate and cost limits while tracking usage across users, applications, and environments.