This repository aggregates resources for LLM evaluation including benchmark datasets across domains like RAG, agents, coding, and multimodal capabilities. It organizes tools for inference-speed and quantization testing, leaderboards for model comparison, and academic papers on evaluation methodologies. The project serves as the official companion to a survey paper on value-oriented LLM evaluation roadmaps.