VLMEvalKit is a Python evaluation framework for large vision-language models that streamlines model benchmarking without manual data preparation. It supports 220+ LMMs and 80+ benchmarks, providing both exact matching and LLM-based answer extraction for evaluation results. The toolkit implements generation-based evaluation for all supported vision-language models.