open-compass/LawBench
A benchmark suite for evaluating the legal knowledge and reasoning capabilities of large language models.
Not currently ranked — collecting fresh signals.
star history
LawBench is an evaluation framework that benchmarks LLMs across 20 legal tasks based on China’s judicial system. It tests multiple dimensions of legal cognition including entity recognition, reading comprehension, crime calculation, and legal consultation. The benchmark addresses the gap in understanding how well LLMs perform in high-specialization, safety-critical legal applications.
Frequently asked
- What is open-compass/LawBench?
- A benchmark suite for evaluating the legal knowledge and reasoning capabilities of large language models.
- Is LawBench open source?
- Yes — open-compass/LawBench is open source, released under the Apache-2.0 license.
- What language is LawBench written in?
- open-compass/LawBench is primarily written in Python.
- How popular is LawBench?
- open-compass/LawBench has 436 stars on GitHub.
- Where can I find LawBench?
- open-compass/LawBench is on GitHub at https://github.com/open-compass/LawBench.