ray-project/llm-numbers
A reference guide of numbers and benchmarks useful for LLM developers to make back-of-the-envelope calculations.

Velocity · 7d
+3.9
★ / day
Trend
→steady
star history
This repository aggregates key numbers and metrics that LLM developers should know for estimation and optimization. It covers token-to-word ratios, cost savings from prompt engineering techniques like appending “Be Concise,” and API pricing data. The resource is maintained by Anyscale and originated from an internal reference document similar to Jeff Dean’s classic performance numbers guide.