← all repositories

ray-project/llm-numbers

A reference guide of numbers and benchmarks useful for LLM developers to make back-of-the-envelope calculations.

llm-numbers
Velocity · 7d
+3.9
★ / day
Trend
steady
star history

This repository aggregates key numbers and metrics that LLM developers should know for estimation and optimization. It covers token-to-word ratios, cost savings from prompt engineering techniques like appending “Be Concise,” and API pricing data. The resource is maintained by Anyscale and originated from an internal reference document similar to Jeff Dean’s classic performance numbers guide.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.