AnswerDotAI/llms-txt
A specification for a standardized `/llms.txt` file that provides concise, LLM-friendly markdown content to help language models use websites effectively.

This project proposes a /llms.txt markdown file that websites can provide to give LLMs quick access to relevant information at inference time. It addresses the context window limitation problem where most websites are too large to fit in a model’s context. The format is human and machine readable, designed for classical parsing techniques. The project also proposes providing .md versions of HTML pages at the same URL path for clean content access.