whylabs/langkit
An open-source toolkit for extracting metrics and signals from LLM inputs and outputs to enable production monitoring and safety evaluation.
Not currently ranked — collecting fresh signals.
star history
LangKit is an open-source text metrics toolkit for monitoring language models. It extracts signals from input and output text including text quality, relevance, sentiment, toxicity, and security patterns. The toolkit provides out-of-the-box metrics for detecting jailbreaks, prompt injection attacks, hallucinations, and refusals. It integrates with the whylogs data logging library for production observability.
Frequently asked
- What is whylabs/langkit?
- An open-source toolkit for extracting metrics and signals from LLM inputs and outputs to enable production monitoring and safety evaluation.
- Is langkit open source?
- Yes — whylabs/langkit is open source, released under the Apache-2.0 license.
- What language is langkit written in?
- whylabs/langkit is primarily written in Jupyter Notebook.
- How popular is langkit?
- whylabs/langkit has 993 stars on GitHub.
- Where can I find langkit?
- whylabs/langkit is on GitHub at https://github.com/whylabs/langkit.