a16z-infra/llama2-chatbot
A Streamlit-based chatbot application providing a web interface for interacting with LLaMA2 models via Replicate API.

Velocity · 7d
+1.3
★ / day
Trend
→steady
star history
This repository hosts a chatbot application built with Streamlit that allows users to chat with LLaMA2 models. The app supports selecting between different model sizes (7B, 13B, 70B) hosted on Replicate, maintains per-session chat history, and provides sidebar controls for tuning hyperparameters such as temperature, top-p, and max sequence length. It includes Auth0 authentication integration and Docker deployment support for Fly.io.