← all repositories

a16z-infra/llama2-chatbot

A Streamlit-based chatbot application providing a web interface for interacting with LLaMA2 models via Replicate API.

1.4k stars Python Chat AssistantsLanguage Models
llama2-chatbot
Velocity · 7d
+1.3
★ / day
Trend
steady
star history

This repository hosts a chatbot application built with Streamlit that allows users to chat with LLaMA2 models. The app supports selecting between different model sizes (7B, 13B, 70B) hosted on Replicate, maintains per-session chat history, and provides sidebar controls for tuning hyperparameters such as temperature, top-p, and max sequence length. It includes Auth0 authentication integration and Docker deployment support for Fly.io.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.