LLaVA-Plus extends large multimodal models with the ability to use tools across different modalities. It enables vision-language assistants to plug into external models, APIs, and skills to complete complex tasks. The codebase supports training, evaluation, and deployment of these tool-augmented multimodal agents, with support for various vision tasks via integrated external tools.