Cicero is an autonomous agent that negotiates and coordinates with other players in the strategy game Diplomacy through open-domain natural language. It combines large language models for dialogue generation with strategic reasoning components for game planning. The system uses RL training and leverages the ParlAI framework for language model fine-tuning and generation.