UnifiedSKG presents a multi-task learning framework that reformulates heterogeneous structured knowledge grounding tasks into a unified text-to-text format. It demonstrates that large language models (T5) with simple modifications achieve state-of-the-art performance across 21 diverse NLP tasks involving databases and knowledge bases. The project provides code, trained checkpoints on HuggingFace, and facilitates systematic research on knowledge-grounded language understanding.