GymFC is a modular framework for tuning flight control systems using reinforcement learning. It synthesizes neural network-based attitude controllers that exceed traditional PID controller performance. The project integrates with Gazebo simulator and OpenAI Gym environments for training RL agents that control quadcopters, and powers the Neuroflight neural network flight control firmware.