This paper describes a flight control design method for agile aerospace vehicle applications subject to rate saturation constraints. The model includes linear airframe dynamics and a second order nonlinear actuator. A baseline controller is synthesized utilizing the signal-based closed-loop shaping design method to obtain good performance and robustness metrics in the linear domain. Design of an Anti-Windup augmentation based on the rate saturation signal is then carried out to address the performance degradation of a constrained system. Three distinct Anti-Windup schemes are analyzed, ranging from classical to modern frameworks. A comparative analysis of the proposed compensators is provided by evaluating the L2 gain and simulating a flight scenario under a nonlinear actuator with multiple saturations. All analyzed Anti-Windup schemes reduce the upper bound on the L2 gain of the system and show a significant improvement in disturbance rejection response.