This paper deals with a robust formation control methodology for the Multi-UAV system with uncertain exogenous disturbance. The fourth-order UAV model with disturbance and the disturbance estimate system is introduced. In order to achieve the rigid formation fight, graph theory and consensus algorithm are utilized and the state of the UAVs converges to desired value by using Leader-Follower structure. The proposed control law includes the Robust Integral of the Sign of error (RISE) for estimation of the disturbance and also involves collision avoidance property based on potential method. The stability and convergent properties are proven based on Lyapunov theory. Finally, several simulation results show the effectiveness of the proposed method compared with a conventional sliding mode control.