<p dir="ltr">Methodologies for optimizing UAVs' control for varied environmental conditions have become crucial in the recent development for UAV control sector, yet they are lacking. This research focuses on the dynamism of the Gazebo simulator and PX4 Autopilot flight controller, frequently referenced in academic sectors for their versatility in generating close-to-reality digital environments. This thesis proposed an integrated simulation system that ensures realistic wind and gust interactions in the digital world and efficient data extraction by employing an industrial standard control communication protocol called MAVLink with the also the industry standard ground control software QGroundControl, using real and historical weather information from NOAA database. This study also looks into the potential of reinforcement learning, namely the DDPG algorithm, in determining optimal UAV safety distance, trajectory prediction, and mission planning under wind disruption. The overall goal is to enhance UAV stability and safety in various wind-disturbed conditions. Mainly focusing on minimizing potential collision risks in areas such as streets, valleys, tunnels, or really anywhere has winds and obstacles. The ROS network further enhanced these components, streamlining UAV response analysis in simulated conditions. This research presents a machine-learning approach to UAV flight safety and efficiency in dynamic environments by synthesizing an integrated simulation system with reinforcement learning. And the results model has a high accuracy, reaching 91%, 92%, and 97% accuracy on average in prediction of maximum shifting displacement, and left/right shifting displacement, when testing with real wind parameters from KLAF airport. </p>