With the development of science and technology, the detection distance of airborne radar and the range of air-to-air missiles have been increased to hundreds of kilometers. Maneuver decision-making means that the aircraft chooses the appropriate maneuver (e.g., normal overload, tangential overload, and roll angle) to change its state according to the acquired information of the target (e.g., azimuth, velocity, height, and distance), so as to defeat the target.Īir combat can be divided into within-visual-range air combat and beyond-visual-range air combat. Therefore, it is urgent to build maneuver decision-making methods. The simulation results of the fixed initial state and random initial state show that the proposed method is efficient and can meet the real-time requirement.Īutonomous air combat through unmanned combat aerial vehicles is the future of air combat and maneuver decision-making is the core of autonomous air combat. Simulations are conducted to verify the effectiveness of the proposed method, and the kinematic model of the missile is used in simulations instead of the missile engagement zone to test whether the maneuver decision-making method is effective or not. Then, repeat the above process to gradually improve the maneuver decision-making ability. These samples are used to train the neural network, and the neural network with a greater winning rate is selected by simulations. It starts from random behaviors and generates samples consisting of states, actions, and results of air combat through self-play without using human knowledge. To this end, Monte Carlo tree search in continuous action space is proposed and neural networks-guided Monte Carlo tree search with self-play is utilized to improve the ability of air combat agents. Therefore, a maneuver decision-making method based on deep reinforcement learning and Monte Carlo tree search is proposed to investigate whether it is feasible for maneuver decision-making without human knowledge or advantage function.

Aeronautics Engineering College, Air Force Engineering University, Xi'an, ChinaĪutonomous maneuver decision-making methods for air combat often rely on human knowledge, such as advantage functions, objective functions, or dense rewards in reinforcement learning, which limits the decision-making ability of unmanned combat aerial vehicle to the scope of human experience and result in slow progress in maneuver decision-making.

Continued abuse of our services will cause your IP address to be blocked indefinitely.Hongpeng Zhang * Huan Zhou Yujie Wei Changqiang Huang Please fill out the CAPTCHA below and then click the button to indicate that you agree to these terms. If you wish to be unblocked, you must agree that you will take immediate steps to rectify this issue. If you do not understand what is causing this behavior, please contact us here. If you promise to stop (by clicking the Agree button below), we'll unblock your connection for now, but we will immediately re-block it if we detect additional bad behavior.

Overusing our search engine with a very large number of searches in a very short amount of time.

Using a badly configured (or badly written) browser add-on for blocking content.

Running a 'scraper' or 'downloader' program that either does not identify itself or uses fake headers to elude detection.

Using a script or add-on that scans GameFAQs for box and screen images (such as an emulator front-end), while overloading our search engine.

There is no official GameFAQs app, and we do not support nor have any contact with the makers of these unofficial apps. Continued use of these apps may cause your IP to be blocked indefinitely.

This triggers our anti-spambot measures, which are designed to stop automated systems from flooding the site with traffic. Some unofficial phone apps appear to be using GameFAQs as a back-end, but they do not behave like a real web browser does.

Using GameFAQs regularly with these browsers can cause temporary and even permanent IP blocks due to these additional requests. If you are using the Brave browser, or have installed the Ghostery add-on, these programs send extra traffic to our servers for every page on the site that you browse, then send that data back to a third party, essentially spying on your browsing habits.We strongly recommend you stop using this browser until this problem is corrected. The latest version of the Opera browser sends multiple invalid requests to our servers for every page you visit.The most common causes of this issue are: Your IP address has been temporarily blocked due to a large number of HTTP requests.

Combat air maneuvers