梁子璇 , 郭栋 , 朱圣英 , 等 . 高超声速目标拦截末段交战窗口快速生成方法 [J ] . 宇航学报 , 2021 , 42 ( 3 ): 333 - 343 .

LIANG Z X , GUO D , ZHU S Y , et al . Rapid generation of terminal engagement window for interception of hypersonic targets [J ] . Journal of Astronautics , 2021 , 42 ( 3 ): 333 - 343 . (in Chinese)

胡冬冬 . 2019年美国高超声速武器防御体系建设动向及发展研究 [J ] . 战术导弹技术 , 2020 ( 1 ): 1 - 8 .

HU D D . Research on the development of hypersonic weapon defense system in the United States in year 2019 [J ] . Tactical Missile Technology , 2020 ( 1 ): 1 - 8 . (in Chinese)

熊瑛 , 吕涛 , 陈祎璠 , 等 . 2021年国外导弹防御发展综述 [J ] . 飞航导弹 , 2021 ( 12 ): 1 - 6 .

XIONG Y , LÜ T , CHEN Y P , et al . Review of foreign missile defense development in 2021 [J ] . Aerodynamic Missile Journal , 2021 ( 12 ): 1 - 6 . (in Chinese)

韩洪伟 , 王鹏坡 . 高超声速武器发展及防御策略研究 [J ] . 飞航导弹 , 2019 ( 12 ): 12 - 15 .

HAN H W , WANG P P . Research on hypersonic weapon development and defense strategy [J ] . Aerodynamic Missile Journal , 2019 ( 12 ): 12 - 15 . (in Chinese)

赵杰 , 王君 , 张大元 , 等 . 反临近空间高超声速飞行器中末交接视角研究 [J ] . 飞行力学 , 2015 , 33 ( 3 ): 253 - 256 .

ZHAO J , WANG J , ZHANG D Y , et al . Visual angle research for midcourse and terminal guidance hand-over of near space hypersonic vehicles [J ] . Flight Dynamics , 2015 , 33 ( 3 ): 253 - 256 . (in Chinese)

张涛 , 李为民 , 李炯 , 等 . 面向中末交接班的临近空间拦截弹弹道优化 [J ] . 宇航学报 , 2021 , 42 ( 3 ): 367 - 377 .

ZHANG T , LI W M , LI J , et al . Trajectory optimization of near-space interceptor with the constraint of midcourse and terminal guidance handover window [J ] . Journal of Astronautics , 2021 , 42 ( 3 ): 367 - 377 . (in Chinese)

赵亮博 , 朱广生 , 张耀 , 等 . 智能飞行器追逃博弈中的关键技术及发展趋势 [J ] . 飞航导弹 , 2021 ( 12 ): 134 - 139 .

ZHAN L B , ZHU G S , ZHANG Y , et al . Key technologies and development trend of intelligent flight vehicle pursuit-evasion games [J ] . Aerodynamic Missile Journal , 2021 ( 12 ): 134 - 139 . (in Chinese)

WEI X Q , YANG J Y . Optimal strategies for multiple unmanned aerial vehicles in a pursuit/evasion differential game [J ] . Journal of Guidance, Control, and Dynamics , 2018 , 41 ( 8 ): 1799 - 1806 . DOI: 10.2514/1.G003480 http://doi.org/10.2514/1.G003480 https://arc.aiaa.org/doi/10.2514/1.G003480 https://arc.aiaa.org/doi/10.2514/1.G003480

QI N M , SUN Q L , ZHAO J . Evasion and pursuit guidance law against defended target [J ] . Chinese Journal of Aeronautics , 2017 , 30 ( 6 ): 1958 - 1973 . DOI: 10.1016/j.cja.2017.06.015 http://doi.org/10.1016/j.cja.2017.06.015 https://linkinghub.elsevier.com/retrieve/pii/S1000936117301541 https://linkinghub.elsevier.com/retrieve/pii/S1000936117301541

ZENG X , YANG L P , ZHU Y W , et al . Comparison of two optimal guidance methods for the long-distance orbital pursuit-evasion game [J ] . IEEE Transactions on Aerospace and Electronic Systems , 2021 , 57 ( 1 ): 521 - 539 . DOI: 10.1109/TAES.7 http://doi.org/10.1109/TAES.7 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=7 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=7

YAN T , CAI Y L , XU B . Evasion guidance algorithms for air-breathing hypersonic vehicles in three-player pursuit-evasion games [J ] . Chinese Journal of Aeronautics , 2020 , 33 ( 12 ): 3423 - 3436 . DOI: 10.1016/j.cja.2020.03.026 http://doi.org/10.1016/j.cja.2020.03.026 https://linkinghub.elsevier.com/retrieve/pii/S1000936120302107 https://linkinghub.elsevier.com/retrieve/pii/S1000936120302107

王鑫 , 闫杰 , 孟廷伟 . 高速目标分阶段博弈拦截制导策略研究 [J ] . 航空学报 , 2022 , 43 ( 9 ): 325598 . DOI: 10.7527/S1000-6893.2021.25598 http://doi.org/10.7527/S1000-6893.2021.25598 基于分阶段博弈模型对吸气式高超声速飞行器的拦截问题进行了研究, 提出了由两枚拦截弹组成的拦截系统的分阶段拦截方案。依据高超声速目标的机动特征将拦截过程分为两个阶段。在第1个阶段, 拦截系统依据目标运动特征及约束条件计算得到目标在预测交汇平面的可达范围和虚拟拦截点。拦截弹Ⅰ执行基于虚拟交班点的中制导以及基于广义末制导律的末制导过程。由于目标运动状态受到约束条件的限制, 使得目标在突防过程中可行范围和机动能力大幅减弱。在第2个阶段, 基于博弈理论和直觉模糊理论建立拦截弹Ⅱ-目标直觉模糊博弈模型。通过设计拦截弹-目标策略集以及多属性评估模型获得满足要求的均衡策略模型, 通过求解非线性规划问题最终使得我方拦截最终博弈获胜。通过拦截弹动态策略和固定策略的仿真对比说明所提博弈制导策略的有效性。

WANG X , YAN J , MENG T W . Research on high-speed target multi-stage interception scheme based on game theory [J ] . Acta Aeronautica et Astronautica Sinica , 2022 , 43 ( 9 ): 325598 . (in Chinese) DOI: 10.7527/S1000-6893.2021.25598 http://doi.org/10.7527/S1000-6893.2021.25598 Interception of the air-breathing hypersonic vehicle is studied based on the staged game model in this paper. The solution based on the interception system made of two interceptors are proposed. According to the maneuvering characteristics of the hypersonic target, the process of interception is divided into two stages. In the first stage, the interception system calculates the target's reachable range and virtual interception point in the predicted intersection plane according to the target's motion characteristics and constraint conditions. Interceptor Ⅰ executes mid-guidance based on the virtual handover point, and terminal guidance based on the generalized terminal guidance law. Because the movement of the target is restricted by the constraints, the feasible range and maneuvering ability of the target are greatly weakened in the penetration process. In the second stage of the interception process, the Interceptor Ⅱ-target intuitionistic fuzzy game model is established based on the game theory and the intuitionistic fuzzy theory. The equilibrium strategy model is obtained through interceptor-target strategy sets and the multi-attribute evaluation model. Our side wins the game by solving the nonlinear programming problem. Finally, the numerical results of the dynamic strategy and the fixed strategy are compared to show the effectiveness of the proposed guidance strategy.

刘双喜 , 王一冲 , 朱梦杰 , 等 . 小弹目速度比下拦截高超声速飞行器微分对策制导律研究 [J ] . 空天防御 , 2022 , 5 ( 2 ): 49 - 57 .

LIU S X , WANG Y C , ZHU M J , et al . Research on differential game guidance law for intercepting hypersonic vehicles with small missile-to-target speed ratio [J ] . Air and Space Defense , 2022 , 5 ( 2 ): 49 - 57 . (in Chinese)

ISAACS R . Differential games: a mathematical theory with applications to warfare and pursuit, control, and optimization [M ] . New York, NY, US : John Wiley , 1965 .

FRIEDMAN A . Differential games [M ] . New York, NY, US : John Wiley , 1971 .

王雨琪 , 宁国栋 , 王晓峰 , 等 . 基于微分对策的临近空间飞行器机动突防策略 [J ] . 航空学报 , 2020 , 41 ( 增刊2 ): 724276 .

WANG Y Q , NING G D , WANG X F , et al . Maneuver penetration strategy of near space vehicle based on differential game [J ] . Acta Aeronautica et Astronautica Sinica , 2020 , 41 ( S2 ): 724276 . (in Chinese) DOI: 10.7527/S1000-6893.2020.24276 http://doi.org/10.7527/S1000-6893.2020.24276 Aiming at the maneuvering penetration problem of near space vehicles, we design and analyze the maneuvering penetration strategy of the vehicles during midcourse guidance based on the differential game theory. First, the attack-defense confrontation problem is transformed into a two-person zero-sum game problem, and a quadratic objective function is designed. Secondly, considering the problem of insufficient computing power of the vehicle, we take reasonable assumptions to obtain the analytical solution of the game problem for convenient practical applications. Finally, the maneuvering penetration strategy based on the differential game theory is simulated and verified. The results show that compared with the sinusoidal maneuver during the midcourse guidance, this strategy not only reduces 54.3% of energy consumption by the vehicle, but increases 58.6% of the energy consumption by the interceptor, therefore significantly raising the penetration ability of the vehicle during terminal guidance.

鲜勇 , 田海鹏 , 王剑 , 等 . 基于微分对策的导弹智能机动突防研究 [J ] . 飞行力学 , 2014 , 32 ( 1 ): 70 - 73 .

XIAN Y , TIAN H P , WANG J , et al . Research on intelligent maneuver penetration of missile based on differential game theory [J ] . Flight Dynamics , 2014 , 32 ( 1 ): 70 - 73 . (in Chinese)

YE Q , LIU C S . A differential game based guidance law for an accelerating exoatmospheric missile [J ] . Asian Journal of Control , 2017 , 19 ( 3 ): 1205 - 1216 . DOI: 10.1002/asjc.1430 http://doi.org/10.1002/asjc.1430 https://onlinelibrary.wiley.com/doi/10.1002/asjc.1430 https://onlinelibrary.wiley.com/doi/10.1002/asjc.1430

常晓飞 , 孙博 , 闫杰 , 等 . 针对高速机动目标的三维非线性微分对策制导律 [J ] . 弹道学报 , 2018 , 30 ( 3 ): 1 - 6 . DOI: 10.12115/j.issn.1004-499X(2018)03-001 http://doi.org/10.12115/j.issn.1004-499X(2018)03-001 为有效拦截高超声速飞行器,提出了一种基于预测控制的三维微分对策制导律。该制导律将高速机动目标拦截末制导过程抽象为以视线角速率和燃料消耗为性能指标的零和微分对策问题,以非线性模型预测控制为框架,采用梯度下降法实时求解决策约束型有限时域微分对策,得到最优决策。该制导律能够在满足动态系统高维非线性、机动能力和燃料消耗等要求下,实现对目标的精确拦截; 在与比例导引律燃料消耗相当的情况下,具有末端弹道平直、制导精度高等优点。

CHANG X F , SUN B , YAN J , et al . 3-dimensional nonlinear differential game-based guidance law against high-speed maneuvering target [J ] . Journal of Ballistics , 2018 , 30 ( 3 ): 1 - 6 . (in Chinese)

孙景亮 , 刘春生 . 基于自适应动态规划的导弹制导律研究综述 [J ] . 自动化学报 , 2017 , 43 ( 7 ): 1101 - 1113 .

SUN J L , LIU C S . An overview on the adaptive dynamic programming based missile guidance law [J ] . Acta Automatica Sinica , 2017 , 43 ( 7 ): 1101 - 1113 . (in Chinese)

刘念 , 刘春生 , 孙景亮 . 自适应动态规划算法在飞行器追逃中的应用 [J ] . 飞行力学 , 2016 , 34 ( 6 ): 45 - 48 .

LIU N , LIU C S , SUN J L . Application of adaptive dynamic programming algorithm in the pursuit-evasion of aircraft [J ] . Flight Dynamics , 2016 , 34 ( 6 ): 45 - 48 . (in Chinese)

SUN J L , LIU C S , YE Q . Robust differential game guidance laws design for uncertain interceptor-target engagement via adaptive dynamic programming [J ] . International Journal of Control , 2017 , 90 ( 5 ): 990 - 1004 . DOI: 10.1080/00207179.2016.1192687 http://doi.org/10.1080/00207179.2016.1192687 https://www.tandfonline.com/doi/full/10.1080/00207179.2016.1192687 https://www.tandfonline.com/doi/full/10.1080/00207179.2016.1192687

SUN J L , LIU C S . Finite-horizon differential games for missile-target interception system using adaptive dynamic programming with input constraints [J ] . International Journal of Systems Science , 2018 , 49 ( 2 ): 264 - 283 . DOI: 10.1080/00207721.2017.1401153 http://doi.org/10.1080/00207721.2017.1401153 https://www.tandfonline.com/doi/full/10.1080/00207721.2017.1401153 https://www.tandfonline.com/doi/full/10.1080/00207721.2017.1401153

孙磊 , 付斌 , 万士正 , 等 . 基于自适应动态规划的反高超武器微分对策制导律 [J ] . 航空工程进展 , 2020 , 11 ( 6 ): 796 - 802 .

SUN L , FU B , WAN S Z , et al . Differential game guidance law based on adaptive dynamic programming for the interception of hypersonic targets [J ] . Advances in Aeronautical Science and Engineering , 2020 , 11 ( 6 ): 796 - 802 . (in Chinese)

雍恩米 . 高超声速滑翔式再入飞行器轨迹优化与制导方法研究 [D ] . 长沙 : 国防科学技术大学 , 2008 : 45 .

YONG E M . Study on trajectory optimization and guidance approach for hypersonic glide-reentry vehicle [D ] . Changsha : National University of Defense Technology , 2008 : 45 . (in Chinese)

BARDHAN R , GHOSE D . Nonlinear differential games- based impact-angle-constrained guidance law [J ] . Journal of Guidance, Control, and Dynamics , 2015 , 38 ( 3 ): 384 - 402 . DOI: 10.2514/1.G000940 http://doi.org/10.2514/1.G000940 https://arc.aiaa.org/doi/10.2514/1.G000940 https://arc.aiaa.org/doi/10.2514/1.G000940

LUO W C , LIANG M M , LIU D R , et al . Event-triggered control for zero-sum games based on critic-identifier architecture with particle swarm optimization [C ] // Proceedings of the 11th International Conference on Intelligent Control and Information Processing . Dali, China : IEEE , 2021 : 171 - 176 .

LIU D R , YANG X , WANG D , et al . Reinforcement-learning-based robust controller design for continuous-time uncertain nonlinear systems subject to input constraints [J ] . IEEE Transactions on Cybernetics , 2015 , 45 ( 7 ): 1372 - 1385 . DOI: 10.1109/TCYB.2015.2417170 http://doi.org/10.1109/TCYB.2015.2417170 The design of stabilizing controller for uncertain nonlinear systems with control constraints is a challenging problem. The constrained-input coupled with the inability to identify accurately the uncertainties motivates the design of stabilizing controller based on reinforcement-learning (RL) methods. In this paper, a novel RL-based robust adaptive control algorithm is developed for a class of continuous-time uncertain nonlinear systems subject to input constraints. The robust control problem is converted to the constrained optimal control problem with appropriately selecting value functions for the nominal system. Distinct from typical action-critic dual networks employed in RL, only one critic neural network (NN) is constructed to derive the approximate optimal control. Meanwhile, unlike initial stabilizing control often indispensable in RL, there is no special requirement imposed on the initial control. By utilizing Lyapunov's direct method, the closed-loop optimal control system and the estimated weights of the critic NN are proved to be uniformly ultimately bounded. In addition, the derived approximate optimal control is verified to guarantee the uncertain nonlinear system to be stable in the sense of uniform ultimate boundedness. Two simulation examples are provided to illustrate the effectiveness and applicability of the present approach.

ABU-KHALAF M , LEWIS F L . Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach [J ] . Automatica , 2005 , 41 ( 5 ): 779 - 791 . DOI: 10.1016/j.automatica.2004.11.034 http://doi.org/10.1016/j.automatica.2004.11.034 https://linkinghub.elsevier.com/retrieve/pii/S0005109805000105 https://linkinghub.elsevier.com/retrieve/pii/S0005109805000105

LYSHEVSKI S E . Optimal control of nonlinear continuous-time systems: design of bounded controllers via generalized nonquadratic functionals [C ] // Proceedings of the 1998 American Control Conference . Philadelphia, PA, US : IEEE , 1998 , 1 : 205 - 209 .

VAMVOUDAKIS K G , LEWIS F L . Online solution of nonlinear two-player zero-sum games using synchronous policy iteration [J ] . International Journal of Robust and Nonlinear Control , 2012 , 22 ( 13 ): 1460 - 1483 . DOI: 10.1002/rnc.1760 http://doi.org/10.1002/rnc.1760 https://onlinelibrary.wiley.com/doi/10.1002/rnc.1760 https://onlinelibrary.wiley.com/doi/10.1002/rnc.1760

MA Y , CAI Y L . A fuzzy model predictive control based upon adaptive neural network disturbance observer for a constrained hypersonic vehicle [J ] . IEEE Access , 2018 , 6 : 5927 - 5938 . DOI: 10.1109/Access.6287639 http://doi.org/10.1109/Access.6287639 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6287639 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6287639

GUO J , WU X Z , TANG S J . Autonomous gliding entry guidance with geographic constraints [J ] . Chinese Journal of Aeronautics , 2015 , 28 ( 5 ): 1343 - 1354 . DOI: 10.1016/j.cja.2015.07.009 http://doi.org/10.1016/j.cja.2015.07.009 https://linkinghub.elsevier.com/retrieve/pii/S1000936115001685 https://linkinghub.elsevier.com/retrieve/pii/S1000936115001685

WANG X , GUO J , TANG S J , et al . Entry trajectory planning with terminal full states constraints and multiple geographic constraints [J ] . Aerospace Science and Technology , 2019 , 84 : 620 - 631 . DOI: 10.1016/j.ast.2018.10.035 http://doi.org/10.1016/j.ast.2018.10.035 https://linkinghub.elsevier.com/retrieve/pii/S1270963818300506 https://linkinghub.elsevier.com/retrieve/pii/S1270963818300506

XUE S B , LU P . Constrained predictor-corrector entry guidance [J ] . Journal of Guidance, Control, and Dynamics , 2010 , 33 ( 4 ): 1273 - 1281 . DOI: 10.2514/1.49557 http://doi.org/10.2514/1.49557 https://arc.aiaa.org/doi/10.2514/1.49557 https://arc.aiaa.org/doi/10.2514/1.49557

PHILLIPS T H . A common aero vehicle (CAV) model, description, and employment guide [R ] . New York, NY , US : Schafer Corporation of AFRL and AFSPC , 2003 .