孙逢春 , 张承宁 . 装甲车辆混合动力电传动技术 [M ] . 北京 : 国防工业出版社 , 2008 .

SUN F C , ZHANG C N . Technologies for the hybrid electric drive system of armored vehicle [M ] . Beijing : National Defense Industry Press , 2008 . (in Chinese)

侯旭朝 , 马越 , 项昌乐 . 电驱动履带车辆转向稳定性控制研究 [J ] . 机械工程学报 , 2024 , 60 ( 8 ): 233 - 244 .

HOU X Z , MA Y , XIANG C L . Research on steering stability control of electric drive tracked vehicle [J ] . Journal of Mechanical Engineering , 2024 , 60 ( 8 ): 233 - 244 .( (in Chinese)

邹渊 , 焦飞翔 , 崔星 . 等 . 地面无人平台动力源集成技术发展综述 [J ] . 兵工学报 , 2020 , 41 ( 10 ): 2132 - 2140 .

ZOU Y , JIAO F X , CUI X , et al . A review on power source technology of unmanned ground vehicle [J ] . Acta Armamentaril , 2020 , 41 ( 10 ): 2132 - 2140 . (in Chinese)

FARAJ M , BASIR O . Range anxiety reduction in battery-powered vehicles [C ] // Proceedings of the 2016 IEEE Transportation Electrification Conference and Expo.Dearborn,MI,US:IEEE , 2016 : 1 - 6 .

赵秀春 , 郭戈 . 混合动力电动汽车能量管理策略研究综述 [J ] . 自动化学报 , 2016 , 42 ( 3 ): 321 - 334 .

ZHAO X C , GUO G . Survey on energy management strategies for hybrid electric vehicles [J ] . Acta Automatic Sinica , 2016 , 42 ( 3 ): 321 - 334 . (in Chinese)

张卫青 . 混合动力汽车的发展现状及其关键技术 [J ] . 重庆理工大学学报 , 2006 , 20 ( 5 ): 19 - 22 .

ZHANG W Q . Research actuality and key technologies of hybrid electric vehicle [J ] . Journal of Chongqing Institute of Technology , 2006 , 20 ( 5 ): 19 - 22 . (in Chinese)

LEON R , MONTALEZA C , MALDONADO L , et al . Hybrid electric vehicles:a review of existing configurations and thermodynamic cycles [J ] . Thermo , 2021 , 1 ( 2 ): 134 - 150 .

WANG Y , BISWAS A , RODRIGUEZ R , et al . Hybrid electric vehicle specific engines:state-of-the-art review [J ] . Energy Reports , 2022 , 8 : 832 - 851 .

唐小林 , 郎陈佳 , 郑林洋 , 等 . 智能网联混合动力汽车能量管理研究综述 [J ] . 重庆理工大学学报 , 2023 , 37 ( 9 ): 1 - 12 .

TANG X L , LANG C J , ZHENG L Y , et al . Energy management research of intelligent connected hybrid electric vehicle:a review [J ] . Journal of Chongqing Institute of Technology , 2023 , 37 ( 9 ): 1 - 12 . (in Chinese)

PADMARAJAN B , MCGORDON A , JENNINGS P . Blended rule based energy management for PHEV:system structure and strategy [J ] . IEEE Transactions on Vehicular Technology , 2016 , 65 ( 10 ): 8757 - 8762 .

邓富昌 , 张校锋 . 基于规则的混合型燃料电池汽车能量管理策略 [J ] . 青岛大学学报 , 2023 , 38 ( 3 ): 75 - 80 .

DENG F C , ZHANG X F . Rule based energy management system of hybrid vehicle [J ] . Journal of Qingdao University , 2023 , 38 ( 3 ): 75 - 80 . (in Chinese)

TROVAO J , PEREIRINHA P , JORGE H , et al . A multi-level energy management system for multi-source electric vehicles-an integrated rule-based meta-heuristic approach [J ] . Applied Energy , 2013 , 105 : 304 - 318 .

丁阿鑫 , 张晨阳 , 沈英 . 燃料电池汽车改进型状态机能量管理策略研究 [J ] . 机械制造与自动化 , 2021 , 50 ( 2 ): 181 - 204 .

DING A X , ZHANG C Y , SHEN Y . Study on improved state machine energy management strategy for fuel cell vehicles [J ] . Machine Building & Automation , 2021 , 50 ( 2 ): 181 - 204 . (in Chinese)

MORTEZA M , MEHDI M . Development a new power management strategy for power split hybrid electric vehicles [J ] . Transportation Research Part D:Transport and Environment , 2015 , 37 : 79 - 96 .

ZOU Y , SUN F C , HU X S , et al . Combined optimal sizing and control for a hybrid tracked vehicle [J ] . Energies , 2012 , 5 ( 12 ): 4697 - 4710 .

ZHU H J , SONG Z Y , HOU J , et al . Simultaneous identification and control using active signal injection for series hybrid electric vehicles based on dynamic programming [J ] . IEEE Transactions on Transportation Electrification , 2020 , 6 ( 1 ): 298 - 307 .

JIANG H L , XU L F , LI J Q , et al . Energy management and component sizing for a fuel cell/battery/supercapacitor hybrid powertrain based on two-dimensional optimization algorithms [J ] . Energy , 2019 , 177 : 386 - 396 .

ZHANG S , HU X S , XIE S B , et al . Adaptively coordinated optimization of battery aging and energy management in plug-in hybrid electric buses [J ] . Applied Energy , 2019 , 256 : 113891 .

LIU T , ZOU Y , LIU D X , et al . Reinforcement learning of adaptive energy management with transition probability for a hybrid electric tracked vehicle [J ] . IEEE Transactions on Industrial Electronics , 2015 , 62 ( 12 ): 7837 - 7846 .

DU G D , ZOU Y , ZHANG X , et al . Energy management for a hybrid electric vehicle based on prioritized deep reinforcement learning framework [J ] . Energy , 2022 , 241 : 122523 .

CHEN H , GUO G , TANG B B , et al . Data-driven transferred energy management strategy for hybrid electric vehicles via deep reinforcement learning [J ] . Energy Reports , 2023 , 10 : 2680 - 2692 .

SINGH V , CHEN S S , SINGHANIA M , et al . How are reinforcement learning and deep learning algorithms used for big data based decision making in financial industries-a review and research agenda [J ] . International Journal of Information Management Data Insights , 2022 , 2 ( 2 ): 100094 .

AN X F , HE H W , WU J , et al . Energy management based on reinforcement learning with double deep Q-learning for a hybrid electric tracked vehicle [J ] . Applied Energy , 2019 , 254 : 113708 .

CUI H H , RUAN J G , WU C C , et al . Advanced deep deterministic policy gradient based energy management strategy design for dual-motor four-wheel-drive electric vehicle [J ] . Mechanism and Machine Theory , 2023 , 179 : 105119 .

ZHOU J H , XUE S W , XUE Y , et al . A novel energy management strategy of hybrid electric vehicle via an improved TD3 deep reinforcement learning [J ] . Energy , 2021 , 224 : 120118 .

张彬 , 邹渊 , 张旭东 , 等 . 基于TD3-PER的混合动力履带车辆能量管理 [J ] . 汽车工程 , 2022 , 44 ( 9 ): 1400 - 1409 .

ZHANG B , ZOU Y , ZHANG X D , et al . Energy management strategy based on TD3-PER for hybrid electric tracked vehicle [J ] . Automotive Engineering , 2022 , 44 ( 9 ): 1400 - 1409 . (in Chinese)

邹渊 , 张彬 , 张旭东 , 等 . 基于归一化优势函数的强化学习混合动力履带车辆能量管理 [J ] . 兵工学报 , 2021 , 42 ( 10 ): 2159 - 2169 .

ZOU Y , ZHANG B , ZHANG X D , et al . Energy management of hybrid tracked vehicle based on reinforcement learning with normalized advantage function [J ] . Acta Armamentarii , 2021 , 42 ( 10 ): 2159 - 2169 . (in Chinese) DOI: 10.3969/j.issn.1000-1093.2021.10.011 http://doi.org/10.3969/j.issn.1000-1093.2021.10.011 The energy management strategy based on reinforcement learning encounters the problem of “dimension disaster”when dealing with high-dimensional problems because of the discretization of state and control variables. For this problem, a new energy management algorithm based on deep reinforcement learning with normalized advantage function is proposed, where two deep neural networks with normalized advantage function are used to realize the continuous control of energy and eliminate the discretization of state and control variables. Based on the modeling of powertrain of a series hybrid tracked vehicle, the framework of the proposed deep reinforcement learning algorithm was built and the parameter update process was completed for the series hybrid tracked vehicle. The simulated results show that the proposed algorithm can output more refined control quantity and less output fluctuation. Compared with the deep Q-learning algorithm, the proposed algorithm improves the fuel economy of series hybrid tracked vehicle by 3.96%. In addition, the adaptability of the proposed algorithm and the optimized effect in real-time control environment are verified by the hardware-in-the-loop simulation.

SCHAUL T , QUAN J , ANTONOGLOU I , et al . Prioritized experience replay [J ] . International Conference on Learning Representations , 2016 , 1511 : 05952 .