Mission Planning of Passive Networked Sensors for Cooperative Anti-stealth Detection Based on POMDP

doi:10.3969/j.issn.1000-1093.2015.04.023

Abstract

Abstract: A cooperative strategy for multiple passive networked sensors to satisfy the requirements of anti-stealth is proposed. A POMDP model for the multiple passive networked sensors is established to improve the effectiveness of the anti-stealth detection. The elements of POMDP model are analyzed comprehensively based on the POMDP theory. A cooperative control system of multi-passive-sensors is put forward, and a UKF method for belief state updating together with a MCRS-based (Monte-Carlo Rollout sampling) algorithm for Q-value estimation is presented. A basic policy of CCSP is designed. Experiments show that the proposed model can be used for the efficient management and scheduling of multi-passive-sensors, as well as the effective detection and tracking of the stealth targets by deploying these sensors. The validity of the proposed algorithm is demonstrated.

Key words: control science and technology, sensor technology, anti-stealth, multiple sensors networking, POMDP, belief state, mission planning

CLC Number:

TP212

WAN Kai-fang, GAO Xiao-guang, LI Bo, MEI Jun-feng. Mission Planning of Passive Networked Sensors for Cooperative Anti-stealth Detection Based on POMDP[J]. Acta Armamentarii, 2015, 36(4): 731-743.

References

［1］卢盈齐, 祝长英. 雷达组网反隐身的一种优化布站方法［J］. 系统工程理论与实践,2007(6): 166-169.
LU Ying-qi, ZHU Chang-ying. An optimal deploy method of netted radar for detecting stealth target［J］. Systems Engineering-Theory & Practice, 2007(6): 166-169. (in Chinese)
［2］刘尚富, 甘怀锦. 雷达隐身与反隐身技术浅析［J］. 舰船电子工程,2010, 30(9): 28-30.
LIU Shang-fu, GAN Huai-jin. Brief review on stealth and anti-stealth techniques of radar［J］. Ship Electronic Engineering, 2010, 30(9): 28-30. (in Chinese)
［3］凌晓曙. 雷达隐身和反隐身技术［J］. 舰船电子对抗, 2007, 30(3): 40-42.
LING Xiao-shu. Stealth and anti-stealth techniques of radar［J］. Shipboard Electronic Countermeasure, 2007, 30(3): 40-42. (in Chinese)
［4］沈阳, 陈永光, 李修和,等. 多基地雷达反隐身分布式检测融合算法研究［J］. 电子学报, 2007, 35(3): 506-510.
SHEN Yang, CHEN Yong-guang, LI Xiu-he,et al. Study on fusion arithmetic of multi radar distributed detection system against stealthy targets ［J］. Acta Electronica Sinica, 2007,35(3): 506-510. (in Chinese)
［5］ Kuschel H, Heckenbach J, Muller S, et al. On the potentials of passive, multistatic, low frequency radars to counter stealth and detect low flying targets［C］∥2008 IEEE Radar Conference. Rome, Italy : IEEE Computer Society, 2008: 1-6.
［6］李伟, 柯涛. 雷达组网反隐身可行性仿真分析［J］. 舰船电子对抗,2010(5): 83-87.
LI Wei, KE Tao. Simulation analysis of anti-stealth feasibility of radar netting［J］. Shipboard Electronic Countermeasure,2010(5): 83-87. (in Chinese)
［7］ Kreucher C, Blatt D, Hero A, et al. Adaptive multi-modality sensor scheduling for detection and tracking of smart targets［J］. Digital Signal Processing, 2006, 16(5): 546-567.
［8］刘先省, 申石磊, 潘泉. 传感器管理及方法综述［J］. 电子学报,2002,30(3): 394-398.
LIU Xian-xing , SHEN Shi-lei, PAN Quan. A survey of sensor management and methods［J］. Acta Electronica Sinica, 2002,30(3): 394-398. (in Chinese)
［9］罗开平, 姜维, 李一军. 传感器管理述评［J］. 电子学报,2010,38(8): 1900-1907.
LUO Kai-ping, JIANG Wei, LI Yi-jun. Review of sensor management［J］. Acta Electronica Sinica, 2010,38(8): 1900-1907. (in Chinese)
［10］李彬彬, 冯新喜, 王朝英，等. 基于信息增量的多被动传感器资源分配算法［J］. 系统工程与电子技术, 2012(3): 502- 507.
LI Bin-bin, FENG Xin-xi, WANG Chao-ying, et al. Multi-passive sensors resource allocation algorithm based on information gain［J］. Systems Engineering and Electronics, 2012(3): 502-507. (in Chinese)
［11］ Williams J L. Information theoretic sensor management［D］. Massachusetts: Massachusetts Institute of Technology, 2007.
［12］ Jenkins K L, Castanon D A. Information-based adaptive sensor management for sensor networks［C］∥2011 American Control Conference. San Francisco, CA, US: AACC, 2011:4934-4940.
［13］ Wei M, Chen G, Blasch E. Game theoretic multiple mobile sensor management under adversarial environments［C］∥11th International Conference on Information Fusion Cologne. Germany: Air Force Research Laboratory, 2008:645-652.
［14］ Li X, Chen G, Blasch E. A geometric feature-aided game theoretic approach to sensor management［C］∥12th International Conference on Information Fusion. Seattle, WA, US: ISIF, 2009:1155-1162.
［15］ Lopez J M M, Rodriguez F J J, Corredera J R C. Fuzzy reasoning for multisensor management［C］∥IEEE International Conference on SMC. US: IEEE, 1995: 1398-1403.
［16］ Smith J F, Rhyne R D. A fuzzy logic algorithm for optimal allocation of distributed resources［C］∥Proceedings of the Second International Conference on Information Fusion. Mountain View, CA: International Society for Infonmation Fusion, 1999: 402-409.
［17］王博, 周一宇, 鲁建华，等. 基于实值粒子群优化的STSS系统传感器管理算法研究［J］. 系统仿真学报,2009,21(22): 7287-7292.
WANG Bo, ZHOU Yi-yu, LU Jian-hua, et al. Research on sensor management algorithm of STSS based on real-number particle swarm optimization［J］. Journal of System Simulation, 2009,21(22): 7287-7292. (in Chinese)
［18］杨博, 王向华, 邵利平,等. 基于群集智能的传感器管理方法研究［J］. 兵工学报，2012, 33(2): 155-161.
YANG Bo, WANG Xiang-hua, SHAO Li-ping, et al. Research on sensor management based on collective intelligence［J］. Acta Armamentarii, 2012, 33(2): 155-161. (in Chinese)
［19］ Williams J L, Fisher J W, Willsky A S. Approximate dynamic programming for communication-constrained sensor network management［J］. IEEE Transactions on Signal Processing, 2007, 55(8): 4300-4311.
［20］ Karmokar A K, Senthuran S, Anpalagan A. POMDP-based cross-layer power adaptation techniques in cognitive radio networks［C］∥Global Communications Conference. Anaheim, California, US：IEEE，2012: 1380-1385.
［21］ Hitchings D, Castanon D A. Receding horizon stochastic control algorithms for sensor management［C］∥American Control Conference. MD, US: AACC, 2010:6809-6815.
［22］ Krishnamurthy V. Algorithms for optimal scheduling and management of hidden Markov model sensors［J］. IEEE Transactions on Signal Processing, 2002, 50(6): 1382-1397.
［23］ Brehard T, Coquelin P A, Duflos E, et al. Optimal policies search for sensor management: application to the AESA radar［C］∥11th International Conference on Information Fusion. Cologne, Germany: Cologne, Germany: International Society for Information Fusion, 2008: 1-8.
［24］ Krishnamurthy V, Djonin D V. Optimal threshold policies for multivariate POMDPs in radar resource Management［J］. IEEE Transactions on Signal Processing, 2009, 57(10): 3954-3969.
［25］ Li Y, Krakow L W, Chong E K, et al. Approximate stochastic dynamic programming for sensor scheduling to track multiple targets［J］. Digital Signal Processing,2009, 19(6): 978-989.
［26］ He Y, Chong E K. Sensor scheduling for target tracking: a Monte Carlo sampling approach［J］. Digital Signal Processing, 2006, 16(5): 533-545.
［27］ Nourbakhsh I, Powers R, Birchfield S. DERVISH an office-navigating robot［J］. AI Magazine, 1995, 16(2): 53-60.
［28］ Simmons R, Koenig S. Probabilistic robot navigation in partially observable environments［C］∥Proceedings of the International Joint Conference on Artificial Intelligence.Canberra, Australia:World Scientific Publishing Co Pte Ltd, 1995.
［29］ Dallaire P, Besse C, Ross S, et al. Bayesian reinforcement learning in continuous POMDPs with Gaussian processes［C］∥International Conference on Intelligent Robots and Systems. St Louis, MO, US：IEEE, 2009: 2604-2609.
［30］ Martinez-Cantin R, De Freitas N, Brochu E, et al. A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot［J］. Autonomous Robots,2009, 27(2): 93-103.
［31］ Pyeatt L D, Howe A E. Integrating POMDP and reinforcement learning for a two layer simulated robot architecture［C］∥The Third Annual Conference on Autonomous Agents. New York, US: ACM, 1999: 168-174.
［32］ Eker B I C S, Ak I N H L. Solving decentralized POMDP problems using genetic algorithms［J］. Autonomous Agents and Multi-Agent Systems, 2013, 27(1): 161-196.
［33］ Chong E K P, Kreucher C M, Hero A O. Monte-Carlo-based partially observable Markov decision process approximations for adaptive sensing［C］∥9th International Workshop on Discrete Event Systems . Goteborg, Sweden:IEEE,2008: 173-180.
［34］ Chong E K, Kreucher C M, Hero Iii A O. Foundations and Applications of Sensor Management［M］. NY: Springer, 2008: 95- 119.
［35］ Li Y, Krakow L W, Chong E K P, et al. Dynamic sensor management for multisensor multitarget tracking［C］∥40th Annual Conference on Information Sciences and Systems. Princeton, NJ: IEEE,2006: 1397-1402
［36］慈元卓. 面向移动目标搜索的多星任务规划问题研究［D］. 长沙：国防科学技术大学, 2008.
CI Yuan-zhuo. Multi-satellite mission planning for moveing target search［D］. Changsha: National University of Defence Technology,2008. (in Chinese)
［37］ Tharmarasa R, Kirubarajan T. Sensor management for large-scale multisensor-multitarget tracking ［D］. Canada: McMaster University,2007.
［38］ Bertsekas D P, Castanon D A. Rollout algorithms for stochastic scheduling problems［J］. Journal of Heuristics, 1999,5(1): 89-108.
［39］ Guy Shani. POMDP solver-a Java implementation arranged as an Eclipse package of most of the point-based algorithms for solving POMDPs ［EB/OL］. ［2013-06-01］. http:∥www.bgu.ac.il/~ shanigu/.

[1]	WANG Mengyang, ZHANG Dong, TANG Shuo, XU Bin, ZHAO Junmin. UAV Swarm On-line Mission Planning Method Based on Dynamic Allocation Strategy [J]. Acta Armamentarii, 2023, 44(8): 2207-2223.
[2]	DU Weiwei, CHEN Xiaowei. Task Assignment and Optimization Method of Tactical-Level Army Operations [J]. Acta Armamentarii, 2023, 44(5): 1431-1442.
[3]	LI Dian-qi， DUAN Yong. Implementation of Active Disturbance Rejection Control of Robot by Tracking Differentiator [J]. Acta Armamentarii, 2016, 37(9): 1721-1729.
[4]	MENG Ke-zi, ZHOU Di. H_∞ Guidance Law Accounting for Dynamics of Missile Autopilot [J]. Acta Armamentarii, 2016, 37(7): 1194-1202.
[5]	WANG Jie， XIONG Zhi， XING Li， DAI Yi-jie, HUA Bing, LIU Jian-ye. Online Calibration of IMU errors of Inertial Navigation System Based on Innovation-based Adaptive Filtering [J]. Acta Armamentarii, 2016, 37(7): 1203-1213.
[6]	ZHANG Fu-bin, MA Peng, WANG Zhi-hui. SINS/DVL Integrated Navigation Algorithm Based on Transversal Coordinate Frame in Polar Region [J]. Acta Armamentarii, 2016, 37(7): 1229-1235.
[7]	YU Xiao-ting， YU Feng， HE Zhen， XIONG Zhi， WANG Zhen-yu. Virtual Sliding Mode Control-based Attitude Estimation for Non-cooperative Spacecraft [J]. Acta Armamentarii, 2016, 37(7): 1282-1290.
[8]	DUAN Mei-jun, ZHOU Di. A Guidance Law with Finite Time under Control Variable Constraint [J]. Acta Armamentarii, 2016, 37(6): 1030-1037.
[9]	JIN Ying-lian, REN Jie, FENG Wei-bo, LI Jian-jun, WANG Bin-rui. Gait Analysis of an Inchworm-like Robot Climbing on Curved Surface and CPG-based Planning [J]. Acta Armamentarii, 2016, 37(6): 1104-1110.
[10]	CHEN Chen， MA Guang-fu， SUN Yan-chao， LI Chuan-jiang. Recursive Sliding Mode Control for Hypersonic Vehicle Based on Nonlinear Disturbance Observer [J]. Acta Armamentarii, 2016, 37(5): 840-850.
[11]	FENG Ka-li， LI An， QIN Fang-jun， LI Feng. Temperature Error Compensation Method Based on Adaptive Neuro Fuzzy Inference for Fiber-optic Gyro [J]. Acta Armamentarii, 2016, 37(4): 641-647.
[12]	ZHANG Chun-yan, SONG Jian-mei, HOU Bo, ZHANG Min-qiang. Cooperative Guidance Law with Impact Angle and Impact Time Constraints for Networked Missiles [J]. Acta Armamentarii, 2016, 37(3): 431-438.
[13]	DONG Zao-peng， WAN Lei， SUN Yu-shan， LIU Tao， LI Yue-ming， ZHANG Guo-cheng. Trajectory Tracking Control of an Underactuated Unmanned Marine Vehicle Based on Asymmetric Model [J]. Acta Armamentarii, 2016, 37(3): 471-481.
[14]	DU Ming-fang, WANG Jun-zheng, LI Duo-yang, HE Yu-dong. Ground Robot Multi-scale Road Perception Based on Semantic Tree MRF Model [J]. Acta Armamentarii, 2016, 37(3): 512-517.
[15]	LIU Ming-yong, ZHU Li, DONG Hai-xia. Research on Gyroscope Array Based on Kalman Filter [J]. Acta Armamentarii, 2016, 37(2): 272-278.