A Semantic Information-based Module Series Method for Unmanned Tracked Driving Systems

doi:10.12382/bgxb.2021.0832

Abstract

Abstract: To improve the performance of unmanned tracked platforms in complex off-road environment, this study proposes a semantic information-based method to integrate the environment perception, motion planning and motion control modules of the unmanned system. Through the fusion perception method of camera and lidar, image semantic information and lidar point cloud features are obtained by the environment perception module, and then the traversable area is roughly determined by combining geometric parameters of the platform. Finally, a three-dimensional grid map with different traversability information is generated, after the Gaussian clustering model is used to conduct a fine traversability analysis of the environment in the traversable area. Platform kinematics and dynamic constraints are considered in the motion planning module. On the basis of smooth transition constraints, terrain and road surface attributes are taken into account to generate behavior motion primitives, and the trajectories with behavior semantics are generated using hierarchical online selection of primitives. The motion control module is based on model predictive control which considers the execution ability, tracking deviation, and control stability of the platform drive motor. Based on the semantic attributes of the behavior motion primitives provided by motion planning, the weight coefficient of the control objective function is updated in real time to reduce lateral deviation, heading deviation, and speed deviation of trajectory tracking. Finally, the medium-sized hybrid unmanned tracked platform is used for verification. The results show that the motion planning method proposed in this paper are 46.1%, 46.5% and 14.2% lower in average pitch angle, average roll angle and average curvature than the trajectory planning result using the plane binary grid map. Compared with the motion control method with fixed parameters, the proposed variable-parameter motion control method based on behavior semantic trajectory reduces the lateral deviation, heading deviation, and speed deviation by 17.1%, 2.7% and 6.1%, respectively.

Key words: trackedplatform, unmanneddrivingsystem, semanticinformation, three-dimensionalgridmap, behaviormotionprimitive, modelpredictivecontrol

CLC Number:

TG810.2

CHEN Huiyan, GUAN Haijie, LIU Hai'ou, GONG Jianwei, WU Heyu. A Semantic Information-based Module Series Method for Unmanned Tracked Driving Systems[J]. Acta Armamentarii, 2022, 43(11): 2705-2716.

References

［1］陈慧岩, 张玉. 军用地面无人机动平台技术发展综述[J]. 兵工学报,2014,35(10):1696-1706.
CHEN H Y, ZHANG Y. An overview of research on military unmanned ground vehicles[J]. Acta Armamentarii, 2014, 35(10): 1696-1706. (in Chinese)
[2] 邢志伟, 朱晓蕊, 何超. 基于行人行为学习的机器人同时定位与可通行区域制图[J]. 机械工程学报, 2019, 55(11): 36- 45.
XING Z W, ZHU X R, HE C. Simultaneous localization and traversable region mapping based on pedestrian behavior learning[J]. Journal of Mechanical Engineering, 2019, 55(11): 36-45. (in Chinese)
[3] QI C R, SU H, MO K, et al. PointNet: deep learning on point sets for 3D classification and segmentation[C]∥Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI, US: IEEE, 2017: 77-85.
[4] GAO B, PAN Y C, LI C K, et al. Are we hungry for 3D LiDAR data for semantic segmentation? a survey of datasets and methods[J]. IEEE Transactions on Intelligent Transportation Systems, 2021, 23(7): 6063-6081.
[5] GAO B, HU S C, ZHAO X J, et al. Fine-grained off-road semantic segmentation and mapping via contrastive learning[C]∥Proceedings of the International Conference on Intelligent Robots and Systems(IROS 2021). Prague, Czech: IEEE, 2021: 5950-5957.
[6] ZHANG Y, CHEN H Y, WASLANDER S, et al. Hybrid trajectory planning for autonomous driving in highly con-strained environments[J]. IEEE Access, 2018, 6: 32800-32819.
[7] 杜广泽, 张旭东, 邹渊，等. 非结构道路场景下轮式无人车辆避障算法[J]. 兵工学报, 2020, 41(10): 2096-2105.
DU G Z，ZHANG X D，ZOU Y，et al. Obstacle avoidance algorithm for autonomous wheeled vehicle in unstructured environments[J]. Acta Armamentarii, 2020, 41(10): 2096-2105. (in Chinese)
[8] THORESEN M, NIELSE N H, MATHIASSEN K, et al. Path planning for UGVs based on traversability hybrid A^*[J]. IEEE Robotics and Automation Letters, 2021, 6(2): 1216-1223.
[9] 田洪清, 王建强, 黄荷叶, 等. 越野环境下基于势能场模型的智能车概率图路径规划方法[J]. 兵工学报, 2021, 42(7): 1496-1505.
TIAN H Q, WANG J Q, HUANG H Y, et al. Probabilistic roadmap method for path planning of intelligent vehicle based on artificial potential field model in off-road environment [J]. Acta Armamentarii, 2021, 42(7): 1496-1505. (in Chinese)
[10] UGUR D, BEBEK O. Fast and efficient terrain-aware motion planning for exploration rovers[C]∥Proceedings of the 2021 IEEE 17th International Conference on Automation Science and Engineering (CASE). Lyon, France: IEEE, 2021: 1561-1567.
[11] KRSI P, FURGALE P, BOSSE M, et al. Driving on point clouds: motion planning, trajectory optimization, and terrain assessment in generic nonplanar environments[J]. Journal of Field Robotics, 2017, 34 (5): 940-984.
[12] FABIAN S, KOHLBRECHER S, VON STRYK O. Pose Prediction for Mobile Ground Robots in Uneven Terrain Based on Difference of Heightmaps[C]∥Proceedings of the 2020 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR). Abu Dhabi, United Arab Emirates: IEEE: 2020: 49-56.
[13] 胡家铭, 胡宇辉, 陈慧岩, 等. 基于模型预测控制的无人驾驶履带车辆轨迹跟踪方法研究[J]. 兵工学报, 2019, 40(3): 456-463.
HU J M, HU Y H, CHEN H Y, et al. Research on trajectory tracking of unmanned tracked vehicles based on model predictive control[J]. Acta Armamentarii, 2019, 40(3): 456-463. (in Chinese)
[14] 王威, 陈慧岩, 马建昊, 等. 基于Frenet坐标系和控制延时补偿的智能车辆路径跟踪[J]. 兵工学报, 2019, 40(11): 2336-2351.
WANG W, CHEN H Y, MA J H, et al. Path tracking for intelligent vehicles based on frenet coordinates and delayed control[J]. Acta Armamentarii, 2019, 40(11): 2336-2351. (in Chinese)
[15] HE H, SHI M, LI J, et al. Design and experiential test of a model predictive path following control with adaptive preview for autonomous buses[J]. Mechanical Systems and Signal Processing, 2021, 157(99): 107701.
[16] 王博洋, 龚建伟, 熊光明, 等. 有级转向履带车辆的驾驶员操控行为模型[J]. 兵工学报, 2020, 41(12): 2379-2388.
WANG B Y, GONG J W, XIONG G M, et al. Driver control behavior model for tracked vehicle with stepped steering mechanism[J]. Acta Armamentarii, 2020, 41(12): 2379-2388. (in Chinese)
[17] YU C Q, GAO C X, WANG J B, et al. Bisenet V2: bilateral network with guided aggregation for real-time semantic segmentation[J]. International Journal of Computer Vision, 2021, 129(11): 3051-3068.
[18] JI K J, CHEN H Y, DI H J, et al.CPFG-SLAM: a robust simultaneous localization and mapping based on LIDAR in off-road environment[C]∥Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV 2018). Changshu, China: IEEE, 2018: 650-655.
[19] 曾根, 王伟达, 盖江涛, 等. 双侧电机耦合驱动履带车辆斜坡转向控制策略[J]. 兵工学报，2021, 42(10):2189-2195.
ZENG G, WANG W D, GAI J T, et al. Steering on ramp control strategy of double motor coupling drive transmission for tracked vehicle[J]. Acta Armamentarii, 2021, 42(10): 2189-2195. (in Chinese)
[20] WU M Z, JIN H, TANG B, et al. Constructing Topological Road Network of Wild Environment using Google Earth Pro[C]∥Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC 2019). Auckland, New Zealand: IEEE, 2019: 2095-2100.
[21] YANG T, XIONG G M, ZHANG Y, et al.A practical planning framework and its implementation for autonomous navigation in off-road environment[C]∥Proceedings of the 2019 IEEE Intelligent Vehicles Symposium. Paris, France: IEEE, 2019: 1571-1576.

[1]	CHEN Luming, LIAO Zili, MA Xiaojun, LIU Chunguang. Hierarchical Control-based Real-time Energy Management Strategy for Hybrid Electric Vehicles [J]. Acta Armamentarii, 2021, 42(8): 1580-1591.
[2]	LIU Cong， LIU Hui, HAN Lijin, CHEN Ke. High-speed Obstacle Avoidance and Stability Control of Distributed Electric Drive Vehicle under Extreme Off-road Conditions [J]. Acta Armamentarii, 2021, 42(10): 2102-2113.
[3]	WANG Zhifu, BAI Jin, HUANG Kanglun, WANG Jun, WANG Yang, LIANG Changchun, WANG Rui. Rollover Prevention Control for In-wheel Motor Drive Vehicle Based on Model Prediction Control [J]. Acta Armamentarii, 2021, 42(1): 11-25.
[4]	DENG Haipeng， MA Bin， ZHAO Haiguang， L Liang, LIU Yu. Path Planning and Tracking Control of Autonomous Vehicle for Obstacle Avoidance [J]. Acta Armamentarii, 2020, 41(3): 585-594.
[5]	HU Jiaming, HU Yuhui, CHEN Huiyan, LIU Kai. Research on Trajectory Tracking of Unmanned Tracked Vehicles Based on Model Predictive Control [J]. Acta Armamentarii, 2019, 40(3): 456-463.
[6]	WANG Wei, CHEN Huiyan, MA Jianhao, LIU Kai, GONG Jianwei. Path Tracking for Intelligent Vehicles Based on Frenet Coordinates and Delayed Control [J]. Acta Armamentarii, 2019, 40(11): 2336-2351.