In order to improve the accuracy of vehicle trajectory prediction in structured road scenes
a multimodal trajectory prediction method based on graph models and attention mechanism is proposed. For the purpose of modeling road environment characteristics
vehicle motion characteristics and characteristics of interaction between vehicles
the lane graph and vehicle interaction graph are constructed. Environment-vehicle feature fusion is completed by stacked attention modules
so as to realize the unification of static and dynamic features of traffic scenes. The final predicted trajectories and corresponding probabilities are obtained through a two-branch decoding module. The Argoverse dataset is used to train and validate the proposed method. The experimental results show that the proposed method achieves excellent performance of motion prediction in structured road scenes. The prediction accuracy is better than the current mainstream methods.
ZHOU B . Study on multi-task and multi-model probabilistic trajectory prediction method in traffic scenes [D ] . Dalian : Dalian University of Technology , 2021 . (in Chinese)
JIA X G . Research on vehicle trajectory prediction in interactive scenarios [D ] . Harbin : Harbin Institute of Technology , 2021 . (in Chinese)
PHANMINH T , GRIGORE E C , BOULTON F A , et al . CoverNet: multimodal behavior prediction using trajectory sets [J ] . Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 2020 : 14062 - 14071 .
CHAI Y N , SAPP B , BANSAL M , et al . MultiPath: multiple probabilistic anchor trajectory hypotheses for behavior prediction:arXiv: 1910.05449 [R ] . Ithaca,NY,US : Cornell University , 2019 : 1910 .05449.
GU J R , SUN C , ZHAO H . DenseTNT: end-to-end trajectory prediction from dense goal sets:arXiv:2108.09640 [R ] . Ithaca,NY, US : Cornell University , 2021 : 2108 .09640.
ZENG W Y , LIANG M , LIAO R J , et al . LaneRCNN: distributed representations for graph-centric motion forecasting [C ] //Proceedings of the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems Prague . Czech Republic : IEEE , 2021 : 532 - 539 .
LIANG M , YANG B , HU R , et al . Learning lane graph representations for motion forecasting:arXiv:2007.13732 [R ] . Ithaca,NY, US : Cornell University , 2020 : 2007 .13732.
HOMAYOUNFAR N , MA W C , LIANG J , et al . DAGMapper: learning to map by discovering lane topology [C ] // Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision.Seoul,Korea:IEEE , 2019 : 2911 - 2920 .
SALZMANN T , IVANOVIC B , CHAKRAVARTY P , et al . Trajectron++:dynamically-feasible trajectory forecasting with heterogeneous data:arXiv:2001. 03093 [R ] . Ithaca,NY , US : Cornell University , 2020 : 2001 .03093.
GILLES T , SABATINI S , TSISHKOU D , et al . HOME: heatmap output for future motion estimation [C ] //Proceedings of the 2021 IEEE International Intelligent Transportation Systems Conference.Indianapolis, IN, US:IEEE, 2021 : 500 - 507 .
ZHANG H P , HUANG C Q , TANG S Q , et al . CNN-basedreal-time prediction method of flight trajectory of unmanned combat aerial vehicle [J ] . Acta Armamentarii , 2020 , 41 ( 9 ): 1894 - 1903 . (in Chinese)
VASWANI A , SHAZEER N M , PARMAR N , et al . Attention is all you need: arXiv: 1706. 03762 [R ] . Ithaca,NY , US : Cornell University , 2017 : 1706 .03762.
MERCAT J , GILLES T , ZOGHBY N E , et al . Multi-head attention for multi-modal joint vehicle motion forecasting [C ] // Proceedings of the 2020 IEEE International Conference on Robotics and Automation.Paris, France:IEEE , 2020 : 9638 - 9644 .
ZENG W L , CHEN Y H , YAO R Y , et al . Application of spatial-temporal graph attention networks in trajectory prediction for vehicles at intersections [J ] . Computer Science , 2021 , 48 ( S1 ): 334 - 341 . (in Chinese)
IVANOVIC B , PAVONE M . The trajectron: probabilistic multi-agent trajectory modeling with dynamic spatiotemporal graphs [C ] // Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision.Seoul, Korea:IEEE , 2019 : 2375 - 2384 .
WANG X , LÜ R R , ZHAO Y , et al . Multi-scale context aggregation network with attention-guided for crowd counting [C ] //Proceedings of the 2020 15th IEEE International Conference on Signal Processing . Beijing, China : IEEE , 2020 : 240 - 245 .
JAIN A , ZAMIR A R , SAVARESE S , et al . Structural-RNN: deep learning on spatio-temporal graphs [C ] // Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, US:IEEE , 2016 : 5308 - 5317 .
IVANOVIC B , SCHMERLING E , LEUNG K , et al . Generative modeling of multimodal multi-human behavior [C ] // Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems. Madrid, Spain:IEEE , 2018 : 3088 - 3095 .
VEMULA A , MUELLING K , OH J . Social attention: modeling attention in human crowds [C ] // Proceedings of the 2018 IEEE International Conference on Robotics and Automation. Brisbane, QLD, Australia:IEEE , 2018 : 4601 - 4607 .
PARK S , LEE G , BHAT M , et al . Diverse and admissible trajectory forecasting through multimodal context understanding: arXiv:2003. 03212 [R ] . Ithaca,NY , US : Cornell University , 2020 : 2003 .03212.
LIU C , LIANG J . Vehicle motion trajectory prediction based on attention mechanism [J ] . Journal of Zhejiang University (Engineering Science) , 2020 , 54 ( 6 ): 1156 - 1163 . (in Chinese)
CHANG M F , LAMBERT J , SANGKLOY P , et al . Argoverse: 3d tracking and forecasting with rich maps [C ] // Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Long Beach, CA, US:IEEE , 2019 : 8740 - 8749 .
ZHAO H , GAO J , LAN T , et al . TNT:target-driven trajectory prediction: arXiv:2008. 08294 [R ] . Ithaca,NY , US : Cornell University , 2020 : 2008 .08294.
KHANDELWAL S , QI W , SINGH J , et al . What-if motion prediction for autonomous driving:arXiv:2008.10587 [R ] . Ithaca,NY , US : Cornell University , 2020 : 2008 .10587.