基于动态和静态环境对象观测一致性约束的移动机器人多传感器标定优化方法

doi:10.3969/j.issn.1000-1093.2017.08.022

摘要/Abstract

摘要： 为了解决机器人未知环境导航过程中的多源、异构传感器空间一致性观测问题，提出了基于动态和静态环境对象观测一致性约束的摄像机与激光测距传感器联合标定优化方法。利用协方差交集方法实现运动目标图像平面方向状态融合，同时采用卡尔曼滤波和概率数据关联滤波实现一对一和一对多信息源的静态角点特征图像平面方向状态融合；在此基础上，利用动态和静态物体融合前与融合后状态误差构造优化目标函数，并利用非线性优化方法实现标定参数优化。实验结果表明，该设计方法能够提高多传感器环境观测的一致性水平，验证了该方法的有效性。

关键词: 控制科学与技术, 机器人同时定位与地图构建, 目标跟踪, 多传感器标定, 多传感器信息融合

Abstract: A calibration optimization method of camera and laser rangefinder based on stationary and moving object observation consistency constraint is proposed to address the problem of spatial observation consistency from heterogeneous multi-sensor in the process of mobile robot navigation in unknown environment. A covariance intersection method is used to fuse the bearing state of moving object on image plane, and Kalman and probabilistic data association filters are used to resolve the bearing state fusion of corner feature in the situations of “one-to-one” and “one-to-many”. On this basis, the objective function is generated using the bearing errors before and after fusion of image projections of stationary and moving objects, and the calibration parameters of camera and laser rangefinder are optimized using nonlinear optimization method. Experimental results show that the proposed method can be used to improve the observation consistency of multi-sensor, and the effectiveness of the mentioned methods is verified. Key

Key words: controlscienceandtechnology, SLAM, objecttracking, multi-sensorcalibration, multi-sensorinformationfusion

中图分类号:

TP249

伍明，张国良，李琳琳，付光远，李承剑. 基于动态和静态环境对象观测一致性约束的移动机器人多传感器标定优化方法[J]. 兵工学报, 2017, 38(8): 1630-1641.

WU Ming, ZHANG Guo-liang, LI Lin-lin, FU Guang-yuan, LI Cheng-jian. Muli-sensor Calibration Optimization Method of Mobile Robot Based on Stationary and Moving Object Observation ConsistencyConstraint[J]. Acta Armamentarii, 2017, 38(8): 1630-1641.

参考文献

［1］ Zhang Y L, Hong D P. Navigation of mobile robot using low-cost GPS[J]. International Journal of Precision Engineering and Manufacturing, 2015, 16(4):847-860.
[2］ Huang H C. An evolution optimal fussy system with information fusion of heterogeneous distributed computing and polar-space dynamic model for online motion control of Swedish redundant robot[J]. IEEE Transactions on Industrial Electronics, 2016, 9(9):1-10.
[3］ Doki K, Suyama K, Funabora Y, et al. Robust localization for mobile robot by K-L divergence based sensor data fusion[C]∥Proceedings of 41st Annual Conference of the IEEE Industrial Electronics Society. Yokohama, Japan: IEEE, 2015:15753693.
[4］ Zhou B, Qian K, Fang F. Multi-sensor fusion robust localization for indoor mobile robots based on a set-membership estimator[C]∥Proceedings of the IEEE International Conference on Cyber Technology in Automation, Control,and Intelligent Systems. Chicago, IL, US: IEEE, 2015:157-162.
[5］ Machado J, Micael L. A sensor fusion layer to cope with reduced visibility in SLAM[J]. Journal of Intelligent and Robotic System, 2015, 80(3):34-49.
[6］ Yuan J, Chen H, Sun F C. Multisensor information fusion for people tracking with a mobile robot: a particle filtering approach[J]. IEEE Transactions on Instrumentation and Measurement, 2015, 64(9): 2427-2442.
[7］韩崇昭, 朱洪艳, 段战胜. 多源信息融合[M]. 北京: 清华大学出版社, 2006.
HAN Chong-zhao, ZHU Hong-yan, DUAN Zhan-sheng. Milti-source information fusion[M]. Beijing: Tsinghua University Press, 2006.(in Chinese)
[8］ Li L L, Zhao W C, Wu F, et al. Analysis and improvement of characteristic points extraction algorithms in camera calibration[J]. Acta Optica Sinica, 2014, 34(5): 0515002.
[9］ Zhang Q, Pless R. Extrinsic calibration of a camera and laser range finder[C]∥Proceedings of the IEEE International Conference on Intelligent Robots and Systems. Louis, MO, US: IEEE, 2004:2301-2306.

[10］ Cobzas D, Zhang H, Jagersand M. A comparative analysis of geometric and image-based volumetric and intensity data registration algorithms[C]∥IEEE International Conference on Robotics and Automation. Edmonton, Alta, Canada: IEEE, 2002:2506-2511.
[11］ Chen Z, Zhuo L. Extrinsic calibration of a camera and a laser range finder using point to line constraint[J]. Procedia Engineering, 2012, 29(3): 4348-4352.
[12］ Bok Y, Choi D G, Kweon I S. Extrinsic calibration of a camera and a 2D laser without overlap[J]. Robotics and Autonomous System, 2016, 78(18):17-28.
[13］ Heng L, Lee G H, Pollefeys M. Self-calibration and visual SLAM with a multi-camera system on a micro aerial vehicle[J］.Autonomous Robots, 2015, 39(3):259-277.
[14］伍明, 李琳琳, 尹宗瑞. 未知环境下机器人定位与运动目标侦测[J]. 山东科技大学学报:自然科学版, 2012, 31(3):66-73.
WU Ming, LI Lin-lin, YIN Zong-rui. Robot localization and detection of moving objects in unknown environment[J]. Journal of Shandong University of Scinence and Technology:Natural Science, 2012, 31(3):66-73.(in Chinese)
[15］ Hartley R, Zisserman A. Multiple view geometry in computer vision[M]. Cambridge, UK: Cambridge University Press, 2003.
[16］ Peynot T, Kassir A. Laser-camera data discrepancies and reliable perception in outdoor robotics[C]∥2010 IEEE/RSJ International Conference on Intelligent Robots and Systems. Taipei, Taiwan: IEEE, 2010:2625-2632
[17］ Kassir M M, Palhang M. A region based Camshift tracking with a moving camera[C]∥Proceedings of the RSI/ISM International Conference on Robotics and Mechatronics. Tehran, Iran: IEEE, 2014:451-455.
[18］ Comaniciu D, Ramesh V, Meer P. Kernel-based object tracking[J]. IEEE Transactions on Pattern Analysis Machine Intelligence, 2003, 25(5): 564-577.
[19］ Nguyen V, Gachter S. A comparison of line extraction algorithms using 2D range data for indoor mobile robotics[J]. Autonomous Robots, 2007, 23(2):97-111.
[20］ Chen L J, Arambel P O, Mehra R K. Fusion under unknown correlation-covariance intersection as a special case[C]∥Proceedings of the Fifth International Conference on Information Fusion. Piscataway, NJ, US: IEEE, 2002: 905-912.
[21］ Bar-Shalom Y, Tse E. Tracking in a cluttered environment with probabilistic data association[J]. Automatica, 1975, 11(5): 451-460.
[22］ Marquardt D. An algorithm for least-squares estimation of nonlinear parameters[J]. SIAM Journal on Applied Mathematics, 1963, 11(5): 431-441.
[23］ Peynot T, Scheding S, Terho S. The Marulan data sets: multi-sensor perception in natural environment with challenging conditions[J]. International Journal of Robotics Research, 2010, 29(13): 1602-1607.

第38卷
第8期2017 年8月兵工学报ACTA
ARMAMENTARIIVol.38No.8Aug.2017

[1]	张昀普，单甘霖. 道路约束下多传感器协同地面目标跟踪的管理方法[J]. 兵工学报, 2022, 43(3): 542-555.
[2]	李纪三，侯娇，刘溶，任渊. 基于贝叶斯滤波算法的警戒相控阵雷达目标跟踪时间资源优化分配算法[J]. 兵工学报, 2021, 42(9): 1902-1910.
[3]	姜珊，底晓强，韩成. 融合时空特性的孪生网络视觉跟踪[J]. 兵工学报, 2021, 42(9): 1940-1950.
[4]	丁海婷，周琳，刁伟峰. 基于背包问题的多相控阵雷达多目标跟踪时间资源管理算法[J]. 兵工学报, 2021, 42(5): 997-1003.
[5]	张永梅，赖裕平，马健喆，冯超，束颉. 基于视频的装甲车和飞机检测跟踪及轨迹预测算法[J]. 兵工学报, 2021, 42(3): 545-554.
[6]	张君彪，熊家军，兰旭辉，李凡，陈新，席秋实. 基于自适应多通道交互式多模型的高超声速滑翔飞行器跟踪方法[J]. 兵工学报, 2021, 42(12): 2626-2636.
[7]	邹汝平，刘建书. 基于概率假设密度滤波与无迹Kalman滤波的多目标跟踪与识别[J]. 兵工学报, 2020, 41(8): 1502-1508.
[8]	卢莉萍，郑潇. 基于旋转反射镜光学成像的动态目标跟踪方法[J]. 兵工学报, 2020, 41(8): 1558-1565.
[9]	邵鹏飞，王蕾，王方勇. 基于序贯蒙特卡洛与概率假设密度滤波的主动分布式声纳多目标跟踪[J]. 兵工学报, 2020, 41(5): 941-949.
[10]	张伽伟，喻鹏，姜润翔, 孙宝全. 基于舰船电场的目标跟踪方法研究[J]. 兵工学报, 2020, 41(3): 559-566.
[11]	杨鑫, 许卫东, 贾其. 一种基于特征统计的动态伪装效果评估方法[J]. 兵工学报, 2019, 40(8): 1693-1699.
[12]	马艳，刘小东. 状态自适应无迹卡尔曼滤波算法及其在水下机动目标跟踪中的应用[J]. 兵工学报, 2019, 40(2): 361-368.
[13]	张蛟，邢士勇，王建华，李茂，陆建峰. 一种具有角速度量测的多站无源目标跟踪方法[J]. 兵工学报, 2019, 40(1): 107-114.
[14]	曾溢良，蓝金辉，邹金霖. 滑动置信度约束的红外弱小目标跟踪算法研究[J]. 兵工学报, 2017, 38(9): 1771-1778.
[15]	苗建明，王少萍，范磊，李元. 欠驱动自主水下航行器空间曲线路径跟踪控制研究[J]. 兵工学报, 2017, 38(9): 1786-1796.