
浏览全部资源
扫码关注微信
1. 东北电力大学 自动化工程学院, 吉林 吉林 132012
2. 哈尔滨工程大学 计算机科学与技术学院, 黑龙江 哈尔滨 150001
3. 东北电力大学 理学院, 吉林 吉林 132012
Received:22 April 2022,
Published Online:19 July 2023,
Published:30 June 2023
移动端阅览
Linlin XIA, Jingjing ZHANG, Yan CHU, et al. Progress and Prospects of Polarized Skylight Fused Visual SLAM[J]. Acta Armamentarii, 2023, 44(6): 1588-1601.
Linlin XIA, Jingjing ZHANG, Yan CHU, et al. Progress and Prospects of Polarized Skylight Fused Visual SLAM[J]. Acta Armamentarii, 2023, 44(6): 1588-1601. DOI: 10.12382/bgxb.2022.0288.
模仿生物复眼对偏振光敏感机理的偏振光导航是近年兴起的新技术
具有稳定、无源及完全自主的特性
偏振传感器的小型化、一体化使其与低成本相机、惯性测量单元等有效集成成为可能。回顾分析多传感器融合的视觉同时定位与地图创建(Simultaneous Localization and Mapping
SLAM)解决方案
梳理偏振导航传感器、天空偏振模式等最新研究进展
进而通过对辅以天空偏振光的视觉-惯性导航系统(Visual-Inertial Navigation System
VINS)的探索
进一步阐释该方案是应对视觉SLAM室外长航时导航实际的可行解。在此基础上
指出面向室外机器人操作系统、图优化框架的偏振成像仪定向观测约束模型的挑战性问题
供研究者探讨。所开发的偏振光辅助的VINS-Fusion具有扩展绝对位姿约束边的图优化技术特色
可实现全局一致的导航轨迹跟踪
为遥感测绘、军事探索等任务中的自主移动机器人导航与定位提供了创新性技术支持。
The polarized light navigation that imitates the mechanism of polarized light perception of compound eyes is a newly developed technology
which is stable
passive and totally autonomous. The miniaturization and integration of polarization sensors is currently enabling its fusion with low-cost cameras
inertial measurement units (IMU)
etc. The solutions for multi-sensor-based simultaneous localization and mapping (SLAM) are firstly reviewed and analyzed. The research progress in polarization navigation sensors and skylight polarization modes are summarized. Then
the polarized light-aided visual-inertial navigation system (VINS) is explored
and this solution is proved to be feasible for outdoor long-term visual SLAM. The challenging problems of polarization imager model that provides directional observation constraint for the whole navigation system are pointed out in terms of outdoor robot operation system (ROS) and graph optimization for reference. The pipeline design of polarized light-aided VINS-Fusion has the technical characteristic of expanding the absolute pose constraint edges of the graph
and further enables the globally consistent navigation trajectory tracking
providing innovative technical supports for autonomous mobile robot navigation and positioning in remote sensing
mapping and military exploration tasks.
SMITH R C , CHEESEMAN P . On the representation and estimation of spatial uncertainty [J ] . The International Journal of Robotics Research , 1986 , 5 ( 4 ): 56 - 68 . DOI: 10.1177/027836498600500404 http://doi.org/10.1177/027836498600500404 http://journals.sagepub.com/doi/10.1177/027836498600500404 http://journals.sagepub.com/doi/10.1177/027836498600500404 This paper describes a general method for estimating the nominal relationship and expected error (covariance) between coordinate frames representing the relative locations of ob jects. The frames may be known only indirectly through a series of spatial relationships, each with its associated error, arising from diverse causes, including positioning errors, measurement errors, or tolerances in part dimensions. This estimation method can be used to answer such questions as whether a camera attached to a robot is likely to have a particular reference object in its field of view. The calculated estimates agree well with those from an independent Monte Carlo simulation. The method makes it possible to decide in advance whether an uncertain relationship is known accu rately enough for some task and, if not, how much of an improvement in locational knowledge a proposed sensor will provide. The method presented can be generalized to six degrees offreedom and provides a practical means of esti mating the relationships ( position and orientation) among objects, as well as estimating the uncertainty associated with the relationships.
刘全攀 , 王正杰 , 王寰 . 基于双目视觉-惯性导航的轻型无人机导航算法 [J ] . 兵工学报 , 2020 , 41 ( 增刊2 ): 242 - 248 .
LIU Q P , WANG Z J , WANG H . Navigation algorithm of light UAV based on stereo visual inertial navigation odometer [J ] . Acta Armamentarii , 2020 , 41 ( S2 ): 242 - 248 . (in Chinese)
王金科 , 左星星 , 赵祥瑞 , 等 . 多源融合SLAM的现状与挑战 [J ] . 中国图象图形学报 , 2022 , 27 ( 2 ): 368 - 389 .
WANG J K , ZUO X X , ZHAO X R , et al . Review of multi-source fusion SLAM: current status and challenges [J ] . Journal of Image and Graphics , 2022 , 27 ( 2 ): 368 - 389 . (in Chinese)
STURZL W . A lightweight single-camera polarization compass with covariance estimation [C ] //Proceedings of IEEE International Conference on Computer Vision. Venice , Italy : IEEE , 2017 : 5353 - 5361 .
LIU Z Y , ZHANG Q , PAN M C , et al . Magnetic disturbance field compensation of a geomagnetic vector measuring instrument [J ] . IEEJ Transactions on Electrical and Electronics Engineering , 2018 , 13 ( 3 ): 356 - 361 . DOI: 10.1002/tee.2018.13.issue-3 http://doi.org/10.1002/tee.2018.13.issue-3 https://onlinelibrary.wiley.com/toc/19314981/13/3 https://onlinelibrary.wiley.com/toc/19314981/13/3
常宜峰 , 种洋 , 柴洪洲 , 等 . 世界地磁场模型精度评价 [J ] . 武汉大学学报(信息科学版) , 2016 , 41 ( 10 ): 1398 - 1403 .
CHANG Y F , CHONG Y , CHAI H Z , et al . Evaluation of world magnetic model accuracy [J ] . Geomatics and Information Science of Wuhan University , 2016 , 41 ( 10 ): 1398 - 1403 . (in Chinese)
CAMPOS C , ELVIRA R , RODRIGUEZ J J G , et al . ORB-SLAM3: An accurate open-source library for visual, visual-inertial, and multi-map SLAM [J ] . IEEE Transactions on Robotics , 2021 , 37 ( 6 ): 1874 - 1890 . DOI: 10.1109/TRO.2021.3075644 http://doi.org/10.1109/TRO.2021.3075644 https://ieeexplore.ieee.org/document/9440682/ https://ieeexplore.ieee.org/document/9440682/
ENGEL J , SCHOPS T , CREMERS D . LSD-SLAM: Large-scale direct monocular SLAM [C ] //Proceedings of European Conference on Computer Vision. Zurich , Switzerland : Springer , 2014 : 834 - 849 .
ENGEL J , KOLTUN V , CREMERS D . Direct sparse odometry [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2018 , 40 ( 3 ): 611 - 625 . DOI: 10.1109/TPAMI.2017.2658577 http://doi.org/10.1109/TPAMI.2017.2658577 Direct Sparse Odometry (DSO) is a visual odometry method based on a novel, highly accurate sparse and direct structure and motion formulation. It combines a fully direct probabilistic model (minimizing a photometric error) with consistent, joint optimization of all model parameters, including geometry-represented as inverse depth in a reference frame-and camera motion. This is achieved in real time by omitting the smoothness prior used in other direct methods and instead sampling pixels evenly throughout the images. Since our method does not depend on keypoint detectors or descriptors, it can naturally sample pixels from across all image regions that have intensity gradient, including edges or smooth intensity variations on essentially featureless walls. The proposed model integrates a full photometric calibration, accounting for exposure time, lens vignetting, and non-linear response functions. We thoroughly evaluate our method on three different datasets comprising several hours of video. The experiments show that the presented approach significantly outperforms state-of-the-art direct and indirect methods in a variety of real-world settings, both in terms of tracking accuracy and robustness.
GAO X , WANG R , DEMMEL N , et al . LDSO: Direct sparse odometry with loop closure [C ] //Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. Madrid, Spain:IEEE , 2018 : 2198 - 2204 .
ZUBIZARRETA J , AGUINAGA I , MONTIEL J M M . Direct sparse mapping [J ] . IEEE Transactions on Robotics , 2020 , 36 ( 4 ): 1363 - 1370 . DOI: 10.1109/TRO.8860 http://doi.org/10.1109/TRO.8860 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=8860 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=8860
夏琳琳 , 蒙跃 , 王策 , 等 . 基于Retinex理论的稀疏直接法VSLAM三维重建 [J ] . 中国惯性技术学报 , 2021 , 29 ( 2 ): 147 - 153 .
XIA L L , MENG Y , WANG C , et al . Retinex-based sparse direct VSLAM 3D reconstruction [J ] . Journal of Chinese Inertial Technology , 2021 , 29 ( 2 ): 147 - 153 . (in Chinese)
XIA L L , CUI J S , SHEN R , et al . A survey of image semantics-based visual simultaneous localization and mapping: application-oriented solutions to antonymous navigation of mobile robots [J ] . International Journal of Advanced Robotic Systems , 2020 , 17 ( 3 ): 1 - 17 .
刘忠泽 , 陈慧岩 , 崔星 , 等 . 无人平台越野环境下同步定位与地图创建 [J ] . 兵工学报 , 2019 , 40 ( 12 ): 2399 - 2406 . DOI: 10.3969/j.issn.1000-1093.2019.12.002 http://doi.org/10.3969/j.issn.1000-1093.2019.12.002 为了满足无人平台在越野环境下碰撞检测以及定位的需求、解决三维点云地图处理计算资源耗费大的问题,设计一种适用于越野环境的同步定位与地图创建方案。提出一种拓扑层次地图,将整个地图划分为多个具有层级结构的三维体素子地图,并以概率方法表示每个体素的状态,进而提取可通行区域。基于三维激光雷达和惯性测量单元,提出一种基于分支定界法的旋转直方图最近邻匹配实时闭环检测方法,并使用Ceres优化稀疏位姿图实现6自由度全局位姿实时优化。越野环境下的实验结果显示:该地图的创建以及可通行区域的提取效果良好,全局定位误差在1 m以内,姿态基本与参考高精度惯性导航系统保持一致;基于该方案提取的可通行区域以及位姿优化结果可满足无人平台实时运动的需求。
LIU Z Z , CHEN H Y , CUI X , et al . Real-time LiDAR SLAM in off-road environment for UGV [J ] . Acta Armamentarii , 2019 , 40 ( 12 ): 2399 - 2406 . (in Chinese) DOI: 10.3969/j.issn.1000-1093.2019.12.002 http://doi.org/10.3969/j.issn.1000-1093.2019.12.002 Simultaneous localization and mapping (SLAM) plays a more and more important role in the environment perception system of unmanned ground vehicle (UGV). A hierarchical global topological map is proposed to solve the low real time capability problem during processing of 3D lidar point cloud map, which divides the entire map into many submaps consisting of large numbers of tree-structure-based voxels, and the submaps are organized with the help of topology. The probabilistic methods are used to represent the state of each voxel being occupied/null. A transitable area is extracted based on the submaps for the UGV's path planning. With the help of an inertial measurement unit (IMU) and two 3D lidars, a branch and bound search (BBS)-based loop detection algorithm called RHM-ICP algorithm is proposed to realize a real time 6-degrees-of-freedom global pose optimization with the help of Ceres, which is to process the sparse pose adjustment (SPA). Experimental results obtained from a real large-scale off-road environment shows an effective reduction of lidar odometry pose accumulative error with a global location error of less than 1 m and a good performance of 3D mapping. Key
龙霄潇 , 程新景 , 朱昊 , 等 . 三维视觉前沿进展 [J ] . 中国图象图形学报 , 2021 , 26 ( 6 ): 1389 - 1428 .
LONG X X , CHENG X J , ZHU H , et al . Recent progress in 3D vision [J ] . Journal of Image and Graphics , 2021 , 26 ( 6 ): 1389 - 1428 . (in Chinese)
WEISS S , SIEGWART R . Real-time metric state estimation for modular vision-inertial systems [C ] //Proceedings of IEEE International Conference on Robotics and Automation. Shanghai , China : IEEE , 2011 : 4531 - 4537 .
MOURIKIS A I , ROUMELIOTIS S I . A multi-state constraint Kalman filter for vision-aided inertial navigation [C ] //Proceedings of IEEE International Conference on Robotics and Automation . Rome, Italy : IEEE , 2007 : 3565 - 3572 .
BLOESCH M , OMARI S , HUTTER M , et al . Robust visual inertial odometry using a direct EKF-based approach [C ] //Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. Hamburg , Germany : IEEE , 2015 : 298 - 304 .
LEUTENEGGER S , LYNEN S , BOSSE M , et al . Keyframe-based visua-inertial odometry using nonlinear optimization [J ] . The International Journal of Robotics Research , 2014 , 34 ( 3 ): 314 - 334 . DOI: 10.1177/0278364914554813 http://doi.org/10.1177/0278364914554813 http://journals.sagepub.com/doi/10.1177/0278364914554813 http://journals.sagepub.com/doi/10.1177/0278364914554813 Combining visual and inertial measurements has become popular in mobile robotics, since the two sensing modalities offer complementary characteristics that make them the ideal choice for accurate visual–inertial odometry or simultaneous localization and mapping (SLAM). While historically the problem has been addressed with filtering, advancements in visual estimation suggest that nonlinear optimization offers superior accuracy, while still tractable in complexity thanks to the sparsity of the underlying problem. Taking inspiration from these findings, we formulate a rigorously probabilistic cost function that combines reprojection errors of landmarks and inertial terms. The problem is kept tractable and thus ensuring real-time operation by limiting the optimization to a bounded window of keyframes through marginalization. Keyframes may be spaced in time by arbitrary intervals, while still related by linearized inertial terms. We present evaluation results on complementary datasets recorded with our custom-built stereo visual–inertial hardware that accurately synchronizes accelerometer and gyroscope measurements with imagery. A comparison of both a stereo and monocular version of our algorithm with and without online extrinsics estimation is shown with respect to ground truth. Furthermore, we compare the performance to an implementation of a state-of-the-art stochastic cloning sliding-window filter. This competitive reference implementation performs tightly coupled filtering-based visual–inertial odometry. While our approach declaredly demands more computation, we show its superior performance in terms of accuracy.
QIN T , LI P L , SHEN S J . VINS-Mono: a robust and versatile monocular visual-inertial state estimator [J ] . IEEE Transactions on Robotics , 2018 , 34 ( 4 ): 1004 - 1020 . DOI: 10.1109/TRO.8860 http://doi.org/10.1109/TRO.8860 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=8860 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=8860
LI P L , QIN T , HU B T , et al . Monocular visual-inertial state estimation for mobile augmented reality [C ] //Proceedings of IEEE International Symposium on Mixed and Augmented Reality. Nantes , France : IEEE , 2017 : 11 - 21 .
QIN T , PAN J , CAO S Z , et al . A general optimization-based framework for local odometry estimation with multiple sensors:arXiv:1901.03638 [R/OL ] . Ithaca, NY , US : Cornell University , 2019 . (2019-01-11). https://arxiv.org/abs/1901.03638 https://arxiv.org/abs/1901.03638 https://arxiv.org/abs/1901.03638
曹力科 , 肖晓辉 . 基于卷帘快门RGB-D相机的视觉惯性SLAM方法 [J ] . 机器人 , 2021 , 43 ( 2 ): 193 - 202 . DOI: 10.13973/j.cnki.robot.200245 http://doi.org/10.13973/j.cnki.robot.200245 针对当前单目视觉惯性SLAM(同步定位与地图创建)中初始化需要加速度激励以及高IMU(惯性测量单元)噪声条件下系统精度下降的问题,提出一种基于卷帘快门RGB-D相机的视觉惯性SLAM方法——VINS-RSD方法.VINS-RSD方法联合卷帘快门RGB-D图像和IMU对系统进行初始化,通过控制特征的速度对卷帘快门效应进行校正,并采用一种带置信因子的损失核函数进行滑动窗口优化.为了评测该方法,在WHU-RSVI数据集的基础上制作了一个可以评价RGB-D视觉惯性SLAM算法的开源深度数据集并进行实验验证.结果表明,与VINS-Mono方法相比,VINS-RSD方法的均方根误差平均值下降了30.76%,表明该方法能获得更高的跟踪精度.
CAO L K , XIAO X H . A visual-inertial SLAM method based on rolling shutter RGB-D cameras [J ] . Robot , 2021 , 43 ( 2 ): 193 - 202 . (in Chinese) DOI: 10.13973/j.cnki.robot.200245 http://doi.org/10.13973/j.cnki.robot.200245 For the current monocular visual-inertial SLAM (simultaneous localization and mapping) systems, the acceleration excitation is necessary, and the system accuracy will decrease in the case of high IMU (inertial measurement unit) noises. To solve those problems, a visual-inertial SLAM method based on rolling shutter RGB-D cameras is proposed, named VINS-RSD method, which combines rolling shutter RGB-D image and IMU to initialize the system. The rolling shutter effect is corrected by controlling the feature velocity, and a loss kernel function with confidence factor is applied to the sliding window optimization. An open-source depth dataset extended from WHU-RSVI dataset is developed to evaluate the RGB-D visual-inertial SLAM method. Experiments are performed on the dataset and the root mean square error of VINS-RSD method is reduced by 30.76% compared to VINS-Mono (monocular visual-inertial system) method, which demonstrates that the proposed method can achieve a higher tracking accuracy.
WEN S H , LIU X , ZHANG H , et al . Dense point cloud map construction based on stereo VINS for mobile vehicles [J ] . ISPRS Journal of Photogrammetry and Remote Sensing , 2021 , 178 : 328 - 344 . DOI: 10.1016/j.isprsjprs.2021.06.009 http://doi.org/10.1016/j.isprsjprs.2021.06.009 https://linkinghub.elsevier.com/retrieve/pii/S0924271621001672 https://linkinghub.elsevier.com/retrieve/pii/S0924271621001672
LIU T A , LIN H Y , LIN W Y . InertialNet: Toward robust SLAM via visual inertial measurement [C ] //Proceedings of IEEE Intelligent Transportation Systems Conference . Auckland, New Zealand : IEEE , 2019 : 1311 - 1316 .
KIM Y , YOON S , KIM S , et al . Unsupervised balanced covariance learning for visual-inertial sensor fusion [J ] . IEEE Robotics and Automation Letters , 2021 , 6 ( 2 ): 819 - 826 . DOI: 10.1109/LSP.2016. http://doi.org/10.1109/LSP.2016. https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=7083369 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=7083369
FU Q , WANG J L , YU H S , et al . PL-VINS: real-time monocular visual-inertial SLAM with point and line: ArXiv:2009.07462 [R/OL ] . Ithaca, NY , US : Cornell University , 2020 (2020-9-16). https://arxiv.org/abs/2009.07462. https://arxiv.org/abs/2009.07462 https://arxiv.org/abs/2009.07462
ZHANG J , KAESS M , SINGH S . Real-time depth enhanced monocular odometry [C ] //Proceedings of 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems. Chicago, IL , US : IEEE , 2014 : 4973 - 4980 .
CAMURRI M , RAMEZANI M , NOBILI S , et al . Pronto: a multi-sensor state estimator for legged robots in real world scenarios [J ] . Frontiers in Robotics and AI , 2020 , 7 : 68 . DOI: 10.3389/frobt.2020.00068 http://doi.org/10.3389/frobt.2020.00068 https://www.frontiersin.org/article/10.3389/frobt.2020.00068/full https://www.frontiersin.org/article/10.3389/frobt.2020.00068/full
SHAO W Z , VIJAYARANGAN S , LI C , et al . Stereo visual inertial LiDAR simultaneous localization and mapping [C ] //Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. Macau , China : IEEE , 2019 : 370 - 377 .
SHAN T X , ENGLOT B , RATTI C , et al . LVI-SAM: tightly-coupled lidar-visual-inertial odometry via smoothing and mapping [C ] //Proceedings of IEEE International Conference on Robotics and Automation. Xi’an , China : IEEE , 2021 : 5692 - 5698 .
WISTH D , CAMURRI M , DAS S , et al . Unified multi-modal landmark tracking for tightly coupled lidar-visual-inertial odometry [J ] . IEEE Robotics and Automation Letters , 2021 , 6 ( 2 ): 1004 - 1011 . DOI: 10.1109/LSP.2016. http://doi.org/10.1109/LSP.2016. https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=7083369 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=7083369
LEE W , ECKENHOFF K , GENEVA P , et al . Intermittent GPS-aided VIO: online initialization and calibration [C ] //Proceedings of IEEE International Conference on Robotics and Automation. Paris , France : IEEE , 2020 : 5724 - 5731 .
CAO S Z , LU X Y , SHEN S J . GVINS: tightly coupled GNSS-visual-inertial fusion for smooth and consistent state estimation [J ] . IEEE Transactions on Robotics , 2022 , 38 ( 4 ): 2004 - 2021 . DOI: 10.1109/TRO.2021.3133730 http://doi.org/10.1109/TRO.2021.3133730 https://ieeexplore.ieee.org/document/9667780/ https://ieeexplore.ieee.org/document/9667780/
YODER J E , IANNUCCI P A , NARULA L , et al . Multi-antenna vision-and-inertial-aided CDGNSS for micro aerial vehicle pose estimation [C ] //Proceedings of the 33rd International Technical Meeting of the Satellite Division of The Institute of Navigation. Manassas, VA , US : The Institute of Navigation , 2020 : 2281 - 2298 .
LI T , ZHANG H P , GAO Z Z , et al . Tight fusion of a monocular camera, MEMS-IMU, and single-frequency multi-GNSS RTK for precise navigation in GNSS-challenged environments [J ] . Remote Sensing , 2019 , 11 ( 6 ): 610 . DOI: 10.3390/rs11060610 http://doi.org/10.3390/rs11060610 https://www.mdpi.com/2072-4292/11/6/610 https://www.mdpi.com/2072-4292/11/6/610 Precise position, velocity, and attitude is essential for self-driving cars and unmanned aerial vehicles (UAVs). The integration of global navigation satellite system (GNSS) real-time kinematics (RTK) and inertial measurement units (IMUs) is able to provide high-accuracy navigation solutions in open-sky conditions, but the accuracy will be degraded severely in GNSS-challenged environments, especially integrated with the low-cost microelectromechanical system (MEMS) IMUs. In order to navigate in GNSS-denied environments, the visual–inertial system has been widely adopted due to its complementary characteristics, but it suffers from error accumulation. In this contribution, we tightly integrate the raw measurements from the single-frequency multi-GNSS RTK, MEMS-IMU, and monocular camera through the extended Kalman filter (EKF) to enhance the navigation performance in terms of accuracy, continuity, and availability. The visual measurement model from the well-known multistate constraint Kalman filter (MSCKF) is combined with the double-differenced GNSS measurement model to update the integration filter. A field vehicular experiment was carried out in GNSS-challenged environments to evaluate the performance of the proposed algorithm. Results indicate that both multi-GNSS and vision contribute significantly to the centimeter-level positioning availability in GNSS-challenged environments. Meanwhile, the velocity and attitude accuracy can be greatly improved by using the tightly-coupled multi-GNSS RTK/INS/Vision integration, especially for the yaw angle.
WANG J Z , LI L L , YU H , et al . VIMO: avisual-inertial-magnetic navigation system based on non-linear optimizations [J ] . Sensors , 2020 , 20 ( 16 ): 4386 . DOI: 10.3390/s20164386 http://doi.org/10.3390/s20164386 https://www.mdpi.com/1424-8220/20/16/4386 https://www.mdpi.com/1424-8220/20/16/4386 Visual-inertial navigation systems are credited with superiority over both pure visual approaches and filtering ones. In spite of the high precision many state-of-the-art schemes have attained, yaw remains unobservable in those systems all the same. More accurate yaw estimation not only means more accurate attitude calculation but also leads to better position estimation. This paper presents a novel scheme that combines visual and inertial measurements as well as magnetic information for suppressing deviation in yaw. A novel method for initializing visual-inertial-magnetic odometers, which recovers the directions of magnetic north and gravity, the visual scalar factor, inertial measurement unit (IMU) biases etc., has been conceived, implemented, and validated. Based on non-linear optimization, a magnetometer cost function is incorporated into the overall optimization objective function as a yawing constraint among others. We have done extensive research and collected several datasets recorded in large-scale outdoor environments to certify the proposed system’s viability, robustness, and performance. Cogent experiments and quantitative comparisons corroborate the merits of the proposed scheme and the desired effect of the involvement of magnetic information on the overall performance.
LIU S Q , LI M H , LIN R , et al . Tightly coupled algorithm of visual inertial odometry and magnetometer fusion [C ] //Proceedings of IEEE 5th Information Technology and Mechatronics Engineering Conference . Chongqing, China : IEEE , 2020 : 330 - 335 .
HASHEMIFAR Z S , ADHIVARAHAN C , BALAKRISHNAN A , et al . Augmenting visual SLAM with Wi-Fi sensing for indoor applications [J ] . Autonomous Robots , 2019 , 43 ( 8 ): 2245 - 2260 . DOI: 10.1007/s10514-019-09874-z http://doi.org/10.1007/s10514-019-09874-z Recent trends have accelerated the development of spatial applications on mobile devices and robots. These include navigation, augmented reality, human-robot interaction, and others. A key enabling technology for such applications is the understanding of the device's location and the map of the surrounding environment. This generic problem, referred to as Simultaneous Localization and Mapping (SLAM), is an extensively researched topic in robotics. However, visual SLAM algorithms face several challenges including perceptual aliasing and high computational cost. These challenges affect the accuracy, efficiency, and viability of visual SLAM algorithms, especially for long-term SLAM, and their use in resource-constrained mobile devices. A parallel trend is the ubiquity of Wi-Fi routers for quick Internet access in most urban environments. Most robots and mobile devices are equipped with a Wi-Fi radio as well. We propose a method to utilize Wi-Fi received signal strength to alleviate the challenges faced by visual SLAM algorithms. To demonstrate the utility of this idea, this work makes the following contributions: (i) We propose a generic way to integrate Wi-Fi sensing into visual SLAM algorithms, (ii) We integrate such sensing into three well-known SLAM algorithms, (iii) Using four distinct datasets, we demonstrate the performance of such augmentation in comparison to the original visual algorithms and (iv) We compare our work to Wi-Fi augmented FABMAP algorithm. Overall, we show that our approach can improve the accuracy of visual SLAM algorithms by 11% on average and reduce computation time on average by 15% to 25%.
JIA Y P , LUO H Y , ZHAO F , et al . Lvio-Fusion: aself-adaptive multi-sensor fusion SLAM framework using actor-critic method [C ] //Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems . Prague, Czech Republic : IEEE , 2021 : 286 - 293 .
彭富清 . 海洋重力辅助导航方法及应用 [D ] . 郑州 : 战略支援部队信息工程大学 , 2009 .
PENG F Q . Marine gravity aided navigation methods with their applications [D ] . Zhengzhou : Information Engineering University , 2009 . (in Chinese)
褚金奎 , 张然 , 王志文 , 等 . 仿生偏振光导航传感器研究进展 [J ] . 科学通报 , 2016 , 61 ( 23 ): 2568 - 2577 .
CHU J K , ZHANG R , WANG Z W , et al . Progress on bio-inspired polarized skylight navigation sensor [J ] . Chinese Science Bulletin , 2016 , 61 ( 23 ): 2568 - 2577 . (in Chinese)
高隽 , 范之国 . 仿生偏振光导航方法 [M ] . 北京 : 科学出版社 , 2014 .
GAO J , FAN Z G . Method of bionic polarized skylight navigation [M ] . Beijing : Science Press , 2014 . (in Chinese)
褚金奎 , 张钟元 , 张然 , 等 . 仿生偏振探测技术及导航传感器应用 [J ] . 计测技术 , 2021 , 41 ( 5 ): 23 - 33 .
CHU J K , ZHANG Z Y , ZHANG R , et al . Bio-inspired polarization detection technology and navigation sensor applications [J ] . Metrology & Measurement Technology , 2021 , 41 ( 5 ): 23 - 33 . (in Chinese)
ZHAO H J , XU W J , ZHANG Y , et al . Polarization patterns under different sky conditions and a navigation method based on the symmetry of the AOP map of skylight [J ] . Optics Express , 2018 , 26 ( 22 ): 28589 - 28603 . DOI: 10.1364/OE.26.028589 http://doi.org/10.1364/OE.26.028589 The polarization states of a skylight can be used for navigation by a lot of insects as well as by human beings. However, the polarization patterns of skylight are greatly influenced by the atmospheric conditions. This paper studied the polarization patterns of skylight under different sky conditions by polarized imaging measurements, in which the AOT (Aerosol Optical Thickness) and clouds were taken into account. The results showed that both the aerosol and cloud disturbed the polarization patterns of the skylight, but the patterns of AOP (Angle of Polarization) showed great robustness. The symmetry of the AOP images was found to be quite steady under most of the sky conditions. We proposed a navigation method by finding out the solar meridian according to the symmetry of an AOP map. The results showed that the solar meridian can be identified accurately under different situations. The calculation errors slightly fluctuated along with the aerosol and cloud.
FRISCH K V . Die polarisation des himmelslichtes als orientierender faktor bei den tänzen der bienen [J ] . Experientia , 1949 , 5 ( 4 ): 142 - 148 . DOI: 10.1007/BF02174424 http://doi.org/10.1007/BF02174424
LABHART T . Polarization-opponent interneurons in the insect visual system [J ] . Nature , 1988 , 331 : 435 - 437 . DOI: 10.1038/331435a0 http://doi.org/10.1038/331435a0
DACKE M , NILSSON D-E , SCHOLTZ C H , et al . Insect orientation to polarized moonlight [J ] . Nature , 2003 , 424 : 33 - 34 .
MAPPES M . Polarization vision: behavioral studies in tethered flying desert locusts, Schistocerca gregaria [D ] . Marburg , Germany : Philipps-Universität Marburg , 2006 .
REPPERT S M , ZHU H , WHITE R H . Polarized light helps monarch butterflies navigate [J ] . Current Biology , 2003 , 14 ( 2 ): 155 - 158 . DOI: 10.1016/j.cub.2003.12.034 http://doi.org/10.1016/j.cub.2003.12.034 https://linkinghub.elsevier.com/retrieve/pii/S0960982203009540 https://linkinghub.elsevier.com/retrieve/pii/S0960982203009540
蔡宇 . 微阵列式光罗盘误差建模与补偿 [D ] . 长沙 : 国防科技大学 , 2018 .
CAI Y . Error modeling and compensation of bio-inspired polarization compass [D ] . Changsha : National University of Defence Technology , 2018 . (in Chinese)
LAMBRINOS D , KOBAYASHI H , PFEIFER R , et al . An autonomous agent navigating with a polarized light compass [J ] . Adaptive Behavior , 1997 , 6 ( 1 ): 131 - 161 . DOI: 10.1177/105971239700600104 http://doi.org/10.1177/105971239700600104 http://journals.sagepub.com/doi/10.1177/105971239700600104 http://journals.sagepub.com/doi/10.1177/105971239700600104 One of the fundamental abilities required in autonomous agents is homing. Natural agents—for instance, desert ants—solve the homing problem mainly by using path integration within an egocentric frame of reference. When employing such a mechanism, compass information for determining direction is necessary, and the precision of the compass will have a crucial effect on the precision of homing. For deriving compass information, certain insects use the pattern of polarized light in the sky that arises due to scattering of sunlight in the atmosphere (polarized light compass). The analysis of skylight polarization is mediated by specialized photoreceptors and neurons in the visual system. Inspired by the insect's polarized light compass, we have constructed a polarization compass that was employed successfully on the mobile robot Sahabot. Three models for extracting compass information from the polarization pattern of the sky were tested. In this article, we describe the navigation system and report results of experiments performed with the Sahabot in one of the natural habitats of the desert ant Cataglyphis in North Africa.
SCHMOLKE A , MALLOT H A . Polarization compass for robot navigation [C ] //Proceedings of the Fifth German Workshop on Artificial Life. Lübeck , Germany : IOS Press , 2002 : 163 - 167 .
CHAHL J , MIZUTANI A . Biomimetic attitude and orientation sensors [J ] . IEEE Sensors Journal , 2012 , 12 ( 2 ): 289 - 297 . DOI: 10.1109/JSEN.2010.2078806 http://doi.org/10.1109/JSEN.2010.2078806 http://ieeexplore.ieee.org/document/5585652/ http://ieeexplore.ieee.org/document/5585652/
EXPERT F , RUFFIER F . Flying over uneven moving terrain based on optic-flow cues without any need for reference frames or accelerometers [J ] . Bioinspiration & Biomimetics , 2015 , 10 ( 2 ): 026003 .
DUPEYROUX J , SERRES J R , VIOLLET S . AntBot: a six-legged walking robot able to home like desert ants in outdoor environments [J ] . Science Robotics , 2019 , 4 ( 27 ): eaau 0307.
褚金奎 , 关传泷 , 刘泽 , 等 . 一种高度集成化的仿生偏振导航传感器 [J ] . 微纳电子技术 , 2020 , 57 ( 3 ): 193 - 197 .
CHU J K , GUAN C L , LIU Z , et al . A highly integrated bionic polarization navigation sensor [J ] . Micronanoelectronic Technology , 2020 , 57 ( 3 ): 193 - 197 . (in Chinese)
FAN C , HU X P , LIAN J X , et al . Design and calibration of a novel camera-based bio-inspired polarization navigation sensor [J ] . IEEE Sensors Journal , 2016 , 16 ( 10 ): 3640 - 3648 . DOI: 10.1109/JSEN.2016.2533628 http://doi.org/10.1109/JSEN.2016.2533628 http://ieeexplore.ieee.org/document/7416144/ http://ieeexplore.ieee.org/document/7416144/
韩国良 , 胡小平 , 何晓峰 , 等 . 基于像素化偏振芯片的仿生偏振光罗盘技术 [J ] . 导航定位与授时 , 2020 , 7 ( 4 ): 19 - 25 .
HAN G L , HU X P , HE X F , et al . A technology about bionic polarized light compass based on pixelated polarizing chip [J ] . Navigation Positioning & Timing , 2020 , 7 ( 4 ): 19 - 25 . (in Chinese)
白杨 , 赵开春 , 尤政 . 分焦平面偏振图像传感器偏振主轴方向的标定 [J ] . 光学精密工程 , 2022 , 30 ( 1 ): 31 - 37 .
BAI Y , ZHAO K C , YOU Z . Calibration of polarization axis direction of sub focal plane polarization image sensor [J ] . Optics and Precision Engineering , 2022 , 30 ( 1 ): 31 - 37 . (in Chinese) DOI: 10.37188/OPE.20223001.0031 http://doi.org/10.37188/OPE.20223001.0031 http://ope.lightpublishing.cn/thesisDetails#10.37188/OPE.20223001.0031 http://ope.lightpublishing.cn/thesisDetails#10.37188/OPE.20223001.0031
韩勇 , 赵开春 , 尤政 . 快速旋转式偏振成像探测装置的设计 [J ] . 光学精密工程 , 2018 , 26 ( 10 ): 2345 - 2354 .
HAN Y , ZHAO K C , YOU Z . Development of rapid rotary polarization imaging detection devices [J ] . Optics and Precision Engineering , 2018 , 26 ( 10 ): 2345 - 2354 . (in Chinese) DOI: 10.3788/OPE. http://doi.org/10.3788/OPE. http://www.opticsjournal.net/Journals/gxjmgc.htm http://www.opticsjournal.net/Journals/gxjmgc.htm
CHEN W , YAN L , CHANDRASEKAR V . Optical polarization remote sensing [J ] . International Journal of Remote Sensing , 2020 , 41 ( 13 ): 4849 - 4852 . DOI: 10.1080/01431161.2020.1743529 http://doi.org/10.1080/01431161.2020.1743529 https://www.tandfonline.com/doi/full/10.1080/01431161.2020.1743529 https://www.tandfonline.com/doi/full/10.1080/01431161.2020.1743529
杨中光 . 基于自然偏振特性的卫星自主导航技术研究 [D ] . 西安 : 西北工业大学 , 2018 .
YANG Z G . Satellite autonomous navigation technology research based on skylight polarization characteristic [D ] . Xi’an : Northwestern Polytechnical University , 2018 . (in Chinese)
钟振兴 , 马晓波 , 安巍 . 基于地基云图与气象数据的辐照度轻量化预测 [J ] . 东北电力大学学报 , 2021 , 41 ( 1 ): 24 - 30 .
ZHONG Z X , MA X B , AN W . A lightweight solar irradiance prediction model based on ground-based cloud images and meteorological data [J ] . Journal of Northeast Electric Power University , 2021 , 41 ( 1 ): 24 - 30 . (in Chinese)
BUCHOLTZ A . Rayleigh-scattering calculations for the terrestrial atmosphere [J ] . Applied Optics , 1995 , 34 ( 15 ): 2765 - 2773 . DOI: 10.1364/AO.34.002765 http://doi.org/10.1364/AO.34.002765 Rayleigh-scattering cross sections and volume-scattering coefficients are computed for standard air; they incorporate the variation of the depolarization factor with wavelength. Rayleigh optical depths are then calculated for the 1962 U.S. Standard Atmosphere and for five supplementary models. Analytic formulas are derived for each of the parameters listed. The new optical depths can be 1.3% lower to 3% higher at midvisible wavelengths and up to 10% higher in the UV region compared with previous calculations, in which a constant or incorrect depolarization factor was used. The dispersion of the depolarization factor is also shown to affect the Rayleigh phase function slightly, by approximately 1% in the forward, backscattered, and 90° scattering-angle directions.
HANNAY J H . Polarization of sky light from a canopy atmosphere [J ] . New Journal of Physics , 2004 , 6 ( 1 ): 197 . DOI: 10.1088/1367-2630/6/1/197 http://doi.org/10.1088/1367-2630/6/1/197 https://iopscience.iop.org/article/10.1088/1367-2630/6/1/197 https://iopscience.iop.org/article/10.1088/1367-2630/6/1/197
吴良海 , 张骏 , 范之国 , 等 . 多次散射因素影响下天空偏振光模式的解析模型 [J ] . 物理学报 , 2014 , 63 ( 11 ): 218 - 225 .
WU L H , ZHANG J , FAN Z G , et al . An analytical model for skylight polarization pattern with multiple scattering [J ] . Acta Pyhsica sinica , 2014 , 63 ( 11 ): 218 - 225 . (in Chinese)
崔岩 , 陈小龙 , 褚金奎 , 等 . 晴朗天气下满月偏振模式的研究 [J ] . 光学学报 , 2014 , 34 ( 10 ): 147 - 155 .
CUI Y , CHEN X L , CHU J K , et al . Study on polarization pattern of full moonlight in clear sky [J ] . Acta Optica sinica , 2014 , 34 ( 10 ): 147 - 155 . (in Chinese)
褚金奎 , 田连标 , 成昊远 , 等 . 天空光主导的波浪水面下偏振分布模型仿真 [J ] . 光学学报 , 2020 , 40 ( 20 ): 18 - 25 .
CHU J K , TIAN L B , CHENG H Y , et al . Simulation of polarization distribution model under wavy water surfaces dominated by skylight [J ] . Acta Optica sinica , 2020 , 40 ( 20 ): 18 - 25 . (in Chinese)
汪先球 . 大气偏振模式的显著特征分析与建模方法研究 [D ] . 合肥 : 合肥工业大学 , 2021 .
WANG X Q . Research on salient characteristic analysis and modeling method of polarized skylight pattern [D ] . Hefei : Hefei University of Technology , 2021 . (in Chinese)
KATTAWAR G W , PLASS G N . Radiance and polarization of multiple scattered light from haze and clouds [J ] . Applied optics , 1968 , 7 ( 8 ): 1519 - 1527 . DOI: 10.1364/AO.7.001519 http://doi.org/10.1364/AO.7.001519 The radiance and polarization of multiple scattered light is calculated from the Stokes' vectors by a Monte Carlo method. The exact scattering matrix for a typical haze and for a cloud whose spherical drops have an average radius of 12 mu is calculated from the Mie theory. The Stokes' vector is transformed in a collision by this scattering matrix and the rotation matrix. The two angles that define the photon direction after scattering are chosen by a random process that correctly simulates the actual distribution functions for both angles. The Monte Carlo results for Rayleigh scattering compare favorably with well known tabulated results. Curves are given of the reflected and transmitted radiances and polarizations for both the haze and cloud models and for several solar angles, optical thicknesses, and surface albedos. The dependence on these various parameters is discussed.
BERRY M V , DENNIS M R , LEE JR R L . Polarization singularities in the clear sky [J ] . New Journal of Physics , 2004 , 6 ( 1 ): 162 . DOI: 10.1088/1367-2630/6/1/162 http://doi.org/10.1088/1367-2630/6/1/162 https://iopscience.iop.org/article/10.1088/1367-2630/6/1/162 https://iopscience.iop.org/article/10.1088/1367-2630/6/1/162
BURAS R , MAYER B . Efficient unbiased variance reduction techniques for Monte Carlo simulations of radiative transfer in cloudy atmospheres: the solution [J ] . Journal of Quantitative Spectroscopy & Radiative Transfer , 2011 , 112 ( 3 ): 434 - 447 .
王威 , 褚金奎 , 崔岩 , 等 . 基于矢量辐射传输的大气偏振建模 [J ] . 中国激光 , 2013 , 40 ( 5 ): 220 - 226 .
WANG W , CHU J K , CUI Y , et al . Modeling of atmospheric polarization pattern based on vector radiative transfer [J ] . Chinese Journal of Lasers , 2013 , 40 ( 5 ): 220 - 226 . (in Chinese)
王子谦 , 张旭东 , 金海红 , 等 . 基于Monte Carlo方法的混浊大气偏振模式全天域建模 [J ] . 中国激光 , 2014 , 41 ( 10 ): 219 - 227 .
WANG Z Q , ZHANG X D , JIN H H , et al . All sky turbid atmospheric polarization pattern modeling based on Monte Carlo method [J ] . Chinese Journal of Lasers , 2014 , 41 ( 10 ): 219 - 227 . (in Chinese)
蒋睿 , 王霞 , 左一凡 , 等 . 基于局部大气偏振特性的仿生导航方法 [J ] . 航空学报 , 2020 , 30 ( 增刊2 ): 724293 .
JIANG R , WANG X , ZUO Y F , et al . Bionic navigation based on local atmospheric polarization [J ] . Acta Aeronautica et Astronautica Sinica , 2020 , 30 ( S2 ): 724293 . (in Chinese)
田柳 , 高隽 , 范之国 , 等 . 基于大气偏振模式分布规律的导航方向角计算方法 [J ] . 电子学报 , 2012 , 40 ( 1 ): 141 - 146 . DOI: 10.3969/j.issn.0372-2112.2012.01.023 http://doi.org/10.3969/j.issn.0372-2112.2012.01.023 针对已有仿生偏振光导航方法中,根据局部天空区域的偏振信息获取导航信息存在的缺陷,提出一种基于大气偏振模式分布规律的导航方向角计算方法.该方法利用大气偏振模式的对称性定义了偏振响应和函数,根据大气偏振模式有限采样点的偏振信息,拟合估计出太阳子午线位置,并最终获取导航方向角信息,最后通过多组观测时刻、多组观测地点的仿真实验,验证了基于大气偏振模式分布规律的导航方向角计算方法的有效性.
TIAN L , GAO J , FAN Z G , et al . The method of the navigation direction angle calculation with the distribution of the atmospheric polarization pattern [J ] . Acta Electronica Sinica , 2012 , 40 ( 1 ): 141 - 146 . (in Chinese) DOI: 10.3969/j.issn.0372-2112.2012.01.023 http://doi.org/10.3969/j.issn.0372-2112.2012.01.023 For the disadvantages of the existing method of bionic polarization navigation,that calculates the navigation direction angle based on the polarization information of the local sky region,a method is proposed to calculate the navigation direction angle based on the symmetrical distribution of the atmospheric polarization mode.The function of polarization response sum is defined according to the symmetry of the atmosphere polarization mode,a finite number of sampling points of the atmospheric polarization are acquired to calculate the position of the solar meridian and to determine the navigation direction angle.The corresponding validation experiment is also given to test the method of navigation direction angle calculation using the symmetry of the atmospheric polarization distribution mode.
崔岩 , 周鑫昌 , 刘亚飞 , 等 . 基于Hough变换的太阳子午线提取方法 [J ] . 光学学报 , 2020 , 40 ( 17 ): 14 - 20 .
CUI Y , ZHOU X C , LIU Y F , et al . Solar meridian extraction method based on Hough transformation [J ] . Acta Optica Sinica , 2020 , 40 ( 17 ): 14 - 20 . (in Chinese)
任建斌 . 仿生偏振光导航中信息获取及姿态解算方法研究 [D ] . 太原 : 中北大学 , 2015 .
REN J B . Study on the data processing and attitude control for bio-inspired polarized-light-aided navigation [D ] . Taiyuan : North University of China , 2015 . (in Chinese)
赵成帅 , 吴新冬 , 赵东花 , 等 . 一种基于改进太阳子午线拟合方法的仿生偏振光定向系统 [J ] . 导航定位与授时 , 2021 , 8 ( 4 ): 68 - 74 .
ZHAO C S , WU X D , ZHAO D H , et al . A bionic polarized light orientation system based on improved solar meridian fitting method [J ] . Navigation Positioning & Timing , 2021 , 8 ( 4 ): 68 - 74 . (in Chinese)
褚金奎 , 关乐 , 李世奇 , 等 . 大气偏振模式图分布及仿生偏振导航技术 [J ] . 遥感学报 , 2018 , 22 ( 6 ): 969 - 679 .
CHU J K , GUAN L , LI S Q , et al . Atmospheric polarization field pattern distribution and polarization navigation technology [J ] . Journal of Remote Sensing , 2018 , 22 ( 6 ): 969 - 679 . (in Chinese)
KONG X L , WU W Q , ZHANG L L , et al . Performance improvement of visual-inertial navigation system by using polarized light compass [J ] . Industrial Robot—The International Journal of Robotics Research and Application , 2016 , 43 ( 6 ): 588 - 595 . DOI: 10.1108/IR-03-2016-0103 http://doi.org/10.1108/IR-03-2016-0103 https://www.emerald.com/insight/content/doi/10.1108/IR-03-2016-0103/full/html https://www.emerald.com/insight/content/doi/10.1108/IR-03-2016-0103/full/html This paper aims to present a method for improving the performance of the visual-inertial navigation system (VINS) by using a bio-inspired polarized light compass.
XIAN Z W , HE X F , LIAN J X , et al . A bionic autonomous navigation system by using polarization navigation sensor and stereo camera [J ] . Autonomous Navigation , 2017 , 41 ( 5 ): 1107 - 1118 .
WANG Y J , HU X P , ZHANG L L , et al . Polarized light compass-aided visual-inertial navigation under foliage environment [J ] . IEEE Sensors Journal , 2017 , 17 ( 17 ): 5646 - 5653 . DOI: 10.1109/JSEN.2017.2725938 http://doi.org/10.1109/JSEN.2017.2725938 http://ieeexplore.ieee.org/document/7974755/ http://ieeexplore.ieee.org/document/7974755/
FAN C , HU X P , HE X F , et al . Integrated polarized skylight sensor and MIMU with a metric map for urban ground navigation [J ] . IEEE Sensors Journal , 2018 , 18 ( 4 ): 1747 - 1722 . DOI: 10.1109/JSEN.2017.2786294 http://doi.org/10.1109/JSEN.2017.2786294 http://ieeexplore.ieee.org/document/8234546/ http://ieeexplore.ieee.org/document/8234546/
ZHOU W Z , FAN C , HE X F , et al . Integrated bionic polarized vision/VINS for goal-directed navigation and homing in unmanned ground vehicle [J ] . IEEE Sensors Journal , 2021 , 21 ( 10 ): 11232 - 11241 . DOI: 10.1109/JSEN.2021.3066844 http://doi.org/10.1109/JSEN.2021.3066844 https://ieeexplore.ieee.org/document/9380405/ https://ieeexplore.ieee.org/document/9380405/
XIA L L , LIU R M , ZHANG D C , et al . Polarized light-aided visual-inertial navigation system: global heading measurements and graph optimization based multi-sensor fusion [J ] . Measurement Science and Technology , 2022 , 33 ( 5 ): 055111 . DOI: 10.1088/1361-6501/ac4637 http://doi.org/10.1088/1361-6501/ac4637 Polarized skylight is as fundamental a constituent of passive navigation as the geomagnetic field. With regard to its applicability to outdoor robot localization, a polarized light-aided visual-inertial navigation system (VINS) modelization dedicated to globally optimized pose estimation and heading correction is constructed. The combined system follows typical visual simultaneous localization and mapping (SLAM) frameworks, and we propose a methodology to fuse global heading measurements with visual and inertial information in a graph optimization-based estimator. With ideas of‘adding new attributes of graph vertices and creating heading error-encoded constraint edges’, the heading, as the absolute orientation reference, is estimated by the Berry polarization model and continuously updated in a graph structure. The formulized graph optimization process for multi-sensor fusion is simultaneously provided. In terms of campus road experiments on the Bulldog-CX robot platform, the results are compared against purely stereo camera-dependent and VINS Fusion frameworks, revealing that our design is substantially more accurate than others with both locally and globally consistent position and attitude estimates. As a passive and tightly coupled navigation mode, the polarized light-aided VINS can therefore be considered as a tool candidate for a class of visual SLAM-based multi-sensor fusion.
李昊天 , 张宇 . 改进的D-S证据推理地图匹配算法 [J ] . 东北电力大学学报 , 2020 , 40 ( 1 ): 90 - 96 .
LI H T , ZHANG Y . Improved D-S evidence reasoning map matching algorithm [J ] . Journal of Northeast Electric Power University , 2020 , 40 ( 1 ): 90 - 96 . (in Chinese)
张少将 . 基于多传感器信息融合的智能车定位导航系统研究 [D ] . 哈尔滨 : 哈尔滨工业大学 , 2020 .
ZHANG S J . Research on multi-sensor information fusion based localization and navigation system for intelligent vehicle [D ] . Harbin : Harbin Institute of Technology , 2020 . (in Chinese)
张子茜 , 熊再立 , 张彪 , 等 . 基于超分辨率重建技术的遥感图像小目标检测 [J ] . 东北电力大学学报 , 2022 , 42 ( 2 ): 33 - 40 .
ZHANG Z Q , XIONG Z L , ZHANG B , et al . Detection for small target ship in remote sensing image based on super resolution reconstruction technology [J ] . Journal of Northeast Electric Power University , 2022 , 42 ( 2 ): 33 - 40 . (in Chinese)
DU T , ZENG Y H , YANG J , et al . Multi-sensor fusion SLAM approach for the mobile robot with a bio-inspired polarised skylight sensor [J ] . IET Radar Sonar and Navigation , 2020 , 14 ( 2 ): 1950 - 1957 . DOI: 10.1049/rsn2.v14.12 http://doi.org/10.1049/rsn2.v14.12 https://onlinelibrary.wiley.com/toc/17518792/14/12 https://onlinelibrary.wiley.com/toc/17518792/14/12
DU T , TIAN C Z , YANG J , et al . An autonomous initial alignment and observability analysis for SINS with bio-inspired polarized skylight sensors [J ] . IEEE Sensors Journal , 2020 , 20 ( 14 ): 7941 - 7956 . DOI: 10.1109/JSEN.7361 http://doi.org/10.1109/JSEN.7361 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=7361 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=7361
褚金奎 , 陈建华 , 李金山 , 等 . 一种偏振光/双目视觉仿生组合导航方法 [J ] . 光子学报 , 2021 , 50 ( 5 ): 192 - 201 .
CHU J K , CHEN J H , LI J S , et al . Polarized light/binocular vision bionic integrated navigation method [J ] . Acta Photonica Sinica , 2021 , 50 ( 5 ): 192 - 201 . (in Chinese) DOI: 10.3788/gzxb http://doi.org/10.3788/gzxb http://www.opticsjournal.net/Journals/gzxb.cshtml http://www.opticsjournal.net/Journals/gzxb.cshtml
褚金奎 , 武进 , 李金山 , 等 . 偏振光传感器在四旋翼飞行器中的应用 [J ] . 电子学报 , 2020 , 48 ( 1 ): 198 - 203 . DOI: 10.3969/j.issn.0372-2112.2020.01.024 http://doi.org/10.3969/j.issn.0372-2112.2020.01.024 为了实现偏振光传感器在实际三维空间中的导航应用,设计了一种基于仿生偏振光导航传感器、微惯性测量单元(MIMU)与全球定位系统(GPS)的组合导航控制系统,并实际应用到了四旋翼导航控制之中.本文首先介绍了偏振光传感器的功能模型和测角原理.其次采用扩展卡尔曼滤波(EKF)技术设计了偏振光传感器、MIMU、GPS的信息融合算法,通过室外飞行试验对该导航系统的性能进行了测试,并与传统MIMU/GPS/电子罗盘导航系统进行了比较.结果显示:在有磁场干扰环境下,基于偏振光的导航控制系统平均位置精度较传统导航系统提高了50.4%.实验结果表明:该导航控制系统实时性好、精度较高、抗电磁干扰能力强,且误差不随时间累积,基本满足移动载体进行自主导航时的精度和可靠性要求.
CHU J K , WU J , LI J S , et al . Application of polarization sensor in quadrotor helicopter [J ] . Acta Electronica Sinica , 2020 , 48 ( 1 ): 198 - 203 . (in Chinese)
曾云豪 , 杜涛 , 星艳 . 基于惯性/偏振光/光流的六足步行机器人自主导航方法研究 [J ] . 导航定位与授时 , 2020 , 7 ( 6 ): 102 - 108 .
ZENG Y H , DU T , XING Y . Research on autonomous navigation method of Hexapod walking robot based on inertial/polarization skylight/optical flow integrated navigation system [J ] . Navigation Positioning & Timing , 2020 , 7 ( 6 ): 102 - 108 . (in Chinese)
范晨 , 何晓峰 , 范颖 , 等 . 基于微惯性/偏振视觉的组合定向方法 [J ] . 中国惯性技术学报 , 2020 , 28 ( 2 ): 231 - 236 .
FAN C , HE X F , FAN Y , et al . Integrated orientation method based on the micro-inertial and polarized vision [J ] . Journal of Chinese Inertial Technology , 2020 , 28 ( 2 ): 231 - 236 . (in Chinese)
HE R G , HU X P , ZHANG L L , et al . A combination orientation compass based on the information of polarized skylight/geomagnetic/MIMU [J ] . IEEE Access , 2020 , 8 : 10879 - 10887 . DOI: 10.1109/Access.6287639 http://doi.org/10.1109/Access.6287639 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6287639 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6287639
HE X F , ZHANG L L , FAN C , et al . A MIMU/polarized camera/GNSS integrated navigation algorithm for UAV application [C ] //Proceedings of DGON Inertial Sensors and Systems. Braunschweig , Germany : IEEE , 2019 : 1 - 15 .
YUAN M Y , HE X F , HU X P , et al . Polarized skylight/MIMU/geomagnetic orientation algorithm based on adaptive Kalman filter [C ] //Proceedings of Chinese Automation Congress . Shanghai, China : IEEE , 2020 : 1645 - 1650 .
马伟 , 李沅 , 康健 , 等 . 基于联邦滤波的偏振光/SINS/BDS/地磁组合导航算法 [J ] . 传感器与微系统 , 2022 , 41 ( 2 ): 136 - 139 .
MA W , LI Y , KANG J , et al . Polarized light/ SINS/BDS/geomagnetic integrated navigation algorithm based on federated filtering [J ] . Transducer and Microsystem Technologies , 2022 , 41 ( 2 ): 136 - 139 . (in Chinese)
0
Views
1663
下载量
0
CNKI被引量
Publicity Resources
Related Articles
Related Author
Related Institution
京公网安备11010802024360号