MAO M , XIE F , HU J J , et al. Analysis of workload of tankcrew under the conditions of informatization [J ] . Defence Technology , 2014 , 10 ( 1 ): 17 - 21 . DOI: 10.1016/j.dt.2013.12.008 http://doi.org/10.1016/j.dt.2013.12.008 https://linkinghub.elsevier.com/retrieve/pii/S2214914713000597 https://linkinghub.elsevier.com/retrieve/pii/S2214914713000597

傅斌贺 , 刘维平 , 聂俊峰 , 等 . 考虑认知行为差异的乘员信息作业绩效研究 [J ] . 兵工学报 , 2019 , 40 ( 3 ): 659 - 665 . DOI: 10.3969/j.issn.1000-1093.2019.03.026 http://doi.org/10.3969/j.issn.1000-1093.2019.03.026 认知行为差异逐渐成为乘员信息作业绩效的主要影响因素，为提高乘员的信息作业绩效，开展了考虑认知行为差异的装甲车辆乘员信息作业绩效研究。基于任务-网络建模技术，构建了融合通道维度的乘员信息作业认知行为模型，以及乘员信息作业绩效预测模型。针对不同认知能力水平，进行了乘员信息作业绩效对比实验；通过对绩效数据的统计分析，得到了乘员认知能力与作业绩效之间的相关关系和影响规律。结果表明：乘员信息作业绩效预测结果与实验数据具有较好的一致性；乘员认知能力与信息作业绩效呈显著的正相关关系，乘员认知行为差异对信息作业绩效具有显著影响。建议装甲车辆乘员选拔应结合认知能力测评，并进行针对性训练和任务分工，可以提高乘员作业绩效，节约训练资源。

FU B H , LIU W P , NIE J F , et al. Research on crew’s information operation performance with the difference of cognitive behavior [J ] . Acta Armamentarii , 2019 , 40 ( 3 ): 659 - 665 . (in Chinese)

GLUMM M M , KEHRING K L , WHITE T L . Effects of multimodal displays about threat location on target acquisition and attention to visual and auditory communications: ARL-TR-4074 [R ] . Aberdeen Proving Ground, MD, US:U.S.Army Research Laboratory , 2007 : 20 - 26 .

ELLIOTT L R , SCHMEISSER E T , REDDENE S . Development of tactile and haptic systems for US infantry navigation and communication[C]//SMITH M J, SALVENDY G. Human Interface and the Management of Information. Interacting with Information . Orlando, FL, US:Springer , 2011 : 399 - 407 .

GRAY R , SPENCE C , HO C , et al. Efficient multimodal cuing of spatial attention [J ] . Proceedings of the IEEE , 2013 , 101 ( 9 ): 2113 - 2122 . DOI: 10.1109/JPROC.2012.2225811 http://doi.org/10.1109/JPROC.2012.2225811 http://ieeexplore.ieee.org/document/6403488/ http://ieeexplore.ieee.org/document/6403488/

ERNST M O , BULTHOOF H H . Merging the senses into a robust percept [J ] . Trends in Cognitive Sciences , 2004 , 8 ( 4 ): 162 - 169 . DOI: 10.1016/j.tics.2004.02.002 http://doi.org/10.1016/j.tics.2004.02.002 To perceive the external environment our brain uses multiple sources of sensory information derived from several different modalities, including vision, touch and audition. All these different sources of information have to be efficiently merged to form a coherent and robust percept. Here we highlight some of the mechanisms that underlie this merging of the senses in the brain. We show that, depending on the type of information, different combination and integration strategies are used and that prior knowledge is often required for interpreting the sensory signals.

SPENCE C , DRIVER J . Crossmodal space and crossmodal attention [M ] . New York, NY, US: Oxford University Press , 2004 : 148 - 156 .

HO C , SPENCE C . The multisensory driver:implications for ergonomic car interface design [M ] . London, UK: CRC Press , 2017 : 18 - 26 .

WICKENS C D . Multiple resources and performance prediction [J ] . Theoretical Issues in Ergonomics Science , 2002 , 3 ( 2 ): 159 - 177 . DOI: 10.1080/14639220210123806 http://doi.org/10.1080/14639220210123806 http://www.tandfonline.com/doi/abs/10.1080/14639220210123806 http://www.tandfonline.com/doi/abs/10.1080/14639220210123806

WICKENS C D . Multiple resources and mental workload [J ] . Human Factors , 2008 , 50 ( 3 ): 449 - 455 . The objective is to lay out the rationale for multiple resource theory and the particular 4-D multiple resource model, as well as to show how the model is useful both as a design tool and as a means of predicting multitask workload overload.I describe the discoveries and developments regarding multiple resource theory that have emerged over the past 50 years that contribute to performance and workload prediction.The article presents a history of the multiple resource concept, a computational version of the multiple resource model applied to multitask driving simulation data, and the relation of multiple resources to workload.Research revealed the importance of the four dimensions in accounting for task interference and the association of resources with brain structure. Multiple resource models yielded high correlations between model predictions and data. Lower correlations also identified the existence of additional resources.The model was shown to be partially relevant to the concept of mental workload, with greatest relevance to performance breakdowns related to dual-task overload. Future challenges are identified.The most important application of the multiple resource model is to recommend design changes when conditions of multitask resource overload exist.

WANG Y W , WU B H , MA S , et al. Effect of mapping characteristic on audiovisual warning:evidence from a simulated driving study [J ] . Applied Ergonomics , 2022 , 99 : 103638 . DOI: 10.1016/j.apergo.2021.103638 http://doi.org/10.1016/j.apergo.2021.103638 https://linkinghub.elsevier.com/retrieve/pii/S0003687021002854 https://linkinghub.elsevier.com/retrieve/pii/S0003687021002854

HUANG G J , PITTS B J . The effects of age and physical exercise on multimodal signal responses:implications for semi-autonomous vehicle takeover requests [J ] . Applied Ergonomics , 2022 , 98 : 103595 . DOI: 10.1016/j.apergo.2021.103595 http://doi.org/10.1016/j.apergo.2021.103595 https://linkinghub.elsevier.com/retrieve/pii/S0003687021002428 https://linkinghub.elsevier.com/retrieve/pii/S0003687021002428

LUNDQVIST L M , ERIKSSON L . Age, cognitive load, and multimodal effects on driver response to directional warning [J ] . Applied Ergonomics , 2019 , 76 : 147 - 154 . DOI: 10.1016/j.apergo.2019.01.002 http://doi.org/10.1016/j.apergo.2019.01.002 https://linkinghub.elsevier.com/retrieve/pii/S000368701930002X https://linkinghub.elsevier.com/retrieve/pii/S000368701930002X

OSKARSSON P A , ERIKSSON L , CARLANDER O . Enhanced perception and performance by multimodal threat cueing in simulated combat vehicle [J ] . Human Factors , 2012 , 54 ( 1 ): 122 - 137 . DOI: 10.1177/0018720811424895 http://doi.org/10.1177/0018720811424895 http://journals.sagepub.com/doi/10.1177/0018720811424895 http://journals.sagepub.com/doi/10.1177/0018720811424895 Objective: In a simulated combat vehicle, uni-, bi-, and trimodal cueing of direction to threat were compared with the purpose to investigate whether multisensory redundant information may enhance dynamic perception and performance.

VAN ERP J B F , ERIKSSON L , LEVIN B , et al. Tactile cueing effects on performance in simulated aerial combat with high acceleration [J ] . Aviation, Space, and Environmental Medicine , 2007 , 78 ( 12 ): 1128 - 1134 . Recent evidence indicates that vibrotactile displays can potentially reduce the risk of sensory and cognitive overload. Before these displays can be introduced in super agile aircraft, it must be ascertained that vibratory stimuli can be sensed and interpreted by pilots subjected to high G loads.Each of 9 pilots intercepted 32 targets in the Swedish Dynamic Flight Simulator. Targets were indicated on simulated standard Gripen visual displays. In addition, in half of the trials target direction was also displayed on a 60-element tactile torso display. Performance measures and subjective ratings were recorded.Each pilot pulled G peaks above +8 Gz. With tactile cueing present, mean reaction time was reduced from 1458 ms (SE = 54) to 1245 ms (SE = 88). Mean total chase time for targets that popped up behind the pilot's aircraft was reduced from 13 s (SE = 0.45) to 12 s (SE = 0.41). Pilots rated the tactile display favorably over the visual displays at target pop-up on the easiness of detecting a threat presence and on the clarity of initial position of the threats.This study is the first to show that tactile display information is perceivable and useful in hypergravity (up to +9 Gz). The results show that the tactile display can capture attention at threat pop-up and improve threat awareness for threats in the back, even in the presence of high-end visual displays. It is expected that the added value of tactile displays may further increase after formal training and in situations of unexpected target pop-up.

CALHOUN G L , FONTEGON J V , DRAPER M H , et al. Tactile versus aural redundant alert cues for UAV control applications[C]//Proceedings of the Human Factors and Ergonomics Society Annual Meeting . Los Angeles, CA, US: Sage Publications , 2004 , 48 ( 1 ): 137 - 141 .

NGO M K , PIERCE R S , SPENCE C . Using multisensory cues to facilitate air traffic management [J ] . Human Factors , 2012 , 54 ( 6 ): 1093 - 1103 . In the present study, we sought to investigate whether auditory and tactile cuing could be used to facilitate a complex, real-world air traffic management scenario.Auditory and tactile cuing provides an effective means of improving both the speed and accuracy of participants' performance in a variety of laboratory-based visual target detection and identification tasks.A low-fidelity air traffic simulation task was used in which participants monitored and controlled aircraft.The participants had to ensure that the aircraft landed or exited at the correct altitude, speed, and direction and that they maintained a safe separation from all other aircraft and boundaries. The performance measures recorded included en route time, handoff delay, and conflict resolution delay (the performance measure of interest). In a baseline condition, the aircraft in conflict was highlighted in red (visual cue), and in the experimental conditions, this standard visual cue was accompanied by a simultaneously presented auditory, vibrotactile, or audiotactile cue.Participants responded significantly more rapidly, but no less accurately, to conflicts when presented with an additional auditory or audiotactile cue than with either a vibrotactile or visual cue alone.Auditory and audiotactile cues have the potential for improving operator performance by reducing the time it takes to detect and respond to potential visual target events.These results have important implications for the design and use of multisensory cues in air traffic management.

李家文 , 成波 . 驾驶员疲劳状态适应式复合预警方法的研究 [J ] . 汽车工程 , 2012 , 34 ( 3 ): 211 - 216 .

LI J W , CHENG B . A study on the adaptive multiple warnings scheme for driver drowsiness [J ] . Automotive Engineering , 2012 , 34 ( 3 ): 211 - 216 . (in Chinese)

张子健 . 人机共驾模式下多模态刺激对驾驶员情景意识唤醒及接管评价研究 [D ] . 重庆 : 重庆大学 , 2019 .

ZHANG Z J . Research on driver situation awareness arousal and takeover evaluation by multi-modal stimuli in man-machine shared driving mode [D ] . Chongqing : Chongqing University , 2019 . (in Chinese)

陈慧娟 . 飞机驾驶舱多通道人机交互设计研究 [D ] . 南京 : 东南大学 , 2016 .

CHEN H J . Research on multi-modal human-computer interaction design in cockpit [D ] . Nanjing : Southeast University , 2016 . (in Chinese)

KALYUGA S . Cognitive load theory:implications for affective computing[C]//Proceedings of the Twenty-Fourth International FLAIRS Conference . Palm Beach, FL, US:AAAI , 2011 : 105 - 110 .

SANTANGELO V , SPENCE C . Multisensory cues capture spatial attention regardless of perceptual load [J ] . Journal of Experimental Psychology:Human Perception and Performance , 2007 , 33 ( 6 ): 1311 - 1321 . DOI: 10.1037/0096-1523.33.6.1311 http://doi.org/10.1037/0096-1523.33.6.1311 http://doi.apa.org/getdoi.cfm?doi=10.1037/0096-1523.33.6.1311 http://doi.apa.org/getdoi.cfm?doi=10.1037/0096-1523.33.6.1311

MARUCCI M , DI FLUMERI G , BORGHINI G , et al. The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence [J ] . Scientific Reports , 2021 , 11 ( 1 ): 1 - 15 . DOI: 10.1038/s41598-020-79139-8 http://doi.org/10.1038/s41598-020-79139-8 Our previous study demonstrated increased expression of Heat shock protein (Hsp) 90 in the skin of patients with systemic sclerosis (SSc). We aimed to evaluate plasma Hsp90 in SSc and characterize its association with SSc-related features. Ninety-two SSc patients and 92 age-/sex-matched healthy controls were recruited for the cross-sectional analysis. The longitudinal analysis comprised 30 patients with SSc associated interstitial lung disease (ILD) routinely treated with cyclophosphamide. Hsp90 was increased in SSc compared to healthy controls. Hsp90 correlated positively with C-reactive protein and negatively with pulmonary function tests: forced vital capacity and diffusing capacity for carbon monoxide (DLCO). In patients with diffuse cutaneous (dc) SSc, Hsp90 positively correlated with the modified Rodnan skin score. In SSc-ILD patients treated with cyclophosphamide, no differences in Hsp90 were found between baseline and after 1, 6, or 12 months of therapy. However, baseline Hsp90 predicts the 12-month change in DLCO. This study shows that Hsp90 plasma levels are increased in SSc patients compared to age-/sex-matched healthy controls. Elevated Hsp90 in SSc is associated with increased inflammatory activity, worse lung functions, and in dcSSc, with the extent of skin involvement. Baseline plasma Hsp90 predicts the 12-month change in DLCO in SSc-ILD patients treated with cyclophosphamide.

GILSON R D , REDDEN E S , ELLIOTT L R . Remote tactile displays for future soldiers: ARL-SR-0152 [R ] . Aberdeen Proving Ground, MD, US: U.S.Army Research Laboratory , 2007 : 17 - 39 .

GREEN P , WILLIAMS M . Perspective in orientation/navigation displays: a human factors test[C]//Proceedings of the Third International Conference on Vehicle Navigation and Information Systems . Piscataway, NJ, US:IEEE , 1992 : 221 - 226 .

ELLIOTT L R , REDDEN E S . Reducing workload: a multisensory approach[M]//Designing Soldier Systems . London, UK: CRC Press , 2018 : 69 - 96 .

WHITE T L , HANCOCK P A . Specifying advantages of multi-modal cueing: Quantifying improvements with augmented tactile information [J ] . Applied Ergonomics , 2020 , 88 : 103146 . DOI: 10.1016/j.apergo.2020.103146 http://doi.org/10.1016/j.apergo.2020.103146 https://linkinghub.elsevier.com/retrieve/pii/S0003687020301034 https://linkinghub.elsevier.com/retrieve/pii/S0003687020301034

VAN ERP J B F , WERKHOVEN P , WERKHOVEN P . Validation of principles for tactile navigation displays[C]// Proceedings of the Human Factors and Ergonomics Society Annual Meeting . Los Angeles, CA, US: SAGE Publications , 2006 , 50 ( 16 ): 1687 - 1691 .

WHITE T L , KRAUSMAN A S , HAAS E C . Tactile displays in Army operational environments[M]//MARTIN J, ALLENDER L, SAVAGE-KNEPSHIELDP, et al. Designing Soldier Systems . London, UK: CRC Press , 2018 : 97 - 116 .

LOOMIS J M , LIPPA Y , KLATZKY R L , et al. Spatial updating of locations specified by 3-D sound and spatial language [J ] . Journal of Experimental Psychology:Learning, Memory, and Cognition , 2002 , 28 ( 2 ): 335 - 345 . DOI: 10.1037/0278-7393.28.2.335 http://doi.org/10.1037/0278-7393.28.2.335 http://doi.apa.org/getdoi.cfm?doi=10.1037/0278-7393.28.2.335 http://doi.apa.org/getdoi.cfm?doi=10.1037/0278-7393.28.2.335

LAVIE N . Distracted and confused?:selective attention under load [J ] . Trends in Cognitive Sciences , 2005 , 9 ( 2 ): 75 - 82 . DOI: 10.1016/j.tics.2004.12.004 http://doi.org/10.1016/j.tics.2004.12.004 https://linkinghub.elsevier.com/retrieve/pii/S136466130400316X https://linkinghub.elsevier.com/retrieve/pii/S136466130400316X

SPENCE C . Crossmodal spatial attention [J ] . Annals of the New York Academy of Sciences , 2010 , 1191 ( 1 ): 182 - 200 . DOI: 10.1111/nyas.2010.1191.issue-1 http://doi.org/10.1111/nyas.2010.1191.issue-1 http://blackwell-synergy.com/doi/abs/10.1111/nyas.2010.1191.issue-1 http://blackwell-synergy.com/doi/abs/10.1111/nyas.2010.1191.issue-1