装甲车辆多模态交互和环境负荷对乘员任务绩效的影响

doi:10.12382/bgxb.2024.0079

摘要/Abstract

摘要：

随着信息技术的进步,装甲车辆的人机交互方式不断更新,为探究新型多模态交互下乘员的任务绩效,指导未来装甲车辆多模态操作、告警方式的设计,建立一套可集成多模态交互、可调节环境负荷大小的新型人机交互实验系统。基于该系统,招募20名成年男性开展了操作(输入)方式、告警(输出)方式和环境负荷水平的三因素工效学实验。在虚拟实验平台中完成不同实验条件下的模拟击打目标实验,分析被试的任务绩效。实验结果表明:相对于在触屏输入或语音输入下,机械输入下乘员的反应时间最短,但乘员操作错误率最高;机械输入和触屏输入下乘员的任务完成时间远优于语音输入;相对于单模态视觉告警,叠加了触觉告警的视觉+触觉(Visual+Tactile,V+T)双模态告警会显著缩短乘员反应时间,而叠加了听觉告警的视觉+听觉(Visual+ Auditory,V+A)告警则无明显差异;V+T或V+A双模态告警可以显著缩短乘员任务完成时间;对于环境负荷的影响,低环境负荷下乘员任务绩效明显高于高环境负荷;随着环境负荷的增加,V+T告警中叠加听觉告警会造成告警冗余;该研究可为装甲车辆舱室多模态人机交互设计提供实践依据。

关键词: 装甲车辆, 乘员, 多模态交互, 环境负荷, 任务绩效

Abstract:

With the progress of information technology,the human-computer interaction modes of armored vehicles have been constantly updated.In order to explore the mission performance of occupant in new multimodal interaction and guide the design of multimodal operation and warning modes of future armored vehicles,a human-computer interaction experimental system which integrates multimodal interaction and adjusts the environmental load is established.Based on this system,20 adult males were recruited to conduct an ergonomics experiment involving operation (input) mode,warning (output) mode and environmental load level. The simulated target hitting experiments under different experimental conditions are performed in a virtual experimental platform,and the mission performances of occupants are analyzed.The experimental results show that the reaction time of occupant under mechanical input is the shortest and the operation error rate is the highest compared with those under touch input or voice input.The mission completion time of occupant under mechanical input and touch input is much shorter than that under voice input.Compared to the single modal visual (V) warning,the visual+tactile (V+T) dual-modal warning superimposed with tactile warning is used to significantly shorten the reaction time of occupant,while the visual+auditory (V+A) dual-modal warning superimposed with auditory warning has no significant difference.V+T or V+A dual-modal warning can significantly shorten the mission completion time of occupant.For the influence of environmental load,the mission performance of crew under low environmental load is significantly higher than that under high environmental load.As the environmental load increases,superimposing A warning in V+T warning will cause warning redundancy.The research can provide a practical basis for the design of multi-modal human-computer interaction in the armored vehicle cabin.

Key words: armored vehicle, occupant, multi-modal interaction, environmental load, mission performance

中图分类号:

TJ811

栾可迪, 郭保桥, 魏中亮, 谷源森, 王岗亭, 邓丽莎, 陈鹏万. 装甲车辆多模态交互和环境负荷对乘员任务绩效的影响[J]. 兵工学报, 2025, 46(4): 240079-.

LUAN Kedi, GUO Baoqiao, WEI Zhongliang, GU Yuansen, WANG Gangting, DENG Lisha, CHEN Pengwan. Effects of Armored Vehicle Multi-modal Interactions and Environmental Load on Mission Performance of Occupant[J]. Acta Armamentarii, 2025, 46(4): 240079-.

图/表 23

参考文献 39

[1]	陈挚. 目标的识别与快速准确攻击一体化设计研究[D]. 南京: 南京航空航天大学, 2011.
	CHEN Z. Design research on integration detection identification and rapid accurate attack of target[D]. Nanjing: Nanjing University of Aeronautics and Astronautics, 2011. (in Chinese)
[2]	曹灵芝, 殷复鹏. 人因工程在汽车产品中的应用调查与分析[C]// 中国人类工效学学会成立20周年庆祝大会论文集. 北京: 中国人类工效学学会,2009:409-413.
	CAO L Z, YIN F P. Investigation and analysis of human factors application in chinese car industry[C]// Proceedings of the 20th Anniversary Celebration Conference of the Chinese Ergonomics Society. Beijing: Chinese Ergonomics Society,2009:409-413. (in Chinese)
[3]	张文镝, 周诗婕, 金海亮, 等. 自动驾驶系统中人机协同的认知决策一体化机制研究[J]. 汽车文摘, 2023(9):11-18.
	ZHANG W D, ZHOU S J, JIN H L, et al. Research on cognitive decision integration mechanism of human-machinecollaboration in automated driving system[J]. Automotive Digest, 2023(9):11-18. (in Chinese)
[4]	GRAY R, SPENCE C, HO C, et al. Efficient multimodal cuing of spatial attention[J]. Proceedings of the IEEE, 2013, 101(9):2113-2122.
[5]	钱晓松, 杨新, 张帆. 面向特种车辆的触屏交互系统设计研究[J]. 装饰, 2018(3):82-85.
	QIAN X S, YANG X, ZHANG F. An exploratory design research on touchscreen interaction system in special vehicles[J]. Art & Design, 2018(3):82-85. (in Chinese)
[6]	杨洋. 基于语音交互的手持移动端多通道交互研究[D]. 北京: 北京邮电大学, 2018.
	YANG Y. Reserch on multy-channel interaction of handheld mobile device based on voice interaction[D]. Beijing: Beijing University of Posts and Telecommunications, 2018. (in Chinese)
[7]	范雪乔. 基于手势识别VR系统的交互体验评价研究[D]. 哈尔滨: 哈尔滨工业大学, 2018.
	FAN X Q. Research on interactive experience evaluation based on gesture recognition VR system[D].Harbin: Harbin Institute of Technology, 2018. (in Chinese)
[8]	刘洋. 智能音箱语音交互设计中的可用性研究[D]. 北京: 中国矿业大学, 2022.
	LIU Y. Research on usability of intelligent speaker in voice interaction design[D]. Beijing: China University of Mining and Technology, 2022. (in Chinese)
[9]	高岚岚, 纪坤, 乐剑. 眼动交互在点击任务中的应用研究[J]. 舰船电子工程, 2023, 43(5):63-63,81.
	GAO L L, JI K, LE J. Application research of eye movement interaction in click task[J]. Ship Electronic Engineering, 2023, 43(5):63-66,81. (in Chinese)
[10]	徐源. 眼控—手控双通道交互方式的工效学研究[D]. 杭州: 浙江理工大学, 2017.
	XU Y. The ergonomics research of eye control-hand control dual channel interaction[D]. Hangzhou: Zhejiang Sci-Tech University, 2017. (in Chinese)
[11]	孙晓东, 金晓萍, 解芳, 等. 多模态告警和认知负荷对装甲车辆乘员反应的影响[J]. 兵工学报, 2023, 44(4):972-981.
	SUN X D, JIN X P, XIE F, et al. The effect of multimodal warning and cognitive load on the response of armored vehicle occupants[J]. Acta Armamentarii, 2023, 44(4):972-981. (in Chinese)
[12]	NGO M K, PIERCE R S, SPENCE C. Using multisensory cues to facilitate air traffic management[J]. Human Factors, 2012, 54(6):1093-1103. pmid: 23397817
[13]	WANG Y W, WU B H, MA S, et al. Effect of mapping characteristic on audiovisual warning:evidence from a simulated driving study[J]. Applied Ergonomics, 2022,99:103638.
[14]	LUNDQVIST L M, ERIKSSON L. Age,cognitive load,and multimodal effects on driver response to directional warning[J]. Applied ergonomics, 2019,76:147-154.
[15]	HUANG G, PITTS B J. The effects of age and physical exercise on multimodal signal responses:implications for semi-autonomous vehicle takeover requests[J]. Applied Ergonomics, 2022,98:103595.
[16]	张子健. 人机共驾模式下多模态刺激对驾驶员情景意识唤醒及接管评价研究[D]. 重庆: 重庆大学, 2019.
	ZHANG Z J. Research on driver situation awareness arousal and takeover evaluation by multi-modal stimuli in man-machine shared driving mode[D]. Chongqing: Chongqing University, 2019. (in Chinese)
[17]	OSKARSSON P A, ERIKSSON L, CARLANDER O. Enhanced perception and performance by multimodal threat cueing in simulated combat vehicle[J]. Human Factors, 2012, 54(1):122-137.
[18]	van ERP J B F, ERIKSSON L, LEVIN B, et al. Tactile cueing effects on performance in simulated aerial combat with high acceleration.[J]. Aviation,Space and Environmental Medicine, 2007, 78(12):1128-1134.
[19]	李家文, 成波. 驾驶员疲劳状态适应式复合预警方法的研究[J]. 汽车工程, 2012(3):211-216.
	LI J W, CHENG B. A study on the adaptive multiple warnings scheme for driver drowsiness[J]. Automotive Engineering, 2012(3):211-216. (in Chinese)
[20]	陈慧娟. 飞机驾驶舱多通道人机交互设计研究[D]. 南京: 东南大学, 2016.
	CHEN H J. Research on multi-modal human-computer interaction design in cockpit[D]. Nanjing: Southeast University, 2016. (in Chinese)
[21]	高莹. 基于环境心理学的老年人疗养中心设计方法的研究[D]. 西安: 长安大学, 2015.
	GAO Y. Study of the elderly convalescent center design method based on environmental psychology[D]. Xi’an: Chang’an University, 2015. (in Chinese)
[22]	石程. 基于环境—行为关系理论的老年公寓空间环境设计研究[D]. 兰州: 兰州理工大学, 2018.
	SHI C. Research on space environment design of elderly apartment based onenvironment-behavioral relationship theory[D]. Lanzhou: Lanzhou University of Technology, 2018. (in Chinese)
[23]	HUANG L, ZHU Y X, OUYANG Q, et al. A study on the effects of thermal,luminous,and acoustic environments on indoor environmental comfort in offices[J]. Building and Environment, 2011,49:304-309.
[24]	ŠABIĆE , CHEN J, MACDONALD J A, et al. Toward a better understanding of in-vehicle auditory warnings and background noise[J]. Human Factors, 2021,63(2):312-335.
[25]	KARUNARATHNE B, WANG T, SO R H Y, et al. Adversarial relationship between combined medial olivocochlear (MOC) and middle-ear-muscle (MEM) reflexes and alarm-in-noise detection thresholds under negative signal-to-noise ratios (SNRs)[J]. Hearing Research, 2018,367:124-128.
[26]	ANDERSON S, PARBERY-CLARK A, WHITE-SCHWOCH T, et al. Auditory brainstem response to complex sounds predicts self-reported speech-in-noise performance[J]. Journal of Speech Language and Hearing Research, 2013, 56(1):31-43.
[27]	张永超. 高铁客站候车区热、光、声环境对人体舒适度的交互作用影响研究[D]. 北京: 北京交通大学, 2021.
	ZHANG Y C. Research on interaction effect of thermal,light and acousticenvironment on human comfort in waiting area of high-speedrailway station[D]. Beijing: Beijing Jiaotong University, 2021. (in Chinese)
[28]	NAGANO K, HORIKOSHI T. New comfort index during combined conditions of moderate low ambient temperature and traffic noise[J]. Energy & Buildings, 2005, 37(3):287-294.
[29]	KIM H E, TOKURA H. Influence of two different light intensities from 16:00 to 20:30 hours on evening dressing behavior in the cold[J]. Collegium Antropologicum, 2007, 31(1):145-151.
[30]	FRANSSON N, VAESTFJAELL D, SKOOG J. In search of the comfortable indoor environment:a comparison of the utility of objective and subjective indicators of indoor comfort[J]. Building & Environment, 2007, 42(5):1886-1890.
[31]	YANG W, MOON H J. Cross-modal effects of illuminance and room temperature on indoor environmental perception[J]. Building and environment, 2018,146:280-288.
[32]	YANG W, MOON H J. Combined effects of sound and illuminance on indoor environmental perception[J]. Applied Acoustics, 2018,141:136-143.
[33]	ISHII J, TETSUMI H. The combined effects of illuminance and air temperature on the human physiological and psychological[C]// Proceedings of Meeting Architectural Institute of Japan.Minato-ku,Tokyo, Japan: Architectural Institute of Japan,1996.
[34]	YANG W, MOON H J. Combined effects of acoustic,thermal,and illumination conditions on the comfort of discrete senses and overall indoor environment[J]. Building and environment, 2019,148:623-633.
[35]	国家质量监督检验检疫总局.声环境质量标准:GB 3096—2008 [S]. 北京: 中国环境科学出版社, 2008.
	General Administration of Quality Supervision, Inspection and Quarantine of the People’s Republic of China.Environmental quality standard for noise:GB 3096—2008 [S]. Beijing: China Environmental Science Press, 2008. (in Chinese)
[36]	国家市场监督管理总局.视觉工效学原则.室内工作场所照明:GB/T 13379-2023[S]. 北京: 中国标准出版社, 2023.
	State Administration for Market Regulation.Principles of visual ergonomics-the lighting of indoor work places:GB/T 13379—2023[S]. Beijing: China standard press, 2023. (in Chinese).
[37]	高祖新, 言方荣. 概率论与数理统计[M]. 第2版.: 南京:南京大学出版社, 2020. GAO Z X,YAN F R.Probability and statistics[M]. 2 ed. Nanjing: Nanjing University Press,2020. (in Chinese)
[38]	黄捷. 人机交互在震动环境下的仿真模型设计与实验测试[C]// 第四届和谐人机环境联合学术会议论文集. 昆明: 中国计算机学会,2008:1-7.
	HUANG J. Model design and experimental test of HCI in vibratile environment[C]// Proceedings of the fourth Harmonious Human-Machine Environment Joint Academic Conference. Kunming: China Computer Federation,2008:1-7. (in Chinese)
[39]	毛信良, 周田伟, 陈二喜. 一种用于多点触摸终端的触摸控制方法与设备:CN104076986B[P].2015-12-09.
	MAO X L, ZHOU T W, CHEN E X. A touch control method and device for multi-touch terminal:CN104076986B[P].2015-12-09. (in Chinese)

编辑推荐 0

Metrics

阅读次数

全文

115

HTML			PDF

最新录用	在线预览	正式出版	最新录用	在线预览	正式出版
0	0	6	68	0	41

来源	本网站	其他网站

次数	53	62
比例	46%	54%

摘要

196

最新录用	在线预览	正式出版

148	0	48

来源	本网站	其他网站

次数	80	116
比例	41%	59%

设备	参数
噪声发生设备	2.0声道,最大功率40W
可调光强式光源	额定功率14.5W(72×0.2W/LED模块)
数字照度计	量程0.1~99990lx、0.1~999.9lx,分度值0.1lx;1000~99990lx,分度值1lx
数字噪声计	量程30~130dB,分度值0.1dB
视频采集设备	300万像素,帧率30帧/s

设备	参数
噪声发生设备	2.0声道,最大功率40W
可调光强式光源	额定功率14.5W(72×0.2W/LED模块)
数字照度计	量程0.1~99990lx、0.1~999.9lx,分度值0.1lx;1000~99990lx,分度值1lx
数字噪声计	量程30~130dB,分度值0.1dB
视频采集设备	300万像素,帧率30帧/s

序号	方位
1	东偏南45°
2	东偏北45°
3	东偏南10°
4	东偏南50°
5	东偏北10°
6	东偏北50°

序号	方位
1	东偏南45°
2	东偏北45°
3	东偏南10°
4	东偏南50°
5	东偏北10°
6	东偏北50°

实验编号类型	敌方车辆波次
实验编号类型	1	2	3	4
奇数	1	2、5	6	3、4
偶数	2	1、3	4	5、6