Abstract: With the progress of information technology, the human-computer interaction modes of armored vehicles have been constantly updated. In order to explore the mission performance of occupant under new multimodal interaction and guide the design of multimodal operation and warning methods of future armored vehicles, a new human-computer interaction experimental system which integrates multimodal interaction and adjusts the environmental load was established. Based on this system, 20 adult males were recruited to carry out an ergonomic experiment involving three factors: operation (input) method, warning (output) method and environmental load level. In the virtual experiment platform, the simulated target hitting experiments under different experimental conditions were performed, and the mission performances of occupants were analyzed. The experimental results show that compared with that under touch input or voice input, the reaction time of occupants under mechanical input is the shortest and the operation error rate is the highest. The task completion time of the occupants under mechanical input and touch input is much better than that under voice input. Compared to the single modal visual (V) warning, the V+T dual-modal warning superimposed with tactile (T) warning is significantly shorten the reaction time of occupants, while the V+A dual-modal warning superimposed with auditory (A) warning has no significant difference. V+T or V+A dual-modal warning can significantly shorten the task completion time of occupants. For the influence of environmental load, the mission performance of occupants under low environmental load is significantly higher than that under high environmental load. As the environmental load increases, superimposing A warning in V+T warning will cause warning redundancy. The research can provide a practical basis for the design of multi-modal human-computer interaction in the armored vehicle cabin.

Key words: armored vehicle, occupant, multi-modal interaction, environmental load, mission performance