Multiple Expert Evaluations of a PC Computer-Based Aviation Flight Training Device

Abstract

The usability of a personal computer based aviation-training device (PCATD) was investigated by conducting multiple expert evaluations. One group of experts performed a heuristic evaluation of the PCATD system. Experts in a second group evaluated the PCATD by conducting a cognitive-walkthrough analysis. An ethnographic analysis was also carried out by directly observing and interviewing the participating experts during the evaluations. Experts evaluated the usability of the PCATD as applied to various practical test standards used for instrument flight training. Strong consensus by the experts in both groups indicated that the PCATD was usable for fundamental flight training as required by the Federal Aviation Administration’s Instrument Rating curriculum. Issues concerning various PCATD simulation fidelities and related inconsistencies in interface design were discovered. These issues caused concern over using the PCATD for training that could be applied to actual flight time.