Data-Driven Decision Making in Aviation Safety Management Systems: A Supervised Machine Learning Approach.
Main Article Content
Abstract
One of the objectives of the FAA’s safety improvement plan is to continuously collect safety data to identify potential risks. Over the last decade, the application of machine learning (ML) and Artificial Intelligence (AI) models in prediction, classification, and identification has been widely used across both aviation and nonaviation domains. Few studies have explored the use of ML techniques in aviation for predicting safety. Therefore, the purpose of the current study is twofold: (a) to build and compare the classification performance of three supervised machine learning models: Random Forest (RF), Support Vector Machine (SVM), and Extreme Gradient Boost (XG Boost), and (b) to apply the Synthetic Minority Oversampling Technique (SMOTE) class imbalance technique to all three models and compare the performance. The total sample size for the current study was N = 17,275, of which 15,870 (91.86%) were classified as accidents and 1,405 (9.14%) were classified as incidents. The NTSB database includes many features, such as event ID, registration number, Federal Aviation Regulation (FAR), flight plan, damage type, event type, crew demographics, and aircraft characteristics. The dependent or outcome variable for the current study was event type (accident or incident). The findings of this study demonstrate that supervised ML models can be effectively used to predict or classify aviation events such as incidents or accidents. Specifically, the Random Forest, SVM, and XG Boost models can be applied to operational data to classify aviation accidents and incidents. The findings of this study offer multiple practical implications for enhancing safety through proactive and predictive data analytical decision-making approaches, which align with ICAO’s (2018) SMM. A robust SMS is always dependent on data-driven decision-making, and integrating ML to proactively identify hazards can strengthen the SMS foundation.