How Safe Are Pilot Schools in Indonesia? Measuring Safety Performance in Flight Training

Main Article Content

Agung Wahyu Wicaksono
Imam Sonhaji
Ahmad Bahrawi

Abstract

Accidents and serious incidents are the primary objectives to be avoided in aviation operations. Based on data from the Indonesian National Transportation Safety Commission, 190 accidents and serious incidents occurred from 2010 to early 2024. Among these 190 incidents, 10.5% were attributable to flight training operations conducted by student pilots in Indonesia; therefore, the level of safety performance in flight schools warrants measurement. This research aims to measure safety performance by using safety promotion and safety intelligence as exogenous variables. Safety leadership is both an intervening and a moderating variable in the relationship among these variables. The research was conducted at pilot schools run by the Indonesian Government. A total of 102 participants were included using a saturated sampling technique. The research employs a quantitative SEM-PLS approach in SmartPLS3. The results showed that 6 of the 7 hypotheses were accepted. All direct relationships between variables are significant, whereas the mediating and moderating variables do not influence the relationships among safety promotion, safety intelligence, and safety performance. Reflecting on the flight training operations carried out by the Indonesian government, the training flight operations fulfill the level of safety that has been determined as measured by the 3 important roles played by Quality Assurance, Quality Control, and the Chief Instructor, as well as by the level of implementation of a good safety management system in each school.

Article Details

Section
Peer-Reviewed Articles

References

Ab Hamid, M. R., Sami, W., & Mohmad Sidek, M. H. (2017). Discriminant Validity Assessment: Use of Fornell & Larcker criterion versus HTMT Criterion. Journal of Physics: Conference Series, 890(1). https://doi.org/10.1088/1742-6596/890/1/012163

Adjekum, D. K. (2014). Safety Culture Perceptions in a Collegiate Aviation Program: A Systematic Assessment. Journal of Aviation Technology and Engineering, 3(2), 44. https://doi.org/10.7771/2159-6670.1086

Adjekum, D. K. (2017). An evaluation of the relationships between collegiate aviation safety management system initiative, self-efficacy, transformational safety leadership and safety behavior mediated by safety motivation. International Journal of Aviation, Aeronautics, and Aerospace, 4(2). https://doi.org/10.15394/ijaa.2017.1169

Adjekum, D. K., & Tous, M. F. (2020). Assessing the relationship between organizational management factors and a resilient safety culture in a collegiate aviation program with Safety Management Systems (SMS). Safety Science, 131. https://doi.org/10.1016/j.ssci.2020.104909

Afthanorhan, A., Ghazali, P. L., & Rashid, N. (2021). Discriminant Validity: A Comparison of CBSEM and Consistent PLS using Fornell & Larcker and HTMT Approaches. Journal of Physics: Conference Series, 1874(1). https://doi.org/10.1088/1742-6596/1874/1/012085

Alidrisi, H. M., & Mohamed, S. (2018). Systematic review of safety leadership: A fresh perspective. In Lecture Notes in Mechanical Engineering (Vol. 0, Issue 9783319741222, pp. 215–223). Pleiades journals. https://doi.org/10.1007/978-3-319-74123-9_23

Ardeshir, A., & Mohajeri, M. (2018). Assessment of safety culture among job positions in high-rise construction: a hybrid fuzzy multi criteria decision-making (FMCDM) approach. International Journal of Injury Control and Safety Promotion, 25(2), 195–206. https://doi.org/10.1080/17457300.2017.1416483

Atikasari, C. D., Sudiarno, A., & Priyanto, E. (2022). The effect of safety leadership, safety culture, and safety behavior on safety performance after a company merger: a case study. Jurnal Sistem Dan Manajemen Industri, 6(2), 187–199. https://doi.org/10.30656/jsmi.v6i2.5051

Bagozzi, R. P., & Yi, Y. (2012). Specification, evaluation, and interpretation of structural equation models. Journal of the Academy of Marketing Science, 40(1), 8–34. https://doi.org/10.1007/s11747-011-0278-x

Bell, S. M., Chalmers, R. P., & Flora, D. B. (2024). The Impact of Measurement Model Misspecification on Coefficient Omega Estimates of Composite Reliability. Educational and Psychological Measurement, 84(1), 5–39. https://doi.org/10.1177/00131644231155804

CASR 141. (2017). CIVIL AVIATION SAFETY REGULATIONS (CASR) PART 141 CERTIFICATION AND OPERATING REQUIREMENTS FOR PILOT SCHOOLS.

Chen, M., Chen, Y., & Ma, S. (2021). Identifying Safety Performance Indicators for Risk Assessment in Civil Aviation. IOP Conference Series: Materials Science and Engineering, 1043(3). https://doi.org/10.1088/1757-899X/1043/3/032010

Dou, X. (2020). Big data and smart aviation information management system. Cogent Business and Management, 7(1). https://doi.org/10.1080/23311975.2020.1766736

Fardnia, P., Kaspereit, T., Walker, T., & Xu, S. (2021). Financial performance and safety in the aviation industry. International Journal of Managerial Finance, 17(1), 138–165. https://doi.org/10.1108/IJMF-03-2019-0095

Fornell, C., & Larcker, D. (1981). Evaluating Structural Equation Models with Unobservable Variables and Measurement Error.

Fruhen, L. S., Mearns, K. J., Flin, R., & Kirwan, B. (2014). Safety intelligence: An exploration of senior managers’ characteristics. Applied Ergonomics, 45(4), 967–975. https://doi.org/10.1016/j.apergo.2013.11.012

Gaweesh, S. M., Bakhshi, A. K., & Ahmed, M. M. (2021). Safety performance assessment of connected vehicles in mitigating the risk of secondary crashes: A driving simulator study. Transportation Research Record, 2675(12), 117–129. https://doi.org/10.1177/03611981211027881

Gonzalez, O., MacKinnon, D. P., & Muniz, F. B. (2021). Extrinsic Convergent Validity Evidence to Prevent Jingle and Jangle Fallacies. Multivariate Behavioral Research, 56(1), 3–19. https://doi.org/10.1080/00273171.2019.1707061

Grill, M., & Nielsen, K. (2019). Promoting and impeding safety – A qualitative study into direct and indirect safety leadership practices of constructions site managers. Safety Science, 114, 148–159. https://doi.org/10.1016/j.ssci.2019.01.008

Hair, J. F., Howard, M. C., & Nitzl, C. (2020). Assessing measurement model quality in PLS-SEM using confirmatory composite analysis. Journal of Business Research, 109, 101–110. https://doi.org/10.1016/j.jbusres.2019.11.069

Hair, J. F., Page, M., & Brunsveld, N. (2020). Essentials of Business Research Methods; Fourth Edition.

Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. In European Business Review (Vol. 31, Issue 1, pp. 2–24). Emerald Group Publishing Ltd. https://doi.org/10.1108/EBR-11-2018-0203

Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8

Hult, M., Halminen, O., Linna, M., Suominen, S., & Kangasniemi, M. (2021). Cost-effectiveness calculators for health, well-being and safety promotion: A systematic review. In European Journal of Public Health (Vol. 31, Issue 5, pp. 997–1003). Oxford University Press. https://doi.org/10.1093/eurpub/ckab068

ICAO. (2016). Annex 19 Safety Management.

ICAO. (2018). Doc 9859 Safety Management Manual.

Ingesson, T. (2022). Beyond Blame: What Investigations of Intelligence Failures Can Learn from Aviation Safety. International Journal of Intelligence and CounterIntelligence, 35(3), 527–542. https://doi.org/10.1080/08850607.2021.1924102

Jager-Hyman, S., Benjamin Wolk, C., Ahmedani, B. K., Zeber, J. E., Fein, J. A., Brown, G. K., Byeon, Y. V., Listerud, H., Gregor, C. A., Lieberman, A., & Beidas, R. S. (2019). Perspectives from firearm stakeholders on firearm safety promotion in pediatric primary care as a suicide prevention strategy: a qualitative study. Journal of Behavioral Medicine, 42(4), 691–701. https://doi.org/10.1007/s10865-019-00074-9

Kalkbrenner, M. T. (2023). Alpha, Omega, and H Internal Consistency Reliability Estimates: Reviewing These Options and When to Use Them. Counseling Outcome Research and Evaluation, 14(1), 77–88. https://doi.org/10.1080/21501378.2021.1940118

Kalteh, H. O., Mortazavi, S. B., Mohammadi, E., & Salesi, M. (2021). The relationship between safety culture and safety climate and safety performance: a systematic review. International Journal of Occupational Safety and Ergonomics, 27(1), 206–216. https://doi.org/10.1080/10803548.2018.1556976

Karanikas, N., Chionis, D., & Plioutsias, A. (2020). “Old” and “new” safety thinking: Perspectives of aviation safety investigators. Safety Science, 125. https://doi.org/10.1016/j.ssci.2020.104632

Kaspers, S., Karanikas, N., Roelen, A., Piric, S., & De Boer, R. J. (2019). How does aviation industry measure safety performance? Current practice and limitations. In Int. J. Aviation Management (Vol. 4, Issue 3).

Lai, M. H. C. (2021). Composite reliability of multilevel data: It’s about observed scores and construct meanings. Psychological Methods, 26(1), 90–102. https://doi.org/10.1037/met0000287

Lindner, T., Puck, J., & Verbeke, A. (2020). Misconceptions about multicollinearity in international business research: Identification, consequences, and remedies. In Journal of International Business Studies (Vol. 51, Issue 3, pp. 283–298). Palgrave Macmillan Ltd. https://doi.org/10.1057/s41267-019-00257-1

Majid, S. A., Nugraha, A., Sulistiyono, B. B., Suryaningsih, L., Widodo, S., Kholdun, A. I., Febrian, W. D., Wahdiniawati, S. A., Marlita, D., Wiwaha, A., & Endri, E. (2022). The effect of safety risk management and airport personnel competency on aviation safety performance. Uncertain Supply Chain Management, 10(4), 1509–1522. https://doi.org/10.5267/j.uscm.2022.6.004

Naor, M., Adler, N., Pinto, G. D., & Dumanis, A. (2020). Psychological safety in aviation new product development teams: Case study of 737 max airplane. Sustainability (Switzerland), 12(21), 1–15. https://doi.org/10.3390/su12218994

P. Obite, C., P. Olewuezi, N., U. Ugwuanyim, G., & C. Bartholomew, D. (2020). Multicollinearity Effect in Regression Analysis: A Feed Forward Artificial Neural Network Approach. Asian Journal of Probability and Statistics, 22–33. https://doi.org/10.9734/ajpas/2020/v6i130151

Paap, K. R., Anders-Jefferson, R., Zimiga, B., Mason, L., & Mikulinsky, R. (2020). Interference scores have inadequate concurrent and convergent validity: Should we stop using the flanker, Simon, and spatial Stroop tasks? Cognitive Research: Principles and Implications, 5(1). https://doi.org/10.1186/s41235-020-0207-y

Patriarca, R., Di Gravio, G., Cioponea, R., & Licu, A. (2019). Safety intelligence: Incremental proactive risk management for holistic aviation safety performance. Safety Science, 118, 551–567. https://doi.org/10.1016/j.ssci.2019.05.040

Peñaloza, G. A., Saurin, T. A., Formoso, C. T., & Herrera, I. A. (2020). A resilience engineering perspective of safety performance measurement systems: A systematic literature review. Safety Science, 130. https://doi.org/10.1016/j.ssci.2020.104864

Provan, D. J., Woods, D. D., Dekker, S. W. A., & Rae, A. J. (2020). Safety II professionals: How resilience engineering can transform safety practice. In Reliability Engineering and System Safety (Vol. 195). Elsevier Ltd. https://doi.org/10.1016/j.ress.2019.106740

Qayoom, A., & H.W. Hadikusumo, B. (2019). Multilevel safety culture affecting organization safety performance: a system dynamic approach. Engineering, Construction and Architectural Management, 26(10), 2326–2346. https://doi.org/10.1108/ECAM-08-2018-0355

Robert Foster, A., & Kwasi Adjekum, D. (2022). Qualitative Review of the Relationship between Safety Management Systems (SMS) and Safety Culture in Multiple-Collegiate Aviation Programs. Aviation Faculty Publication, 40(1), 63–94. https://commons.und.edu/avi-fac/18

Roemer, E., Schuberth, F., & Henseler, J. (2021). HTMT2–an improved criterion for assessing discriminant validity in structural equation modeling. Industrial Management and Data Systems, 121(12), 2637–2650. https://doi.org/10.1108/IMDS-02-2021-0082

Schopf, A. K., Stouten, J., & Schaufeli, W. B. (2021). The role of leadership in air traffic safety employees’ safety behavior. Safety Science, 135. https://doi.org/10.1016/j.ssci.2020.105118

Sebele-Mpofu, F. Y. (2020). Saturation controversy in qualitative research: Complexities and underlying assumptions. A literature review. In Cogent Social Sciences (Vol. 6, Issue 1). Cogent OA. https://doi.org/10.1080/23311886.2020.1838706

Sorensen, G., Dennerlein, J. T., Peters, S. E., Sabbath, E. L., Kelly, E. L., & Wagner, G. R. (2021). The future of research on work, safety, health and wellbeing: A guiding conceptual framework. Social Science and Medicine, 269. https://doi.org/10.1016/j.socscimed.2020.113593

Stiles, S., Ryan, B., & Golightly, D. (2018). Evaluating attitudes to safety leadership within rail construction projects. Safety Science, 110, 134–144. https://doi.org/10.1016/j.ssci.2017.12.030

Stroeve, S., Smeltink, J., & Kirwan, B. (2022). Assessing and Advancing Safety Management in Aviation. Safety, 8(2). https://doi.org/10.3390/safety8020020

Wang, B. (2021). Safety intelligence as an essential perspective for safety management in the era of Safety 4.0: From a theoretical to a practical framework. Process Safety and Environmental Protection, 148, 189–199. https://doi.org/10.1016/j.psep.2020.10.008

Wang, Z., Jiang, Z., & Blackman, A. (2021). Linking emotional intelligence to safety performance: The roles of situational awareness and safety training. Journal of Safety Research, 78, 210–220. https://doi.org/10.1016/j.jsr.2021.06.005

Wondola, D. W., Aulele, S. N., & Lembang, F. K. (2020). Partial Least Square (PLS) Method of Addressing Multicollinearity Problems in Multiple Linear Regressions (Case Studies: Cost of electricity bills and factors affecting it). Journal of Physics: Conference Series, 1463(1). https://doi.org/10.1088/1742-6596/1463/1/012006

Zhang, J., Xie, C., Wang, J., Morrison, A. M., & Coca-Stefaniak, J. A. (2020). Responding to a major global crisis: the effects of hotel safety leadership on employee safety behavior during COVID-19. International Journal of Contemporary Hospitality Management, 32(11), 3365–3389. https://doi.org/10.1108/IJCHM-04-2020-0335