A hybrid FRAM-Kirkpatrick framework for evaluating OSH digital training effectiveness in complex socio-technical systems


Authors: Andrei Stefan Iacob, Oana-Roxana Chivu, Mihnea Costoiu, Alina Trifu, Roland Moraru, Adrian Bibiș

Abstract: Digital occupational safety and health training is nowadays widely adopted in complex socio-technical systems. Yet its effectiveness is often assessed using linear approaches that fail to capture impacts on real work and system performance. This study argues that training effectiveness cannot be meaningfully evaluated without a systemic perspective. To address this gap, the paper proposes the FRAM-Kirkpatrick Framework, integrating the Functional Resonance Analysis Method (FRAM) with the Kirkpatrick training evaluation model. The framework conceptualizes digital OSH training as a systemic intervention influencing functional performance variability. The FRAM-Kirkpatrick Framework is applied through multiple case studies in the road transport sector involving three companies and 47 professional drivers. Results show significant improvements in learning and safe behavior, accompanied by a substantial reduction in functional variability within critical system functions. The findings demonstrate that the FRAM-Kirkpatrick Framework enables a more robust evaluation of digital training effectiveness in complex socio-technical systems.

Pages: 124-139

DOI: 10.46300/9109.2026.20.13

International Journal of Education and Information Technologies, E-ISSN: 2074-1316, Volume 20, 2026, Art. #13

PDF DOI XML

Certification