BEHAVIORAL DIGITAL TRACES AS A SOURCE FOR EVALUATING THE EFFECTIVENESS OF PERSONNEL TRAINING PROGRAMS
Abstract
The purpose of this article is to examine the potential of behavioral digital traces generated by learning management systems as an instrument for evaluating the effectiveness of personnel training programs. The relevance of this study is driven by a growing gap between the volume of behavioral data accumulated in corporate LMS platforms and the limited capacity of organizations to utilize these data for evidence-based assessment of training outcomes. Traditional evaluation models, were developed within an offline paradigm and primarily rely on self-reported measures, which restricts their applicability in the context of digital learning environments. The research methodology combines systematic literature review with conceptual modeling. The study synthesizes findings from three converging disciplines: learning analytics, HR analytics and people analytics, and training evaluation theory. Based on this synthesis, the authors develop a conceptual framework that maps specific types of behavioral digital traces to established evaluation levels. The results demonstrate that behavioral data from LMS platforms, including login frequency, session duration, content interaction patterns, assessment attempt sequences, and module revisitation behavior, constitute valid indicators of learner engagement, knowledge acquisition, and behavioral change. The proposed framework integrates these indicators into a structured evaluation system that complements traditional survey-based approaches with objective, continuously collected digital evidence. The study identifies that while learning analytics has matured significantly in higher education settings, its application within corporate human resource development remains fragmented and theoretically underdeveloped. The practical value of this research lies in providing HR professionals and L&D managers with a systematic approach to leveraging existing LMS data for training evaluation purposes, thereby reducing reliance on costly post-training surveys, enabling real-time monitoring of learning effectiveness, and supporting data-driven decisions regarding personnel development investments. The findings contribute to bridging the gap between learning analytics and people analytics disciplines within the broader context of HRM digitalization.
References
Bates R. A critical analysis of evaluation practice: The Kirkpatrick model and the principle of beneficence. Evaluation and Program Planning. 2004. Vol. 27, No. 3. P. 341–347. DOI: https://doi.org/10.1016/j.evalprogplan.2004.04.011.
Siemens G. Learning analytics: The emergence of a discipline. American Behavioral Scientist. 2013. Vol. 57, No. 10. P. 1380–1400. DOI: https://doi.org/10.1177/0002764213498851.
Winter M. et al. Behavioral trace data in an online learning environment as indicators of learning engagement in university students. Frontiers in Psychology. 2024. Vol. 15. Article 1396881. DOI: https://doi.org/10.3389/fpsyg.2024.1396881.
Angrave D., Charlwood A., Kirkpatrick I., Lawrence M., Stuart M. HR and analytics: Why HR is set to fail the big data challenge. Human Resource Management Journal. 2016. Vol. 26, No. 1. P. 1–11. DOI: https://doi.org/10.1111/1748-8583.12090.
Кравчук О. І., Варіс І. О., Рубель К. О. Цифровізація менеджменту персоналу: концептуальні аспекти та тенденції. Проблеми сучасних трансформацій. Серія: економіка та управління. 2024. № 12. DOI: https://doi.org/10.54929/2786-5738-2024-12-07-04.
Канцур І. Г., Кононова О. Є., Хмарська І. А. Управління персоналом в умовах цифрової економіки. Економіка та держава. 2022. № 2. С. 103–108. DOI: https://doi.org/10.32702/2306-6806.2022.2.103.
Ferguson R. Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning. 2012. Vol. 4, No. 5/6. P. 304–317. DOI: https://doi.org/10.1504/IJTEL.2012.051816.
Gasevic D., Dawson S., Siemens G. Let's not forget: Learning analytics are about learning. TechTrends. 2015. Vol. 59, No. 1. P. 64–71. DOI: https://doi.org/10.1007/s11528-014-0822-x.
Gasevic D., Dawson S., Rogers T., Gasevic D. Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education. 2016. Vol. 28. P. 68–84. DOI: https://doi.org/10.1016/j.iheduc.2015.10.002.
Pardo A., Han F., Ellis R. A. Combining university student self-regulated learning indicators and engagement with online learning events to predict academic performance. IEEE Transactions on Learning Technologies. 2017. Vol. 10, No. 1. P. 82–92. DOI: https://doi.org/10.1109/TLT.2016.2639508.
Aldowah H., Al-Samarraie H., Fauzy W. M. Educational data mining and learning analytics for 21st century higher education: A review and synthesis. Telematics and Informatics. 2019. Vol. 37. P. 13–49. DOI: https://doi.org/10.1016/j.tele.2019.01.007.
Marler J. H., Boudreau J. W. An evidence-based review of HR Analytics. The International Journal of Human Resource Management. 2017. Vol. 28, No. 1. P. 3–26. DOI: https://doi.org/10.1080/09585192.2016.1244699.
Huselid M. A. The science and practice of workforce analytics: Introduction to the HRM special issue. Human Resource Management. 2018. Vol. 57, No. 3. P. 679–684. DOI: https://doi.org/10.1002/hrm.21916.
Yoon S. W., Han S., Chae C. People analytics and human resource development: Research landscape and future needs based on bibliometrics and scoping review. Human Resource Development Review. 2024. Vol. 23, No. 1. P. 30–57. DOI: https://doi.org/10.1177/15344843231209362.
Lee J. Y., Lee Y. Integrative literature review on people analytics and implications from the perspective of human resource development. Human Resource Development Review. 2024. Vol. 23, No. 1. P. 58–87. DOI: https://doi.org/10.1177/15344843231217181.
Kirkpatrick J. D., Kirkpatrick W. K. Kirkpatrick's Four Levels of Training Evaluation. ATD Press, 2016. ISBN: 978-1-60728-008-8.
Bates R. (2004) A critical analysis of evaluation practice: The Kirkpatrick model and the principle of beneficence. Evaluation and Program Planning, vol. 27, no. 3, pp. 341–347. https://doi.org/10.1016/j.evalprogplan.2004.04.011
Siemens G. (2013) Learning analytics: The emergence of a discipline. American Behavioral Scientist, vol. 57, no. 10, pp. 1380–1400. https://doi.org/10.1177/0002764213498851
Winter M., et al. (2024) Behavioral trace data in an online learning environment as indicators of learning engagement in university students. Frontiers in Psychology, vol. 15, article 1396881. https://doi.org/10.3389/fpsyg.2024.1396881
Angrave D., Charlwood A., Kirkpatrick I., Lawrence M., Stuart M. (2016) HR and analytics: Why HR is set to fail the big data challenge. Human Resource Management Journal, vol. 26, no. 1, pp. 1–11. https://doi.org/10.1111/1748-8583.12090
Kravchuk O. I., Varis I. O., Rubel K. O. (2024) Tsyfrovizatsiia menedzhmentu personalu: kontseptualni aspekty ta tendentsii [Digitalization of personnel management: conceptual aspects and trends]. Problemy suchasnykh transformatsii. Seriia: ekonomika ta upravlinnia – Problems of Modern Transformations. Series: Economics and Management, no. 12. https://doi.org/10.54929/2786-5738-2024-12-07-04 (in Ukrainian)
Kantsur I. H., Kononova O. Ye., Khmarska I. A. (2022) Upravlinnia personalom v umovakh tsyfrovoi ekonomiky [Personnel management in the digital economy]. Ekonomika ta derzhava – Economy and State, no. 2, pp. 103–108. https://doi.org/10.32702/2306-6806.2022.2.103 (in Ukrainian)
Ferguson R. (2012) Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning, vol. 4, no. 5/6, pp. 304–317. https://doi.org/10.1504/IJTEL.2012.051816
Gasevic D., Dawson S., Siemens G. (2015) Let's not forget: Learning analytics are about learning. TechTrends, vol. 59, no. 1, pp. 64–71. https://doi.org/10.1007/s11528-014-0822-x
Gasevic D., Dawson S., Rogers T., Gasevic D. (2016) Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education, vol. 28, pp. 68–84. https://doi.org/10.1016/j.iheduc.2015.10.002
Pardo A., Han F., Ellis R. A. (2017) Combining university student self-regulated learning indicators and engagement with online learning events to predict academic performance. IEEE Transactions on Learning Technologies, vol. 10, no. 1, pp. 82–92. https://doi.org/10.1109/TLT.2016.2639508
Aldowah H., Al-Samarraie H., Fauzy W. M. (2019) Educational data mining and learning analytics for 21st century higher education: A review and synthesis. Telematics and Informatics, vol. 37, pp. 13–49. https://doi.org/10.1016/j.tele.2019.01.007
Marler J. H., Boudreau J. W. (2017) An evidence-based review of HR Analytics. The International Journal of Human Resource Management, vol. 28, no. 1, pp. 3–26. https://doi.org/10.1080/09585192.2016.1244699
Huselid M. A. (2018) The science and practice of workforce analytics: Introduction to the HRM special issue. Human Resource Management, vol. 57, no. 3, pp. 679–684. https://doi.org/10.1002/hrm.21916
Yoon S. W., Han S., Chae C. (2024) People analytics and human resource development: Research landscape and future needs based on bibliometrics and scoping review. Human Resource Development Review, vol. 23, no. 1, pp. 30–57. https://doi.org/10.1177/15344843231209362
Lee J. Y., Lee Y. (2024) Integrative literature review on people analytics and implications from the perspective of human resource development. Human Resource Development Review, vol. 23, no. 1, pp. 58–87. https://doi.org/10.1177/15344843231217181
Kirkpatrick J. D., Kirkpatrick W. K. (2016) Kirkpatrick's Four Levels of Training Evaluation. ATD Press.
Copyright (c) 2026 Надія Любомудрова, Ігор Ямщиков

This work is licensed under a Creative Commons Attribution 4.0 International License.

