74054443-24ab-4697-879a-9c261f55307e20241122055038935naun:naunmdt@crossref.orgMDT DepositInternational Journal of Education and Information Technologies2074-131610.46300/9109http://www.naun.org/cms.action?id=3037312202431220241810.46300/9109.2024.18https://npublications.com/journals/educationinformation/2024.phpSotiriaGournaAgricultural University of Athens, Department of Agribusiness and Supply Chain Management, 1st km Old National Road Thebes-Elefsis, Thebes, 32200, GreeceArtemisRigouAgricultural University of Athens, Department of Agribusiness and Supply Chain Management, 1st km Old National Road Thebes-Elefsis, Thebes, 32200, GreeceFoteiniKyriaziAgricultural University of Athens, Department of Agribusiness and Supply Chain Management, 1st km Old National Road Thebes-Elefsis, Thebes, 32200, GreeceCatherineMarinagiAgricultural University of Athens, Department of Agribusiness and Supply Chain Management, 1st km Old National Road Thebes-Elefsis, Thebes, 32200, GreeceLearning Analytics (LA) is a field of research and practice that uses data analysis to comprehend and optimize learning and the environment in which learning takes place. As an AI tool in higher education, LA is expected to improve student learning and support the academic community in teaching delivery, institutional management, long-term research and development, innovation, data-driven decision-making, and more. We have conducted a literature review to explore these issues and examine the added value of LA in higher education. We have focused on the key issues that educational institutions need to consider to get the most out of LA use. The findings of this review reveal that the proper use of the LA toolkit can enhance the development of an appropriate educational environment through the careful determination of ethics and policies that support the main institutional objective, and the study of opportunities, challenges, and trends in the sector. The key challenges of using AI tools like LA in Higher Education are data privacy and protection, data ownership, data heterogeneity, potential biases in AI algorithms, and the need for alignment of institutional strategies for LA with pedagogical approaches. The trends highlight the current advances in LA that give added value in higher education.112220241122202413314213https://npublications.com/journals/educationinformation/2024/a262008-013(2024).pdf10.46300/9109.2024.18.13https://npublications.com/journals/educationinformation/2024/a262008-013(2024).pdf10.19173/irrodl.v24i2.7063T. Bates, Teaching in a Digital Age: Guidelines for Designing and Learning, 2nd ed., Vancouver, BC: Tony Bates Associates Limited, 2019. https://open.umn.edu/opentextbooks/textbooks/teaching -in-a-digital-age-guidelines-for-designing-teaching-andlearning-for-a-digital-age. Accessed 20-06-24. 10.3390/su16146118E. Katsamakas, O.V. Pavlov, and R. Saklad, “Artificial Intelligence and the Transformation of Higher Education Institutions: A Systems Approach,” Sustainability, vol. 16, no. 14, 6118, 2024. https://doi.org/10.3390/su16146118. 10.1186/s41239-019-0171-0O. Zawacki-Richter, V.I. Marín, M. Bond, and F. Gouverneur, “Systematic review of research on artificial intelligence applications in higher education – where are the educators?,” International Journal of Educational Technology in Higher Education, vol. 16, article no. 39, 2019. https://doi.org/10.1186/s41239- 019-0171-0. 10.1109/access.2022.3177752T. Shaik, T. Xiaohui, Y. Li, C. Dann, J. McDonald, P. Redmond, and L. Galligan, “A Review of the Trends and Challenges in Adopting Natural Language Processing Methods for Education Feedback Analysis,” IEEE Access, vol. 10, pp. 56720–56739, 2022. https://doi.org/10.1109/ACCESS.2022.3177752. 10.1186/s40561-022-00192-zM. Yağcı, “Educational data mining: prediction of students’ academic performance using machine learning algorithms,” Smart Learning Environments, vol. 9, no. 11, 2022. https://doi.org/10.1186/s40561- 022-00192-z. 10.1108/idd-06-2018-0018S. El Alfy, J. Marx Gómez and A. Dani, “Exploring the benefits and challenges of learning analytics in higher education institutions: a systematic literature review,” Information Discovery and Delivery, vol. 47, no. 1, pp. 25–34, 2019. https://doi.org/10.1108/IDD-06- 2018-0018. 10.1177/0002764213498851G. Siemens, “Learning Analytics: The Emergence of a Discipline,” American Behavioral Scientist, vol. 57, no. 10, pp. 1380–1400, 2013. https://doi.org/10.1177/0002764213498851. 10.1016/j.chb.2018.07.027O. Viberg, M. Hatakka, O. Bälter, and A. Mavroudi, “The current landscape of learning analytics in higher education,” Computers in Human Behavior, vol. 89, pp. 98–110, 2018. https://doi.org/10.1016/j.chb.2018.07.027. 10.1111/bjet.13234C. Mutimukwe, O. Viberg, L.M. Oberg, and T. Cerratto-Pargman, “Students' privacy concerns in learning analytics: Model development,” British Journal of Educational Technology, vol. 53, pp. 935–951, 2022. https://doi.org/10.1111/bjet.13234. 10.1111/hequ.12192T. Posselt, N. Abdelkafi, L. Fischer, and C. Tangour, “Opportunities and challenges of higher education institutions in Europe: An analysis from a business model perspective,” Higher Education Quarterly, vol. 73, no. 1, pp. 100–115, 2018. https://doi.org/10.1111/hequ.12192. M. Saaida, “AI-Driven transformations in higher education: Opportunities and challenges,” International Journal of Educational Research and Studies,” vol. 5, no. 1, 2023, pp. 29–36, 2023. https://doi.org/10.5281/zenodo.8164414. 10.30574/gscarr.2024.18.3.0088O. Akinrinola, C.C. Okoye, O. C. Ofodile, and C. E. Ugochukwu, “Navigating and reviewing ethical dilemmas in AI development: Strategies for transparency, fairness, and accountability,” GSC Advance Research and Reviews, vol. 18, no. 3, pp. 50– 58, 2024. https://doi.org/10.30574/gscarr.2024.18.3.0088. 10.1111/bjet.12907X. Chen, D. Zou, and H. Xie, “Fifty years of British Journal of Educational Technology: A topic modeling based bibliometric perspective,” British Journal of Educational Technology, vol. 51, no. 3, pp. 692–708, 2020. https://doi.org/10.1111/bjet.12907. 10.1186/s12911-018-0594-xX. Chen, X. Xie, F. L. Wang, Z. Liu, J. Xu, and T. Hao, “A bibliometric analysis of natural language processing in medical research,” BMC Medical Informatics and Decision Making, vol. 18, no. 1, pp. 1–14, 2018. https://doi.org/10.1186/s12911-018-0594-x. 10.1007/s10639-022-11536-0N. Sghir, A. Adadi, and M. Lahmer, “Recent advances in Predictive Learning Analytics: A decade systematic review (2012–2022),” Education and Information Technologies, vol. 28, pp. 8299–8333, 2023. https://doi.org/10.1007/s10639-022-11536-0. 10.3390/admsci13090196G. Babu and O. Wooden, “Managing the Strategic Transformation of Higher Education through Artificial Intelligence,” Administrative Sciences, vol. 13, 196, 2023. https://doi.org/10.3390/admsci13090196. 10.53761/caraaq92A. Nguyen, M. Kremantzis, A. Essien, I. Petrounias, and S. Hosseini, “Enhancing Student Engagement Through Artificial Intelligence (AI): Understanding the Basics, Opportunities, and Challenges,” Journal of University Teaching and Learning Practice, vol. 21, no. 06, pp. 1, 2024. https://doi.org/10.53761/caraaq92. 10.1007/s10639-022-11281-4S. Heikkinen, M. Saqr, J. Malmberg, and M. Tedre, “Supporting self-regulated learning with learning analytics interventions – a systematic literature review,” Education and Information Technologies, vol. 28, pp. 3059–3088, 2023. https://doi.org/10.1007/s10639-022- 11281-4. 10.1007/978-3-319-52977-6_1P. Leitner, M. Khalil, and M. Ebner, “Learning Analytics in Higher Education—A Literature Review,” In: Peña-Ayala, A. Eds., Learning Analytics: Fundaments, Applications, and Trends. Studies in Systems, Decision and Control, vol. 94, Springer, Cham, 2017, pp. 1–23. https://doi.org/10.1007/978-3- 319-52977-6_1. 10.1002/widm.1355C. Romero and S. Ventura, “Educational data mining and learning analytics: An updated survey,” Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, vol. 10, no. 3, e1355, 2020. https://doi.org/10.1002/widm.1355. 10.3390/app10031042J. L. Rastrollo-Guerrero, J. A. Gómez-Pulido, and A. Durán-Domínguez, “Analyzing and predicting students’ performance by means of machine learning: A Review,” Applied Sciences, vol. 10, no. 3, 1042, 2020. https://doi.org/10.3390/app10031042. C. V. Müller, “Ethics of artificial intelligence and robotics”, in E. N. Zalta, Ed., Stanford Encyclopedia of Philosophy, Palo Alto: CSLI, Stanford University, 2020, pp. 1–70. https://plato.stanford.edu/entries/ethicsai/. Accessed: 02-08-24. 10.18608/jla.2021.1T. Cerratto Pargman, and C. McGrath, “Mapping the ethics of learning analytics in higher education: A systematic literature review of empirical research,” Journal of Learning Analytics, vol. 8, no. 2, pp. 123– 139, 2021. https://doi.org/10.18608/jla.2021.1. 10.18608/jla.2023.7975M. Francis, M. Avoseh, K. Card, L. Newland, and K. Streff, “Student Privacy and Learning Analytics: Investigating the Application of Privacy Within a Student Success Information System in Higher Education,” Journal of Learning Analytics, vol. 10, no. 3, pp. 102–114, 2023. https://doi.org/10.18608/jla.2023.7975. 10.1145/3027385.3027400Y.-S. Tsai and D. Gasevic, “Learning analytics in higher education - challenges and policies: a review of eight learning analytics policies,” LAK ’17: Proceedings of the Seventh International Learning Analytics and Knowledge Conference, Mar. 2017, pp. 233–242. https://doi.org/10.1145/3027385.3027400. B. Dietz-Uhler and J. E. Hurn, “Using learning analytics to predict (and improve) student success: A faculty perspective,” Journal of Interactive Online Learning, vol. 12, no. 1, pp. 17–26, 2013. https://www.ncolr.org/issues/jiol/v12/n1/using-learninganalytics-to-predict-and-improve-student-success.html. Accessed 20-06-24. W. Greller and H. Drachsler, “Translating learning into numbers: A generic framework for learning analytics,” Journal of Educational Technology and Society, vol. 15, no. 3, pp. 42–57, 2012. https://drive.google.com/file/d/1R84FXoT3W3X6C2JV 1BBXha3tCoOQiQ7l/view. Accessed 05-06-24. 10.1080/2331186x.2022.2162697S. Caspari-Sadeghi, “Learning assessment in the age of big data: Learning analytics in higher education,” Cogent Education, vol. 10, 2023. https://doi.org/10.1080/2331186X.2022.2162697. 10.1007/978-3-319-17727-4_15-1Z. Papamitsiou and A. A. Economides, “Learning analytics for smart learning environments: A metaanalysis of empirical research results from 2009 to 2015,” in J. M. Spector, B. B. Lockee, and D. M. Childress, Eds., Learning, design, and Technology: An international compendium of theory, research, practice, and policy, New York: Springer, 2016, pp. 1–23. https://doi.org/10.1007/978-3-319-17727-4_15-1. 10.7176/jep/10-12-05O. Adejo and T. Connolly, “Learning analytics in higher education development: A roadmap,” Journal of Education and Practice, vol. 8, no. 15, pp. 156–163, 2017. https://doi.org/10.7176/JEP https://iiste.org/Journals/index.php/JEP/article/view/370 46. 10.24059/olj.v20i2.790J.T. Avella, M. Kebritchi, S.G. Nunn, and T. Kanai, “Learning analytics methods, benefits, and challenges in higher education: A systematic literature review,” in K. Vignare, P. Moskal, A.F. Wise, and M. Pistilli, Eds. Special Issue on Online Learning Analytics. Online Learning Journal, vol. 20, no. 2, 2016. https://doi.org/10.24059/olj.v20i2.790. 10.1007/s10639-022-11323-xA.S. Alzahrani, Y.S. Tsai, S. Iqbal, P.M.M. Marcos, M. Scheffel, H. Drachsler, C. D. Kloos, N. Aljohani, and D. Gasevic, “Untangling connections between challenges in the adoption of learning analytics in higher education,” Education and Information Technologies, vol. 28, pp. 4563–4595, 2023. https://doi.org/10.1007/s10639-022-11323-x. 10.1145/3303772.3303796S. Slade, P. Prinsloo, and M. Khalil, “Learning analytics at the intersections of student trust, disclosure and benefit,” in D. Azcona and R. Chumg Eds., ICPS Proceedings of the 9th International Conference on Learning Analytics and Knowledge – LAK 2019, March 4-8, Temple, Arizona, USA, 2019, New York: ACM, pp. 235–244. https://doi.org/10.1145/3303772.3303796. 10.1007/978-3-319-99713-1_5C. F. Mondschein and C. Monda, “The EU’s general data protection regulation (GDPR) in a research context,” in P. Kubben, M. Dumontier, and A. Dekker, Eds., Fundamentals of Clinical Data Science, Springer, 2019, pp. 55–71. https://doi.org/10.1007/978-3-319- 99713-1_5. 10.1007/s11423-016-9464-3D. West, H. Huijser, and D. Heath, “Putting an ethical lens on learning analytics,” Educational Technology Research and Development, vol. 64, no. 5, pp. 903– 922, 2016. https://doi.org/10.1007/s11423-016-9464-3. 10.3389/fpsyg.2016.01959L. D. Roberts, J. A. Howell, K. Seaman, and D. C. Gibson, “Student attitudes toward learning analytics in higher education: ‘the Fitbit version of the learning world’,” Frontiers in Psychology, vol. 7, pp. 1-11, 2016. https://doi.org/10.3389/fpsyg.2016.01959. 10.1177/0002764213479366S. Slade and P. Prinsloo, “Learning analytics: Ethical issues and dilemmas,” American Behavioral Scientist, vol. 57, no. 10, pp. 1510–1529, 2013. https://doi.org/10.1177/0002764213479366. 10.1126/science.aax2342Z. Obermeyer, B. Powers, C. Vogeli, and S. Mullainathan, “Dissecting racial bias in an algorithm used to manage the health of populations,” Science, vol. 366, no. 6464, pp. 447–453, 2019. https://www.science.org/doi/10.1126/science.aax2342. 10.18608/jla.2016.33.11D. B. Knight, C. Brozina, and B. Novoselich, “An investigation of first-year engineering student and instructor perspectives of learning analytics approaches,” Journal of Learning Analytics, vol. 3, no. 3, pp. 215–238, 2016. https://doi.org/10.18608/jla.2016.33.11. K. L. Webber and H. Zheng, Big data on campus: data analytics and decision making in higher education, Johns Hopkins University Press, 2020. L. Macfadyen and S. Dawson, “Numbers are not enough. Why e-learning analytics failed to inform an institutional strategic plan,” Educational Technology and Society, vol. 15, no. 3, pp. 149–163, Jan. 2012. https://drive.google.com/file/d/1TTNkuJmWOYsB_np3 Et7ozDuqlSCqWMrd/view Accessed 05-06-24. 10.1080/0144929x.2018.1512940M. D. Lytras, N. Aljohani, A. Visvizi, P. Ordonez De Pablos, and D. Gasevic, “Advanced decision-making in higher education: learning analytics research and key performance indicators,” Behaviour and Information Technology, vol. 37, nos. 10-11, pp. 937–940, 2018. https://doi.org/10.1080/0144929X.2018.1512940. 10.18608/jla.2024.8131I. Kotorov, Y. Krasylnykova, M. Pérez-Sanagustín, F. Mansilla, and J. Broisin, “Supporting Decision-Making for Promoting Teaching and Learning Innovation: A Multiple Case Study,” Journal of Learning Analytics, vol. 11, no. 1, pp. 21–36, 2024. https://doi.org/10.18608/jla.2024.8131. A. Mountford-Zimdars, D. Sabri, J. Moore, J. Sanders, S. Jones, and L. Higham, Causes of differences in student outcomes, London UK: HEFCE, July 2015. https://pure.manchester.ac.uk/ws/portalfiles/portal/3279 9307/FULL_TEXT.PDF. Accessed 10-06-24. 10.1145/3027385.3027396R. Ferguson and D. Clow, “Where is the evidence? A call to action for learning analytics,” in LAK 2017 Proceedings of the Seventh International Learning Analytics and Knowledge Conference, ACM International Conference Proceedings Series, New York, USA: ACM, 2017, pp. 56–65. https://doi.org/10.1145/3027385.3027396. R. Ferguson, A. Brasher, D. Clow, A. Cooper, G. Hillaire, J. Mittelmeier, B. Rienties, T. Ullmann and R. Vuorikari, “Research evidence on the use of learning analytics: Implications for education policy,” in R. Vuorikari and J. Castanõ Munõz, Eds. Joint research centre science for policy report; EUR 28294 EN, Luxembourg: Publications Office of the European Union, 2016, pp. 1–152. https://doi.org/10.2791/955210. 10.1080/02602938.2019.1682118E. Foster and R. Siddle, “The effectiveness of learning analytics for identifying at-risk students in higher education,” Assessment and Evaluation in Higher Education, vol. 45, no. 06, pp. 842–854, 2019. https://doi.org/10.1080/02602938.2019.1682118. 10.1080/02602938.2016.1174187K. Zimbardi, K. Colthorpe, A. Dekker, C. Engstrom, A. Bugarcic, P. Worthy, R. Victor, P. Chunduri, L. Lluka and P. Long, “Are they using my feedback? The extent of students’ feedback use has a large impact on subsequent academic performance,” Assessment and Evaluation in Higher Education, vol. 42, no. 4, pp. 625– 644, 2017. https://doi.org/10.1080/02602938.2016.1174187. 10.1080/02602938.2017.1353586J. Vulperhorst, C. Lutz, R. de Kleijn, and J. van Tartwijk, “Disentangling the predictive validity of high school grades for academic success in university,” Assessment and Evaluation in Higher Education, vol. 43, no. 3, pp. 399–414, 2018. https://doi.org/10.1080/02602938.2017.1353586. 10.14569/ijacsa.2023.0140642S. Gaftandzhieva, S. Hussain, S. Hilcenko, R. Doneva, and K. Boykova, “Data-driven Decision Making in Higher Education Institutions: State-of-play” International Journal of Advanced Computer Science and Applications (IJACSA), vol. 14, no. 6, 2023. http://dx.doi.org/10.14569/IJACSA.2023.0140642. 10.18608/jla.2023.7935G. Ramaswami, T. Susnjak, and A. Mathrani, “Effectiveness of a Learning Analytics Dashboard for Increasing Student Engagement Levels,” Journal of Learning Analytics, vol. 10, no. 3, pp. 115–134, 2023. https://doi.org/10.18608/jla.2023.7935. 10.1007/s10639-024-12913-7C.C. Yang, J-Y. Wu, and O. Hiroaki, “Learning analytics dashboard-based self-regulated learning approach for enhancing students’ e-book-based blended learning,” Education and Information Technologies, pp. 1–22, 2024. https://doi.org/10.1007/s10639-024-12913-7. 10.1007/978-981-99-1414-2_51X. Shacklock, “From bricks to clicks: The potential of data and analytics in higher education,” The Higher Education Commission’s (HEC) report, 26 Jan. 2016. https://www.policyconnect.org.uk/research/reportbricks-clicks-potential-data-and-analytics-highereducation. Accessed 20-06-24. 10.1007/978-3-031-45630-5_3KNIME, 2024. KNIME Analytics Platform. Open source story. https://www.knime.com/knime-opensource-story Accessed: 02-08-24. 10.1201/b16023-20RapidMiner, 2024. Altair RapidMiner. Data Analytics & AI Platform. https://altair.com/altair-rapidminer. Accessed: 02-08-24. WEKA, 2024. WEKA Data Infrastructure Built for the Cloud and AI Era. https://www.weka.io/company/aboutus/. Accessed: 02-08-24. 10.1111/jcal.12982S. Alhazbi, A. Al-ali, A. Tabassum, A. Al-Ali, A. AlEmadi, T. Khattab, and M. A. Hasan, “Using learning analytics to measure self-regulated learning: A systematic review of empirical studies in higher education,” Journal of Computer Assisted Learning, vol. 40, no. 4, pp. 1658–1674, 2024. https://doi.org/10.1111/jcal.12982. 10.1504/ijepee.2019.10026366E. Ponomarenko, A. Oganesyan, and V. Teslenko, “New trends in higher education: Massive open online courses as an innovative tool for increasing university performance,” International Journal of Economic Policy in Emerging Economies, vol. 12, no. 4, pp. 391–406, 2019. https://doi.org/10.1504/IJEPEE.2019.104635. 10.1007/s10639-022-11120-6Y. Jang, S. Choi, H. Jung, and H. Kim, “Practical early prediction of students’ performance using machine learning and explainable AI,” Education and Information Technologies, vol. 27, no. 9, pp. 1–35, 2022. https://doi.org/10.1007/s10639-022-11120-6. 10.1016/j.dss.2024.114229E. Tiukhova, P. Vemuri, N. L. Flores, A. S. Islind, M. Óskarsdóttir, S. Poelmans, B. Baesens and M. Snoeck, “Explainable Learning Analytics: Assessing the stability of student success prediction models by means of explainable AI,” Decision Support Systems, vol. 182, 114229, 2024. https://doi.org/10.1016/j.dss.2024.114229.