d91b993f-c3bb-429d-84af-59e206764a3320220117090806060naun:naunmdt@crossref.orgMDT DepositInternational Journal of Education and Information Technologies2074-131610.46300/9109http://www.naun.org/cms.action?id=3037111202211120221610.46300/9109.2022.16https://npublications.com/journals/educationinformation/2022.phpSergeyPronichkinFederal Research Center “Computer Science and Control” of Russian Academy of Sciences, 40, Vavilov Street, Moscow, 119333 RussiaIgorMamaiFederal Center of Theoretical and Applied Sociology of Russian Academy of Sciences, 24/35, Krzhizhanovsky Street, Moscow, 117218 RussiaBorisSavelyevFederal Center of Theoretical and Applied Sociology of Russian Academy of Sciences, 24/35, Krzhizhanovsky Street, Moscow, 117218 RussiaZafarVazirovFederal Center of Theoretical and Applied Sociology of Russian Academy of Sciences, 24/35, Krzhizhanovsky Street, Moscow, 117218 RussiaThe strategy of innovative development of Russia requires the formation of national research universities of the international level. Twenty-nine Russian universities have already been awarded this status. They are faced with a difficult task - to become the movers of priority areas for the development of science, technology, economic sectors, and the social sphere. The paper discusses the issue of assessing the quality of the activities of universities in the category "National Research University" (NRU). The disadvantages of existing approaches to assessing the activities of universities are highlighted. It is proposed to use self-assessment with the involvement of independent experts as a tool for assessing the activities of the NRU and its improvement. A process model and criteria for assessing the quality of the activities of a national research university have been developed. A mathematical model of the preferences of a decision-maker (DM) for a comprehensive assessment of the quality of NRU activities has been built. The model takes into account the individual and rational preferences of decision makers, as well as the balance of approaches and results to ensure the quality of NRU activities. Estimates of the numerical values of the parameters of the developed mathematical model are determined. For this, an experiment was planned and a D-optimal supersaturated design was built. The quality indicators of the developed model are calculated, which allow us to conclude that the developed model better describes the results of the experiment than the existing models.1172022117202255616https://npublications.com/journals/educationinformation/2022/a122008-006(2022).pdf10.46300/9109.2022.16.6https://npublications.com/journals/educationinformation/2022/a122008-006(2022).pdf10.1016/j.sbspro.2012.09.1136A. Sen, K. Kabak, and D. Kuzalic, “Democratization of University Management for Quality Higher Education,” Procedia - Social and Behavioral Sciences, vol. 58, pp. 1491-1504, 2012. 10.1016/j.sbspro.2015.11.472I. Lapina, I. Kairisa, and D. Aramina, “Role of Organizational Culture in the Quality Management of University,” Procedia - Social and Behavioral Sciences, vol. 213, pp. 770-774, 2015. 10.1016/j.joi.2020.101110N. Matveeva, I. Sterligov, and M. Yudkevich, “The effect of Russian University Excellence Initiative on publications and collaboration patterns,” Journal of Informetrics, vol. 15, pp. 1-15, 2020. 10.1016/j.polsoc.2014.07.002J. Weinrib, and G. Jones, “Largely a matter of degrees: Quality assurance and Canadian universities,” Policy and Society, vol. 33, pp. 225-236, 2014. 10.1016/j.ijme.2020.100366J. Hays, V. Pereseina, and J. Saha, “Lessons in Sustainable Process Paradigm. A case study from Dubai,” The International Journal of Management Education, vol. 18, pp. 1-9, 2020. 10.1016/j.indmarman.2017.01.001A. Pohlmann, and V. Kaartemo, “Research trajectories of Service-Dominant Logic: Emergent themes of a unifying paradigm in business and management,” Industrial Marketing Management, vol. 63, pp. 53-68, 2017. 10.1016/j.sbspro.2014.12.555T. Sidorenko, and T. Gorbatova, “Efficiency of Russian Education Through the Scale of World University Rankings,” Procedia - Social and Behavioral Sciences, vol. 166, pp. 464-467, 2015. 10.1016/j.procs.2018.08.124V. Ivancevic, and I. Lukovic, “National university rankings based on open data: A case study from Serbia,” Procedia Computer Science, vol. 126, pp. 1516-1525, 2018. 10.1016/j.procs.2019.11.063M. Samuel, C. Vasquez, and D. Cabrera, “Clustering of Top 50 Latin American Universities in SIR, QS, ARWU, and Webometrics Rankings,” Procedia Computer Science, vol. 160, pp. 467-472, 2019. 10.1016/j.pubrev.2016.10.013A. Thurlow, A. Kushniryk, and A. Simon, “Evaluating excellence: A model of evaluation for public relations practice in organizational culture and context,” Public Relations Review, vol. 43, pp. 71-79, 2017. 10.1016/j.sbspro.2015.01.977M. Hamid, M. Abdullah, and H. Ahmad, “Conceptual Framework of Innovation Excellence Model for Higher Education Institutions,” Procedia - Social and Behavioral Sciences, vol. 174, pp. 2846-2848, 2015. 10.1016/j.evalprogplan.2020.101816J. Mantilla, A. Zarzuelo, and F. Cruz, “Do ISO:9001 standards and EFQM model differ in their impact on the external relations and communication system at schools?,” Evaluation and Program Planning, vol. 80, pp. 1-17, 2020. 10.1016/j.procs.2019.09.122D. Hıdıroglu, “Self- assessment Performance Measurement in Construction Companies: An Application of the EFQM Excellence Model on Processes and Customer Stages,” Procedia Computer Science, vol. 158, pp. 844-851, 2019. 10.1016/j.procs.2019.11.063M. Samuel, C. Vasquez, and D. Cabrera, “Clustering of Top 50 Latin American Universities in SIR, QS, ARWU, and Webometrics Rankings,” Procedia Computer Science, vol. 160, pp. 467-472, 2019. 10.1016/j.jengtecman.2018.04.007C. Esparrells, and E. Malea, “Do the technical universities exhibit distinct behaviour in global university rankings? A Times Higher Education (THE) case study,” Journal of Engineering and Technology Management, vol. 48, pp. 97-108, 2018. 10.1016/j.ijedudev.2014.10.004B. Millot, “International rankings: Universities vs. higher education systems,” International Journal of Educational Development, vol. 40, pp. 156-165, 2015. 10.1016/j.techfore.2016.03.029G. Olcay, and M. Bulu, “Is measuring the knowledge creation of universities possible?: A review of university rankings,” Technological Forecasting and Social Change, vol. 123, pp. 153-160, 2016. 10.1016/j.sbspro.2012.06.147K. Pavlina, “Webometric Ranking of European Universities,” Procedia - Social and Behavioral Sciences, vol. 46, pp. 3788-3792, 2012. 10.1016/j.matcom.2018.05.021P. Kunsch, and A. Ishizaka, “Multiple-criteria performance ranking based on profile distributions: An application to university research evaluations,” Mathematics and Computers in Simulation, vol. 154, pp. 48-64, 2018. 10.1016/j.eswa.2021.115770B. Menı̇ z, “An advanced TOPSIS method with new fuzzy metric based on interval type-2 fuzzy sets,” Expert Systems with Applications, vol. 186, pp. 1-11, 2021. 10.1016/j.spl.2015.08.001G. Dutta, and R. Ray, “D- and E-optimal blocked main effects plans with unequal block sizes when n is odd,” Statistics & Probability Letters, vol. 107, pp. 37-43, 2015. 10.1016/j.spl.2010.09.026M. Jacroux, “On the D-optimality of orthogonal and nonorthogonal blocked main effects plans,” Statistics & Probability Letters, vol. 81, pp. 116-120, 2011. 10.1016/j.ress.2021.107968Y. Jung, and I. Lee, “Optimal design of experiments for optimization-based model calibration using Fisher information matrix,” Reliability Engineering & System Safety, vol. 216, pp. 1-15, 2021. 10.1016/0167-9473(96)80457-9C. Berding, W. Kleider, and R. Gossl, “DoPE: D-optimal planning & experimentation the tool for experimental design in research and development,” Computational Statistics & Data Analysis, vol. 21, pp. 705-710, 1996. 10.1101/095851S. Nakagawa, P. Johnson, and H. Schielzeth, “The coefficient of determination R2 and intra-class correlation coefficient from generalized linear mixedeffects models revisited and expanded,” Journal of The Royal Society Interface, vol. 14, pp. 1-11, 2017. E. Kasuya, “On the use of R and R squared in correlation and regression,” Ecological Research, vol. 34, pp. 235- 236, 2019. 10.1016/j.csda.2015.08.002W. Hamalainen, “New upper bounds for tight and fast approximation of Fisher’s exact test in dependency rule mining,” Computational Statistics & Data Analysis, vol. 93, pp. 469-482, 2016. 10.1016/j.ins.2018.02.054D. Lima, and R. Barros, “Concept drift detection based on Fisher’s Exact test,” Information Sciences, vol. 442, pp. 220-234, 2018. 10.1016/j.asoc.2015.06.051J. Ezzabadi, M. Saryazdi, and A. Mostafaeipour, “Implementing Fuzzy Logic and AHP into the EFQM model for performance improvement: A case study,” Applied Soft Computing, vol. 36, pp. 165-176, 2015. 10.1016/j.procir.2015.08.079O. Oleghe, and K. Salonitis, “Improving the Efficacy of the Lean Index through the Quantification of Qualitative Lean Metrics,” Procedia CIRP, vol. 37, pp. 42-47, 2015. 10.24833/2071-8160-2018-1-58-94-109R. Reinhardt, and S. Pronichkin, “The realist paradigm of energy diplomacy in the Russian scientific tradition and its practical applicability,” MGIMO Review of International Relations, vol. 1, pp. 94-109, 2018. 10.1016/j.techsoc.2021.101782I. Jonek, A. Musiol, and M. Wolny, “Does motivation matter in evaluation of research institutions? Evidence from Polish public universities,” Technology in Society, vol. 67, pp. 1-18, 2021.