Developing and Approbating a Template Methodology for National Ranking of Higher Education Institutions

NTF mission:

omprehensive support to development of an effective education and research system as a foundation of the Russian economy and society competitiveness

   

Developing and Approbating a Template Methodology for National Ranking of Higher Education Institutions

 

 

 

 

The project Developing and Approbating a Template Methodology for National Ranking of Higher Education Institutions is being implemented by National Training Foundation collaboratively with International Organizations Research Institute of the National Research University Higher School of Economics at the request of the Russian Ministry of Education and Science. The project duration is 3 years: 2011-2013.

The project aims to contribute towards implementation of the Federal Target Programme on Education Development for the Period of 2011 2015, approved by the Government Order of 7th February 2011 No 61, and the Concept for the Long-Term Social and Economic Development of the Russian Federation for the period till 2020,   endorsed by the Government Decree of 17 November 2008, No 1662-p. Both documents emphasize the priority of enhancing the quality of professional education and developing mechanisms of education quality assessment which involve a wide range of stakeholders.

The higher education quality assurance is shifting focus from external quality control relying on national accreditation system towards self-evaluation of higher education institutions based on various models of quality management. This ensures reallocation of responsibility for quality and quality assessment and helps save financial and time resources allocated on external audit.  

There is also a direction from the country top leadership to develop a national education quality assessment system, and methodology and procedures for comparative assessment of higher education institutions.

The project goal is to improve the education quality assurance system and increase demand for educational through development and approbation of a template methodology for national ranking of higher education institutions.

The following key tasks will be undertaken within the project cycle:

  • Analyzing the Russian approaches (methodologies and indicators) used to evaluate higher education institutions performance.

  • Conducting a comparative analysis of global, national and specialized rankings, systematize them and identify their strengths and weaknesses.

  • Carrying out comparative analysis of the methodologies and approaches used in foreign / international practices and methodologies and approaches used in Russian practice.

  • Developing a template methodology for national ranking of higher education institutions.

  • Approbation of the developed methodology.

  • Organizing public and expert discussions of the developed methodology.

  • Arranging consultations with IREG experts to audit the methodology for ranking of the higher education institutions.

  • Developing recommendations on the application of the template methodology for ranking of higher education institutions.

  • Organizing an international conference to discuss the template methodology for national ranking of higher education institutions and the outcomes of its approbation.

 

2011 activities and outcomes

Activities completed during the first stage of the project in 2011:

I. Comprehensive analysis of the Russian approaches (methodologies and indicators) to evaluation of the higher education institutions performance including:

  • Developing a methodology for comparative assessment and conducting analysis of the Russian approaches to evaluation of higher education institutions performance.

  • Identifying and analyzing methodologies and indicators for ranking of higher education institutions.

II. Developing a methodology for comparative analysis and conducting a comparative analysis of global, national and specialized rankings and national approaches to HEI performance evaluation including:

  • Developing a methodology that enables to compare, systematize and identify common, invariable and variable indicators for evaluation of higher education institutions performance used in the global, international and national rankings and classifications, identifying relative strengths and weaknesses of various approaches to evaluation of higher education institutions performance.

  • Carrying out comparative analysis of global, national and specialized rankings, national approaches to HEI performance evaluation.

  • Systematization of approaches and common, invariable and variable indicators for HEI performance evaluation, identification of their strengths and weaknesses.  

III. Developing a methodology for comparative analysis and conducting a comparative analysis of ranking methodologies and key indicators used in international and Russian practices including:

  • Developing a methodology and criteria for comparative analysis of ranking methodologies and key indicators used in international and Russian practices.

  • Conducting a comparative analysis of ranking methodologies and key indicators used in international and Russian practices.

  • Systematization of ranking methodologies and key indicators used in international and Russian practice.

  • Identifying elements (principles, objectives, target group, areas of evaluation, key indicators) for a template methodology of HEI ranking.

 

To ensure comparability of analysis all methodologies have been assessed at three levels of analysis

1 level: Comparing methodologies using common parameters for analysis (target groups, key objectives, areas of evaluation, frequency, method of data collection and processing etc)

2 level: Assessing ranking methodologies against Berlin principles for of HEI ranking and the IREG audit criteria

3 level: Assessing the indicators against criteria of relevance to the Russian education system development objectives, reliability, feasibility of data collection.

 

IV. Carrying out public and experts discussions to reflect on the approaches and indicators proposed and amendng the draft methodology in accordance with the results discussions.

  • The results of the first stage of the project were presented in series of seminars and at the conference Professional education quality assessment systems held in the framework of the project State and public evaluation of higher education institutions and education programmes on 5th December 2011 in Moscow.

 

Download presentation of the project.

2012 activities and outcomes:

Development of a Template Methodology for National Ranking of Higher Education Institutions

Approbation of the Template Methodology for National Ranking of Higher Education Institutions

Conducting public discussions of the Template Methodology within workshops, conference, consultations with IREG experts

Amending the methodology in accordance with the results of the discussions and consulatations on the application of the template methodology for national ranking of higher education institutions

Key outcomes:

The developed methodology

The methodology approbation outcomes

The outcomes of experts and public discussions of the methodology

The outcomes of experts and public discussions of the recommendations

The recommendations for application of the methodology for national ranking of higher education institutions

 

Materials:

Key provisions of a template methodology for ranking Russian higher education institutions

Methodology toolkit

International workshop conference Lessons from Multidimensional Ranking of Russian Higher Education Institutions: from Piloting to Practice (25-26 April 2013)

Conclusions and recommendations on the methodology for multidimensional ranking of the Russian higher education institutions

Recommendations on application of the template methodology for multidimensional ranking of the higher education institutions  

 

Contacts:

Marina V. Larionova, Head of the International Projects, NTF

E-mail: larionova@ntf.ru

Olga V. Perfilieva, Director of the Center for International Comparative Studies, International Organizations Research Institute, HSE

E-mail: Perfilieva@hse.ru

 
e-Publish