Norway
- Evaluations of specific subjects and thematic areas
- Indicator-Based Funding
Purpose
In Norway, evaluation of specific subjects and thematic areas is conducted approximately every ten years, per subject area. It is a formative exercise focused on accountability, organisational learning, and development. The exercise involves informed peer review by international expert panels, who provide a critical review of the Norwegian research system and offer recommendations to improve quality and efficiency. The results are primarily used locally at each institution and do not directly affect institutional funding. Reports are published, with the basic data and methods made publicly available.
Year of Introduction
1990s
Census period
10 years
Governance agency(s)
Research Council of Norway
Purpose
Accountability
Organisational Learning and Strategic Development
Unit of Assessment
The organisation as a whole
Units within the organisation – Research groups
Disciplines across organisations
Focus of Assessment
Scholarly outputs
Societal interaction
Research culture
Career development
Governance
The Research Council of Norway is mandated by the government to “cater for the assessment of research in Norway” (Vedtekter for Norges Forskningsråd, §2.10). To fulfil this role, the Council organises subject-specific evaluations, in which research groups across Norway are expected to participate (voluntarily).
Operation of the exercise
The focus of the subject-specific and thematic area evaluations includes the assessment of scholarly outputs, societal interaction, research culture, and career development.
The subject-specific and thematic area evaluations assess units within organisations, such as research groups and administrative units (departments, faculties).
The evaluation of specific subjects and thematic areas in Norway is based on informed peer review conducted by international expert panels. Research groups are assessed using qualitative data, including sample publications. Groups are graded on three dimensions: Organisation, Research Quality, and Societal Relevance. Administrative units (departments, faculties) are assessed based on a combination of research group assessment results (as mentioned above), self-assessments, personnel data, and bibliometrics.
History, reviews and evaluations
In the second round of the evaluation of specific subjects and thematic areas, an impact case template styled after the UK REF was introduced to document societal impact. In the current iteration (3rd round), the evaluation model has moved in the direction of organisational evaluation, inspired by the Dutch Standard Evaluation Protocol. The Norwegian protocol includes sector-specific criteria and an option for units under evaluation to include in the Terms of Reference “specific aspects that the evaluation committee should focus on – they may be related to a) strategic issues, or b) an administrative unit’s specific tasks”.
While there has been no complete external evaluation to date, a group mandated by the Ministry for research and education published a proposal for a framework for national evaluations of research and education in 2021.
Last updated: May 2025
Acknowledgement: Information provided by Jon Holm and Gunnar Sivertsen.
Purpose
The Norwegian indicator-oriented, performance-based funding system is a summative assessment model that allocates a small share of research funding based on four indicators of research performance. This system combines research and educational indicators and does not rely solely on dedicated research activities. Starting in 2025, the indicator-based system will no longer apply to universities but will remain in place for hospitals and public research institutes.
Year of Introduction
2004
Census period
1 year
Governance agency(s)
Ministry of Education and Research, Ministry of Health, Research Council of Norway
Purpose
Funding allocation
Unit of Assessment
The organisation as a whole
Focus of Assessment
Scholarly outputs
Competitive grants
Governance
The Norwegian indicator-based funding system is managed by the Ministry of Education and Research for the higher education sector; the Ministry of Health for research in the hospitals, and the Research Council of Norway (mandated by MER) for the institute sector.
Operation of the exercise
The focus of the Norwegian performance-based funding system for research-related indicators is on scholarly outputs and competitive grants obtained.
The Norwegian indicator-based funding system focuses on assessing the institution as a whole.
The system allocates a share of research funding based on four indicators of research performance in the health sector and for research institutes
- Publication points (scientific publications adjusted for publication type (article/chapter in anthology/monograph) the number of authors and journal prestige (two levels)
- Funding from the European Commission
- Funding from the Research Council of Norway
- Public and private revenue (such as education and R&D funds from municipalities, businesses and private investors, etc.) ]
These four indicators of research activity are now used for statistical purposes only in the higher education sector.
History, reviews and evaluations
Open Access (OA) has been added as a criterium in journal evaluation since 2018 but quality of procedures remains the primary criterium. On the other hand, several OA journals of questionable quality have been deleted from the list of approved journals.
Starting in 2025, the indicator-based system will no longer apply to universities but will remain in place for hospitals and public research institutes.
The Norwegian indicator has influenced the development of similar systems in other Scandinavian countries, albeit the original was adapted rather than replicated.
Last updated: May 2025
Acknowledgement: Information provided by Jon Holm and Gunnar Sivertsen.
Norway
- Number of Systems
- 2
- Name of System(s)
- Evaluations of specific subjects and thematic areas
- Indicator-Based Funding
