Implementing Narrative CVs – Five recommendations for Funders 3 March 2025Practical recommendations to help research funders create a supportive environment for the effective implementation of Narrative CVs.
Funding Transdisciplinary Research 17 January 2025Practical recommendations for research funders on funding transdisciplinary research, based on findings from RoRI’s UNDISCIPLINED Project
A new typology of national research assessment systems: continuity and change in 13 countries (RoRI Working Paper No.15) 16 May 2025
Taming complexity: narrative CVs in grant funding evaluations (RoRI Working Paper No. 14) 29 November 2024
GRAIL: Codesigning responsible uses of AI in research funding and evaluation(RoRI Working Paper No. 13) 24 October 2024
UNDISCIPLINED: How do research funders define transdisciplinary research? (RoRI Working Paper No. 12) 27 September 2024
Transforming excellence? From ‘matter of fact’ to ‘matter of concern’ in research funding organizations
The pandemic veneer: COVID-19 research as a mobilisation of collective intelligence by the global research community
Why draw lots? Funder motivations for using partial randomisation to allocate research grants (RoRI Working Paper No.7)
Where next for partial randomisation of research funding? The feasibility of RCTs and alternatives (RoRI Working Paper No.9)
Good practice in the use of machine learning & AI by research funding organisations: insights from a workshop series
Experiments with randomisation in research funding: scoping and workshop report (RoRI Working Paper No.4)
The changing role of funders in responsible research assessment: progress, obstacles and the way ahead (RoRI Working Paper No.3)
Career pathways in research Report prepared by a research team at the Centre for Science and Technology Studies (CWTS) at Leiden University, presenting the results of the first phase of the Career Pathways in Research RoRI project.
21st Century PhDs: Why we need better methods of tracking doctoral access, experiences and outcomes (RoRI Working Paper No.2)
Innovating peer review, reconfiguring scholarly communication An analytical overview of ongoing peer review innovation activities
Newman-Griffis, D. (2025). AI Thinking: a framework for rethinking artificial intelligence in practice. Royal Society Open Science 12:241482 08 January 2025
Stafford T, Rombach I, Hind D et al. Where next for partial randomisation of research funding? The feasibility of RCTs and alternatives. Wellcome Open Research 2023, 8:309 30 May 2024
Rzayeva N, Henriques SO, Pinfield S, Waltman L. 2023. The experiences of COVID-19 preprint authors: a survey of researchers about publishing and receiving feedback on their work during the pandemic. Peer J 11:e15864 22 August 2023
Waltman, L., Kaltenbrunner, W., Pinfield, S., & Woods, H. B. (2023). How to improve scientific peer review: Four schools of thought. Learned Publishing. 27 April 2023
Hook, D. W. & Wilsdon, J. R. (2023). The pandemic veneer: COVID-19 research as a mobilisation of collective intelligence by the global research community. Collective Intelligence, 2(1). 13 February 2023
Woods HB, Brumberg J, Kaltenbrunner, W et al. An overview of innovations in the external peer review of journal manuscripts. Wellcome Open Research 2023, 7: 82 27 January 2023
Kaltenbrunner, W., Pinfield, S., Waltman, L., Woods HB and Brumberg, J. (2022). Innovating peer review, reconfiguring scholarly communication: an analytical overview of ongoing peer review innovation activities. Journal of Documentation. Vol. 78 No. 7, pp.429-449 3 August 2022
Woods HB and Pinfield S. Incentivising research data sharing: a scoping review. Wellcome Open Research 2022, 6:355 6 April 2022
Transforming Assessment: the 2025 Global Research Council survey of funder approaches to responsible research assessment 16 May 2025
AGORRA and GRAIL Project Workshops & RoRI 2024 Consortium Meeting summary report 21 January 2025Workshop notes on responsible research assessment frameworks and using AI in research funding, and a summary report of the RoRI consortium meeting in Oslo, 29-31 October 2024
RoRI UNDISCIPLINED workshop & consortium meeting summary report 1 February 2024Workshop notes on funding and evaluation of transdisciplinary research, and a summary report of the RoRI consortium meeting in Hannover, 4-5 December 2023
The experimental research funder’s handbook The experimental research funder’s handbook (2nd edition, ISBN 978-1-7397102-0-0) 5 September 2023The Handbook synthesises insights from funders within the Research on Research Institute consortium that have conducted trials with new approaches to review, allocation and evaluation.
Harnessing the Metric Tide: indicators, infrastructures & priorities for UK responsible research assessment 12 December 2022Review revisiting the findings of the 2015 review The Metric Tide to take a fresh look at the use of indicators in research management and assessment.
Research on Research Institute: Independent Review of Pilot Phase (2019-2021) 2 June 2022In early 2022, RoRI commissioned Carter Research Navigation to provide an independent review of RoRI’s pilot phase.
Scholarly communication in times of crisis: The response of the scholarly communication system to the COVID-19 pandemic 6 December 2021This report analyses how the scholarly communication system – involving the production, evaluation, and dissemination of research outputs – has responded to the COVID-19 pandemic crisis.
A checklist for funder experiments with partial randomisation 2 June 2022The checklist is intended as a support tool for research funders looking to experiment with partial randomisation.
Health Research Funding Landscape Tool 29 September 2019This landscape shows 1,313 research fields in the health sciences. By changing the size and colour coding, the contribution of a specific research funder to the different fields can be made visible
Research Funding Landscape Tool 29 September 2019This landscape shows 2,890 research fields across all sciences. By changing the size and colour coding, the contribution of a specific research funder to the different fields can be made visible.
Funding Transdisciplinary Research 17 January 2025Slidedeck with practical recommendations for research funders on funding transdisciplinary research, based on findings from RoRI’s UNDISCIPLINED Project
GRAIL: Developing responsible practices for AI and machine learning in research funding and evaluation with a community of learning 4 July 2024RoRI Research Fellow Denis Newman-Griffis discussed RoRI’s GRAIL project at the 2024 Data for Policy conference.
Are we all metascientists now? The shifting landscape for research on research 22 February 2024James Wilsdon explores how the fields of metascience, meta-research and research on research are evolving and expanding.
Research evaluation in transition: challenges & opportunities 6 July 2022James Wilsdon describes progress towards responsible research assessment (RRA) over the past 5-10 years.
Has the tide turned towards responsible metrics? 4 July 2022Talk for Northumbria Open Research Week, where James Wilsdon describes progress in agendas for responsible metrics and responsible research assessment (RRA) over the past 5-10 years.
RoRI Funder Data Platform & CRITERIA project overview 2 June 2022An overview of RoRi’s Funder Data Platform, for data-sharing and analysis by research funders, and of the early findings of the CRITERIA study-the first project to use the platform.
Can we fix it? Are incremental tweaks to research practices, cultures & assessment sufficient, or is it time for more radical change? 25 May 2022 Presentation to the UKRIO Annual Conference by James Wilsdon
Experiments in evaluation: lessons from randomisation in research funding 1 December 2021RoRI-SNSF-EMBO workshop covering insights from a consortium of research funders involved in trials of randomisation in funding, and related experiments in grant allocation.