Matthew
Narratives
Grail
Funder Data Platform
AGORRA
Undisciplined
Peer Review
Portfolios
MetaROR
Getting responsible about AI and machine learning in research funding and evaluation
The GRAIL project is exploring good principles and practices for using AI and machine learning in the research funding ecosystem in ways that are both ethical and effective. The project aims to create an inter-funder community of learning around opportunities, challenges, and facilitators for using AI/ML in research funding and evaluation, and to use funder insights and experiences to explore what more grounded use of AI in their settings looks like. To inform future actions and use of AI/ML, the project will characterise current approaches to and use of AI within research funding and develop specific recommendations for strategies to manage for social and organisational impact of AI usage within funding decision-making and assessment.
The opportunities presented by AI and ML technologies—and the dilemmas and uncertainties that accompany them—are the focus of intense debate in almost every sector, including research. There have been some specific calls to build these technologies into research management and evaluation, and there are now a range of small-scale pilots underway among funders and publishers internationally. However, there is a lack of evidence or guidance on organisational, team, or individual best practices for how to responsibly and effectively integrate AI and ML technologies into decision-making processes in a research funding and evaluation context.
The GRAIL project aims to support funders in the responsible design, use, and evaluation of AI tools through community and mutual learning, organisational insights, and practical guidelines. There are three main strands to the project:
Together, these strands will improve our shared base of knowledge and evidence to enable more effective and responsible use of AI and ML tools in research funding
Denis Newman-Griffis, University of Sheffield & Research Fellow, RoRI
The GRAIL project steering group is co-chaired by Jon Holm (Research Council of Norway); Katrin Milzow (Swiss National Science Foundation); and Gustav Petersson (Swedish Research Council).
Project partners include:
Project Lead
Denis Newman-Griffis
The GRAIL project will run for 24-months until mid-2025. It builds on an initial workshop series co-hosted by RoRI and Research Council of Norway in January 2021 (later summarised in this RoRI/RCN working paper).
The GRAIL project will generate the following outputs:
(1) knowledge-sharing eventsA mixture of public-facing, partner-only and conference events will be used to inform ongoing GRAIL discussions and disseminate findings to relevant audiences. Proposed events include:
(2) publicationsA mix of working papers, academic articles and commentaries, including:
RoRI report summarising the headline findings of the project (spring 2025), including a set of guiding questions for formulating/designing AI projects in research funding settings.