Matthew
Narratives
GRAIL
Funder Data Platform
AGORRA
Undisciplined
Peer Review
Portfolios
MetaROR
AFIRE
Join us for insightful sessions on measuring research cultures, narrative CVs, and the future of research assessment reform
We’re excited to be part of the 28th International Conference on Science, Technology, and Innovation Indicators (STI 2024), taking place in Berlin from 18 to 20 September 2024.
Hosted by Fraunhofer ISI, Humboldt University, and the German Centre for Higher Education Research and Science Studies (DZHW), STI Berlin 2024 will bring together leading experts to discuss the latest trends in science and technology indicators. This year’s theme, “Into the Great Wide Open?”, will focus on the dynamics of openness and closedness in science, technology, and innovation, emphasizing their impact on research, policy, and practice.
Several RoRI researchers will be present at STI Berlin 2024, leading or participating in four insightful sessions. These talks will explore pressing topics, from measuring research cultures to the reform of research assessment. You can find an overview below:
11:15 AM – Track 4, Special SessionCan we measure research cultures? Interactive debate on the possibilities and pitfallsSpeakers: Alex Rushforth, Nosisa Dube, Steven Hill, Moumita Koley, Cameron Neylon, James Wilsdon
The transnational reform movement for responsible research assessment is growing considerably. As part of this, there is increasing interest in monitoring and evaluating research cultures and environments (RCE) within national, program, and institutional assessment processes.
Moving from broad aspirations to workable, transparent, and legitimate evaluation practices is not however straightforward. Meeting these demands will necessitate relevant, trusted and reliable indicators, that can provide the robustness of evidence needed for monitoring and evaluation. Rapidly unfolding developments around RCE indicators thus merit urgent attention from experts within the STI community.
The aim of this special session is to bring together researchers and practitioners to debate urgent questions over emerging RCE indicators, draw out important lessons, and compare experiences across research systems.
The format will consist of short presentations from RoRI’s AGORRA Project team and audience Q&A. Speakers will share insider accounts of the latest policy developments, debates and controversies in their respective national research systems.
9:00 AM – Track 5, Recruiting & CVsTaming complexity: narrative CVs in grant funding evaluationsSpeakers: Judit Varga, Wolfgang Kaltenbrunner, Helen Buckley Woods
This short paper presents preliminary findings from RoRI’s Narratives project, investigating the uptake and use of narrative CVs in review panels for research funding decisions. Our analysis draws on empirical material collected through interviews and participant observation in panel meetings of a funding program for early career researchers of the Dutch national research council NWO.
11:45 AM – Track 4, Special SessionReflexive Bibliometrics on Open Research Information through Participatory ForesightSpeakers: Stephan Gauch, Ludo Waltman, Stephan Stahlschmidt, Rodrigo Costas, Martijn Visser, Nees Jan van Eck, Martin Reinhart, Laura Rothfritz, Heinz Pampel, Jacqueline Sachse, Clemens Blümel, Max Leckert, Marcus John, Bianca Kramer, Cameron Neylon
The aim of this special session is to provide an overview of the current state and potential futures of the landscape of open research information. This will include the quality of the data available from open scientometric data sources, the use and adoption of open scientometric data sources, and developments regarding governance, cooperation, and sustainability of open scientometric data sources.
11:45 AM – Track 5, Research Assessment ReformHow effective are research assessment reform initiatives in mobilizing collective action? Framework and case studies of DORA and CoARASpeakers: Alex Rushforth, Gunnar Sivertsen
We look forward to seeing you there. You can find the full conference programme here.