Accessibility Tools
Having studied assessment practices in 5 European funding agencies, the GRANteD project research team concludes that formal policies are important to foster inclusiveness, but several limitations must still be tackled to implement these formal policies into practice and thus enable these organisations to truly spearhead change.
Fair grant allocation is key to guaranteeing that the best researchers receive funding for the best proposals. But equally, it must ensure that no one is discriminated against due to their sex, gender, age, native language or other social dimensions.
To see how this works in practice, an EU-funded project has investigated gender bias in the allocation of research grants and the impact grants have on the careers of female and male researchers. From 2019 to 2023, the GRANteD (Grant allocation disparities from a gender perspective) project worked closely with five research funding organisations* from across Europe. These organisations served as cases to be studied in depth – by interviewing staff, management, remote reviewers, panel members and panel chairs and by observing panels - while also delivering funding data that were analysed from a gender perspective. In addition, they were active in the project’s Stakeholder Committee, together with umbrella organisations such as the European University Association and Science Europe, and representatives from sister projects, like GENDERACTIONplus. Here they were involved in fine-tuning research questions and reflecting on preliminary research findings, as well as in discussing policy recommendations.
In our policy analysis, we found that all five organisations have formal policies in place to mitigate gender bias, yet these differ in scale and scope. Those with advanced policies have established themselves as actors for change, constantly adopting and broadening their policy portfolio to improve the assessment of research grants. Therefore, various general policies as well as specific gender equality policies have been implemented, aiming for more inclusiveness in science and research.
When research funding organisations try to transform fundamental narratives within the research ecosystem, they become ‘spearheads of change’. They do so, for example, by implementing formal policies to change the understanding of excellence or implementing quotas for funding outcomes to encourage more members of minority groups to apply. Putting such innovative policies in place, RFOs sets new standards, both for applicants, on how to conduct research, and for reviewers, on how to assess research.
However, it isn’t enough to put these policies on paper and agree to them. They need to be implemented in concrete everyday practices in peer review panels. Indeed, from studying how policies are implemented we have seen some limitations, and thus, some potential for improvement.
For example, the narrative CV has been used to broaden the concept of excellence. However, reviewers struggle with giving up the h-index as benchmark for assessing merits. Further, they want to keep the h-index as a backup to check the information that applicants reported qualitatively. Another important example is how gender is taken into account in all research proposals (or how it is justified if it is not considered relevant). Here, reviewers lacked clarity on this policy and its aims and accordingly, assessing it in an informed manner was nearly impossible. Most reviewers lacked awareness about gender as a dimension of structural inequality and as an analytic dimension in their respective research fields. Therefore, the task of broadening the understanding of excellence by integrating the sex/gender dimension into the research content and innovation processes, and thereby contributing to research outcomes that are beneficial for all subgroups of society, still needs some concerted effort.
Overall, we found that innovative formal policies are not necessarily implemented in practice in peer review panels. It takes time and understanding to apply new policies, and some stakeholders – panel chairs, panel members and remote reviewers – are not always sufficiently ‘prepared’ to implement them.
To facilitate implementation in practice, a few aspects should be considered:
*Austrian Science Fund; National Science Centre, Poland; Science Foundation Ireland, Swedish Research Council; Slovak Research and Development Agency.
Helene Schiffbänker is a sociologist and senior researcher at Joanneum Research, Austria. Her research focuses on the implementation of gender equality measures in research organisations, in particular on research funding organisations implementing policies to mitigate (gender) bias in research assessment.
Picture credit: JOANNEUM RESEARCH/Bergmann
Michael Ploder is an economist and head of the research group on technology, innovation, policy consulting at Joanneum Research, Austria. His research focuses on the evaluation of funding programmes in science, technology and innovation.