Intra-RUB Collaboration: first paper

Dunja and Christian started collaborating with Daniel Eisenhardt, Christian Meske and Johannes Schneider on Mitigating Bias in Academic Publishing: Towards Responsible AI-Augmentation in Peer-Rewiew Processes. A first paper will be presented at MCIS/CAPSI 2024. Here’s our abstract:

The anonymized peer review process, fundamental to maintaining the quality of scientific publications, has been both praised and criticized. Concerns over various biases, including those related to authors’ affiliations, gender, and groundbreaking ideas, have led to calls for critical reflection. In addition, scientific output and hence the number of necessary reviews has increased tremendously. In that context, machine learning models, and large language models such as ChatGPT more specifically, have been explored as potential solutions to enhance the reviewing process. Yet, AI can be biased itself. Thus, a systematic approach to designing AI systems that mitigate bias in peer review is lacking. Our study hence aims to address this gap by formulating design principles for (gen)AI-augmented review systems. Utilizing an echeloned design science research (DSR) methodology, the project seeks to develop new design knowledge and create a prototype system incorporating these principles.