research
∙
03/23/2023
A Gold Standard Dataset for the Reviewer Assignment Problem
Many peer-review venues are either using or looking to use algorithms to...
share
research
∙
11/22/2022
How do Authors' Perceptions of their Papers Compare with Co-authors' Perceptions and Peer-review Decisions?
How do author perceptions match up to the outcomes of the peer-review pr...
research
∙
04/12/2022
ASQA: Factoid Questions Meet Long-Form Answers
An abundance of datasets and availability of reliable evaluation metrics...
research
∙
03/31/2022
To ArXiv or not to ArXiv: A Study Quantifying Pros and Cons of Posting Preprints Online
Double-blind conferences have engaged in debates over whether to allow a...
research
∙
03/31/2022
Cite-seeing and Reviewing: A Study on Citation Bias in Peer Review
Citations play an important role in researchers' careers as a key factor...
research
∙
07/02/2021
Vox Populi, Vox DIY: Benchmark Dataset for Crowdsourced Audio Transcription
Domain-specific data is the crux of the successful transfer of machine l...
research
∙
12/01/2020
Debiasing Evaluations That are Biased by Evaluations
It is common to evaluate a set of items by soliciting people to rate the...
research
∙
11/30/2020
A Large Scale Randomized Controlled Trial on Herding in Peer-Review Discussions
Peer review is the backbone of academia and humans constitute a cornerst...
research
∙
11/30/2020
A Novice-Reviewer Experiment to Address Scarcity of Qualified Reviewers in Large Conferences
Conference peer review constitutes a human-computation process whose imp...
research
∙
11/30/2020
Prior and Prejudice: The Novice Reviewers' Bias against Resubmissions in Conference Peer Review
Modern machine learning and computer science conferences are experiencin...
research
∙
10/08/2020
Catch Me if I Can: Detecting Strategic Behaviour in Peer Assessment
We consider the issue of strategic behaviour in various peer-assessment ...
research
∙
12/31/2019
On Testing for Biases in Peer Review
We consider the issue of biases in scholarly research, specifically, in ...
research
∙
06/16/2018