research
∙
07/20/2022
DataPerf: Benchmarks for Data-Centric AI Development
Machine learning (ML) research has generally focused on models, while th...
share
research
∙
03/24/2022
k-Rater Reliability: The Correct Unit of Reliability for Aggregated Human Annotations
Since the inception of crowdsourcing, aggregation has been a common stra...
research
∙
11/19/2021
Data Excellence for AI: Why Should You Care
The efficacy of machine learning (ML) models depends on both algorithms ...
research
∙
06/11/2021
Cross-replication Reliability – An Empirical Approach to Interpreting Inter-rater Reliability
We present a new approach to interpreting IRR that is empirical and cont...
research
∙
11/05/2019