research
∙
05/09/2023
StarCoder: may the source be with you!
The BigCode community, an open-scientific collaboration working on the r...
share
research
∙
05/03/2023
Cheaply Evaluating Inference Efficiency Metrics for Autoregressive Transformer APIs
Large language models (LLMs) power many state-of-the-art systems in natu...
research
∙
12/19/2022
Evaluating Human-Language Model Interaction
Many real-world applications of language models (LMs), such as code auto...
research
∙
11/16/2022
Holistic Evaluation of Language Models
Language models (LMs) are becoming the foundation for almost all major l...
research
∙
12/09/2021
Extending the WILDS Benchmark for Unsupervised Adaptation
Machine learning systems deployed in the wild are often trained on a sou...
research
∙
02/01/2021
Can Small and Synthetic Benchmarks Drive Modeling Innovation? A Retrospective Study of Question Answering Modeling Approaches
Datasets are not only resources for training accurate, deployable system...
research
∙
12/30/2019