research
∙
07/12/2023
Ecosystem-level Analysis of Deployed Machine Learning Reveals Homogeneous Outcomes
Machine learning is traditionally studied at the model level: researcher...
share
research
∙
05/03/2023
Cheaply Evaluating Inference Efficiency Metrics for Autoregressive Transformer APIs
Large language models (LLMs) power many state-of-the-art systems in natu...
research
∙
03/28/2023
Ecosystem Graphs: The Social Footprint of Foundation Models
Foundation models (e.g. ChatGPT, StableDiffusion) pervasively influence ...
research
∙
12/20/2022
Trustworthy Social Bias Measurement
How do we design measures of social bias that we trust? While prior work...
research
∙
12/20/2022
Evaluation for Change
Evaluation is the central means for assessing, understanding, and commun...
research
∙
12/19/2022
Evaluating Human-Language Model Interaction
Many real-world applications of language models (LMs), such as code auto...
research
∙
11/25/2022
Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?
As the scope of machine learning broadens, we observe a recurring theme ...
research
∙
11/16/2022
Holistic Evaluation of Language Models
Language models (LMs) are becoming the foundation for almost all major l...
research
∙
05/04/2022
Data Governance in the Age of Large-Scale Data-Driven Language Technology
The recent emergence and adoption of Machine Learning technology, and sp...
research
∙
08/13/2021