research
∙
08/07/2023
Studying Large Language Model Generalization with Influence Functions
When trying to gain better visibility into a machine learning model in o...
share
research
∙
06/28/2023
Towards Measuring the Representation of Subjective Global Opinions in Language Models
Large language models (LLMs) may not equitably represent diverse global ...
research
∙
06/20/2023
Opportunities and Risks of LLMs for Scalable Deliberation with Polis
Polis is a platform that leverages machine intelligence to scale up deli...
research
∙
05/29/2023
Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Models
To recognize and mitigate harms from large language models (LLMs), we ne...
research
∙
03/30/2023
Whose Opinions Do Language Models Reflect?
Language models (LMs) are increasingly being used in open-ended contexts...
research
∙
01/31/2023
Benchmarking Large Language Models for News Summarization
Large language models (LLMs) have shown promise for automatic summarizat...
research
∙
12/21/2022
Tracing and Removing Data Errors in Natural Language Generation Datasets
Recent work has identified noisy and misannotated data as a core cause o...
research
∙
12/19/2022
Evaluating Human-Language Model Interaction
Many real-world applications of language models (LMs), such as code auto...
research
∙
11/16/2022
Holistic Evaluation of Language Models
Language models (LMs) are becoming the foundation for almost all major l...
research
∙
11/07/2022
Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale
Machine learning models are now able to convert user-written text descri...
research
∙
04/21/2022
Spurious Correlations in Reference-Free Evaluation of Text Generation
Model-based, reference-free evaluation metrics have been proposed as a f...
research
∙
03/21/2022
Language modeling via stochastic processes
Modern language models can generate high-quality short texts. However, t...
research
∙
10/03/2021
Towards Understanding Persuasion in Computational Argumentation
Opinion formation and persuasion in argumentation are affected by three ...
research
∙
08/31/2021
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization
Despite recent progress in abstractive summarization, systems still suff...
research
∙
02/02/2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
We introduce GEM, a living benchmark for natural language Generation (NL...
research
∙
10/07/2020
Exploring the Role of Argument Structure in Online Debate Persuasion
Online debate forums provide users a platform to express their opinions ...
research
∙
10/07/2020
WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization
We introduce WikiLingua, a large-scale, multilingual dataset for the eva...
research
∙
05/07/2020
FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization
Neural abstractive summarization models are prone to generate content in...
research
∙
04/06/2020
The Role of Pragmatic and Discourse Context in Determining Argument Impact
Research in the social sciences and psychology has shown that the persua...
research
∙
06/26/2019
Determining Relative Argument Specificity and Stance for Complex Argumentative Structures
Systems for automatic argument generation and debate require the ability...
research
∙
06/26/2019
A Corpus for Modeling User and Language Effects in Argumentation on Online Debating
Existing argumentation datasets have succeeded in allowing researchers t...
research
∙
06/26/2019