research
∙
06/22/2023
Overview of Robust and Multilingual Automatic Evaluation Metrics for Open-Domain Dialogue Systems at DSTC 11 Track 4
The advent and fast development of neural networks have revolutionized t...
share
research
∙
05/24/2023
Human-Centered Metrics for Dialog System Evaluation
We present metrics for evaluating dialog systems through a psychological...
research
∙
05/23/2023
How to Choose How to Choose Your Chatbot: A Massively Multi-System MultiReference Data Set for Dialog Metric Evaluation
We release MMSMR, a Massively Multi-System MultiReference dataset to ena...
research
∙
02/04/2023
Lived Experience Matters: Automatic Detection of Stigma toward People Who Use Substances on Social Media
Stigma toward people who use substances (PWUS) is a leading barrier to s...
research
∙
12/20/2022
Needle in a Haystack: An Analysis of Finding Qualified Workers on MTurk for Summarization
The acquisition of high-quality human annotations through crowdsourcing ...
research
∙
11/20/2022
Conceptor-Aided Debiasing of Contextualized Embeddings
Pre-trained language models reflect the inherent social biases of their ...
research
∙
10/20/2022
Automatic Document Selection for Efficient Encoder Pretraining
Building pretrained language models is considered expensive and data-int...
research
∙
05/25/2022
Empathic Conversations: A Multi-level Dataset of Contextualized Conversations
Empathy is a cognitive and emotional reaction to an observed situation o...
research
∙
05/24/2022
Linear Connectivity Reveals Generalization Strategies
It is widely accepted in the mode connectivity literature that when two ...
research
∙
05/24/2022
VIRATrustData: A Trust-Annotated Corpus of Human-Chatbot Conversations About COVID-19 Vaccines
Public trust in medical information is crucial for successful applicatio...
research
∙
05/24/2022
Benchmark Data and Evaluation Framework for Intent Discovery Around COVID-19 Vaccine Hesitancy
The COVID-19 pandemic has made a huge global impact and cost millions of...
research
∙
12/16/2021
Gendered Language in Resumes and its Implications for Algorithmic Bias in Hiring
Despite growing concerns around gender bias in NLP models used in algori...
research
∙
12/16/2021
Trees in transformers: a theoretical analysis of the Transformer's ability to represent trees
Transformer networks are the de facto standard architecture in natural l...
research
∙
11/03/2021
Automatic Evaluation and Moderation of Open-domain Dialogue Systems
The development of Open-Domain Dialogue Systems (ODS)is a trending topic...
research
∙
09/29/2021
Who says like a style of Vitamin: Towards Syntax-Aware DialogueSummarization using Multi-task Learning
Abstractive dialogue summarization is a challenging task for several rea...
research
∙
02/02/2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
We introduce GEM, a living benchmark for natural language Generation (NL...
research
∙
11/01/2020
SMRT Chatbots: Improving Non-Task-Oriented Dialog with Simulated Multiple Reference Training
Non-task-oriented dialog models suffer from poor quality and non-diverse...
research
∙
10/24/2020
Measuring the `I don't know' Problem through the Lens of Gricean Quantity
We consider the intrinsic evaluation of neural generative dialog models ...
research
∙
10/24/2020
An Evaluation Protocol for Generative Conversational Systems
There is a multitude of novel generative models for open-domain conversa...
research
∙
10/14/2020
Decoding Methods for Neural Narrative Generation
Narrative generation is an open-ended NLP task in which a model generate...
research
∙
10/06/2020
COD3S: Diverse Generation with Discrete Semantic Signatures
We present COD3S, a novel method for generating semantically diverse sen...
research
∙
04/30/2020
Revisiting Memory-Efficient Incremental Coreference Resolution
We explore the task of coreference resolution under fixed memory by exte...
research
∙
12/02/2019
Learning Word Ratings for Empathy and Distress from Document-Level User Responses
Despite the excellent performance of black box approaches to modeling se...
research
∙
06/14/2019
Comparison of Diverse Decoding Methods from Conditional Language Models
While conditional language models have greatly improved in their ability...
research
∙
06/14/2019
Conceptor Debiasing of Word Representations Evaluated on WEAT
Bias in word embeddings such as Word2Vec has been widely investigated, a...
research
∙
04/18/2019
Continual Learning for Sentence Representations Using Conceptors
Distributed representations of sentences have become ubiquitous in natur...
research
∙
04/04/2019
Complexity-Weighted Loss and Diverse Reranking for Sentence Simplification
Sentence simplification is the task of rewriting texts so they are easie...
research
∙
11/17/2018
Correcting the Common Discourse Bias in Linear Representation of Sentences using Conceptors
Distributed representations of words, better known as word embeddings, h...
research
∙
11/17/2018
Unsupervised Post-processing of Word Vectors via Conceptor Negation
Word vectors are at the core of many natural language processing tasks. ...
research
∙
10/25/2018
Learning Neural Emotion Analysis from 100 Observations: The Surprising Effectiveness of Pre-Trained Word Representations
Deep Learning has drastically reshaped virtually all areas of NLP. Yet o...
research
∙
08/30/2018
Modeling Empathy and Distress in Reaction to News Stories
Computational detection and understanding of empathy is an important fac...
research
∙
08/02/2017
Domain Aware Neural Dialog System
We investigate the task of building a domain aware chat system which gen...
research
∙
08/02/2017
Enterprise to Computer: Star Trek chatbot
Human interactions and human-computer interactions are strongly influenc...
research
∙
08/01/2017
Deriving Verb Predicates By Clustering Verbs with Arguments
Hand-built verb clusters such as the widely used Levin classes (Levin, 1...
research
∙
01/20/2016