research
∙
06/07/2023
ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systems
Natural Language to SQL systems (NL-to-SQL) have recently shown a signif...
share
research
∙
06/06/2023
Correction of Errors in Preference Ratings from Automated Metrics for Text Generation
A major challenge in the field of Text Generation is evaluation: Human e...
research
∙
05/31/2023
Text-to-Speech Pipeline for Swiss German – A comparison
In this work, we studied the synthesis of Swiss German speech using diff...
research
∙
05/30/2023
STT4SG-350: A Speech Corpus for All Swiss German Dialect Regions
We present STT4SG-350 (Speech-to-Text for Swiss German), a corpus of Swi...
research
∙
10/24/2022
On the Effectiveness of Automated Metrics for Text Generation Systems
A major challenge in the field of Text Generation is evaluation because ...
research
∙
05/19/2022
SDS-200: A Swiss German Speech to Standard German Text Corpus
We present SDS-200, a corpus of Swiss German dialectal speech with Stand...
research
∙
03/18/2022
Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challenges
This is a report on the NSF Future Directions Workshop on Automatic Eval...
research
∙
02/28/2022
Probing the Robustness of Trained Metrics for Conversational Dialogue Systems
This paper introduces an adversarial method to stress-test trained metri...
research
∙
10/05/2020
Spot The Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systems
The lack of time-efficient and reliable evaluation methods hamper the de...
research
∙
05/04/2020
DoQA – Accessing Domain-Specific FAQs via Conversational QA
The goal of this work is to build conversational Question Answering (QA)...
research
∙
04/16/2020
A Methodology for Creating Question Answering Corpora Using Inverse Data Annotation
In this paper, we introduce a novel methodology to efficiently construct...
research
∙
09/26/2019
Towards a Metric for Automated Conversational Dialogue System Evaluation and Improvement
We present "AutoJudge", an automated evaluation method for conversationa...
research
∙
05/10/2019
Survey on Evaluation Methods for Dialogue Systems
In this paper we survey the methods and concepts developed for the evalu...
research
∙
03/07/2017
Leveraging Large Amounts of Weakly Supervised Data for Multi-Language Sentiment Classification
This paper presents a novel approach for multi-lingual sentiment classif...
research
∙
11/11/2015