research
∙
09/14/2023
VoicePAT: An Efficient Open-source Evaluation Toolkit for Voice Privacy Research
Speaker anonymization is the task of modifying a speech recording such t...
share
research
∙
06/11/2023
Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction
Neural models have drastically advanced state of the art for machine tra...
research
∙
05/31/2023
Ethical Considerations for Machine Translation of Indigenous Languages: Giving a Voice to the Speakers
In recent years machine translation has become very successful for high-...
research
∙
05/04/2023
Neighboring Words Affect Human Interpretation of Saliency Explanations
Word-level saliency explanations ("heat maps over words") are often used...
research
∙
04/10/2023
Oh, Jeez! or Uh-huh? A Listener-aware Backchannel Predictor on ASR Transcriptions
This paper presents our latest investigation on modeling backchannel in ...
research
∙
04/10/2023
Modeling Speaker-Listener Interaction for Backchannel Prediction
We present our latest findings on backchannel modeling novelly motivated...
research
∙
03/17/2023
Conversational Tree Search: A New Hybrid Dialog Task
Conversational interfaces provide a flexible and easy way for users to s...
research
∙
11/22/2022
ArzEn-ST: A Three-way Speech Translation Corpus for Code-Switched Egyptian Arabic - English
We present our work on collecting ArzEn-ST, a code-switched Egyptian Ara...
research
∙
10/21/2022
Low-Resource Multilingual and Zero-Shot Multispeaker TTS
While neural methods for text-to-speech (TTS) have shown great advances ...
research
∙
10/20/2022
Improving Semi-supervised End-to-end Automatic Speech Recognition using CycleGAN and Inter-domain Losses
We propose a novel method that combines CycleGAN and inter-domain losses...
research
∙
10/13/2022
How (Not) To Evaluate Explanation Quality
The importance of explainability is increasingly acknowledged in natural...
research
∙
10/13/2022
Anonymizing Speech with Generative Adversarial Networks to Preserve Speaker Privacy
In order to protect the privacy of speech data, speaker anonymization ai...
research
∙
10/11/2022
Exploring Segmentation Approaches for Neural Machine Translation of Code-Switched Egyptian Arabic-English Text
Data sparsity is one of the main challenges posed by Code-switching (CS)...
research
∙
07/31/2022
The Who in Code-Switching: A Case Study for Predicting Egyptian Arabic-English Code-Switching Levels based on Character Profiles
Code-switching (CS) is a common linguistic phenomenon exhibited by multi...
research
∙
07/11/2022
PoeticTTS – Controllable Poetry Reading for Literary Studies
Speech synthesis for poetry is challenging due to specific intonation pa...
research
∙
07/11/2022
Speaker Anonymization with Phonetic Intermediate Representations
In this work, we propose a speaker anonymization pipeline that leverages...
research
∙
06/24/2022
Prosody Cloning in Zero-Shot Multispeaker Text-to-Speech
The cloning of a speaker's voice using an untranscribed reference sample...
research
∙
05/25/2022
Investigating Lexical Replacements for Arabic-English Code-Switched Data Augmentation
Code-switching (CS) poses several challenges to NLP tasks, where data sp...
research
∙
05/03/2022
Meta Learning for Natural Language Processing: A Survey
Deep learning has been the mainstream technique in natural language proc...
research
∙
03/16/2022
BPE vs. Morphological Segmentation: A Case Study on Machine Translation of Four Polysynthetic Languages
Morphologically-rich polysynthetic languages present a challenge for NLP...
research
∙
03/07/2022
Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Features
While neural text-to-speech systems perform remarkably well in high-reso...
research
∙
01/27/2022
Human Interpretation of Saliency-based Explanation Over Text
While a lot of research in explainable AI focuses on producing effective...
research
∙
12/19/2021
Integrating Knowledge in End-to-End Automatic Speech Recognition for Mandarin-English Code-Switching
Code-Switching (CS) is a common linguistic phenomenon in multilingual co...
research
∙
12/19/2021
Investigation of Densely Connected Convolutional Networks with Domain Adversarial Learning for Noise Robust Speech Recognition
We investigate densely connected convolutional networks (DenseNets) and ...
research
∙
12/13/2021
Predicting User Code-Switching Level from Sociological and Psychological Profiles
Multilingual speakers tend to alternate between languages within a conve...
research
∙
12/12/2021
Improving Code-switching Language Modeling with Artificially Generated Texts using Cycle-consistent Adversarial Networks
This paper presents our latest effort on improving Code-switching langua...
research
∙
12/12/2021
Improving Speech Recognition on Noisy Speech via Speech Enhancement with Multi-Discriminators CycleGAN
This paper presents our latest investigations on improving automatic spe...
research
∙
11/29/2021
ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet
As Automatic Speech Processing (ASR) systems are getting better, there i...
research
∙
10/11/2021
Beyond Accuracy: A Consolidated Tool for Visual Question Answering Benchmarking
On the way towards general Visual Question Answering (VQA) systems that ...
research
∙
09/16/2021
Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratings
Natural language inference (NLI) requires models to learn and apply comm...
research
∙
08/29/2021
Investigations on Speech Recognition Systems for Low-Resource Dialectal Arabic-English Code-Switching Speech
Code-switching (CS), defined as the mixing of languages in conversations...
research
∙
07/26/2021
Thought Flow Nets: From Single Predictions to Trains of Model Thought
When humans solve complex problems, they rarely come up with a decision ...
research
∙
06/30/2021
IMS' Systems for the IWSLT 2021 Low-Resource Speech Translation Task
This paper describes the submission to the IWSLT 2021 Low-Resource Speec...
research
∙
04/18/2021
AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages
Pretrained multilingual models are able to perform cross-lingual transfe...
research
∙
03/03/2021
Few-shot Learning for Slot Tagging with Attentive Relational Network
Metric-based learning is a well-known family of methods for few-shot lea...
research
∙
03/02/2021
Investigations on Audiovisual Emotion Recognition in Noisy Conditions
In this paper we explore audiovisual emotion recognition under noisy aco...
research
∙
02/25/2021
Meta-Learning for improving rare word recognition in end-to-end ASR
We propose a new method of generating meaningful embeddings for speech, ...
research
∙
12/04/2020
Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning
Recently, leveraging pre-trained Transformer based language models in do...
research
∙
10/13/2020
Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension
While neural networks with attention mechanisms have achieved superior p...
research
∙
10/13/2020
F1 is Not Enough! Models and Evaluation Towards User-Centered Explainable Question Answering
Explainable question answering systems predict an answer together with a...
research
∙
07/03/2020
Pretrained Semantic Speech Embeddings for End-to-End Spoken Language Understanding via Cross-Modal Teacher-Student Learning
Spoken language understanding is typically based on pipeline architectur...
research
∙
05/04/2020
ADVISER: A Toolkit for Developing Multi-modal, Multi-domain and Socially-engaged Conversational Agents
We present ADVISER - an open-source, multi-domain dialog system toolkit ...
research
∙
09/24/2019
Code-switching Language Modeling With Bilingual Word Embeddings: A Case Study for Egyptian Arabic-English
Code-switching (CS) is a widespread phenomenon among bilingual and multi...
research
∙
08/13/2019
IMS-Speech: A Speech to Text Tool
We present the IMS-Speech, a web based tool for German and English speec...
research
∙
08/13/2019
End-to-End Multi-Speaker Speech Recognition using Speaker Embeddings and Transfer Learning
This paper presents our latest investigation on end-to-end automatic spe...
research
∙
02/28/2019
Context-aware Neural-based Dialog Act Classification on Automatically Generated Transcriptions
This paper presents our latest investigations on dialog act (DA) classif...
research
∙
10/11/2018
Sequence-to-Sequence Models for Data-to-Text Natural Language Generation: Word- vs. Character-based Processing and Output Diversity
We present a comparison of word-based and character-based sequence-to-se...
research
∙
08/27/2018
Comparing Attention-based Convolutional and Recurrent Neural Networks: Success and Limitations in Machine Reading Comprehension
We propose a machine reading comprehension model based on the compare-ag...
research
∙
08/10/2018
Densely Connected Convolutional Networks for Speech Recognition
This paper presents our latest investigation on Densely Connected Convol...
research
∙
07/30/2018