research
∙
03/14/2023
Chat with the Environment: Interactive Multimodal Perception using Large Language Models
Programming robot behaviour in a complex world faces challenges on multi...
share
research
∙
03/07/2023
Sample-efficient Real-time Planning with Curiosity Cross-Entropy Method and Contrastive Learning
Model-based reinforcement learning (MBRL) with real-time planning has sh...
research
∙
02/20/2023
Emphasizing Unseen Words: New Vocabulary Acquisition for End-to-End Speech Recognition
Due to the dynamic nature of human language, automatic speech recognitio...
research
∙
02/01/2023
Internally Rewarded Reinforcement Learning
We study a class of reinforcement learning problems where the reward sig...
research
∙
01/09/2023
Learning Bidirectional Action-Language Translation with Limited Supervision and Incongruent Input
Human infant learning happens during exploration of the environment, by ...
research
∙
12/14/2022
Disentangling Prosody Representations with Unsupervised Speech Reconstruction
Human speech can be characterized by different components, including sem...
research
∙
11/23/2022
Whose Emotion Matters? Speaker Detection without Prior Knowledge
The task of emotion recognition in conversations (ERC) benefits from the...
research
∙
11/22/2022
Visually Grounded Commonsense Knowledge Acquisition
Large-scale commonsense knowledge bases empower a broad range of AI appl...
research
∙
11/16/2022
Data Augmentation with Unsupervised Speaking Style Transfer for Speech Emotion Recognition
Currently, the performance of Speech Emotion Recognition (SER) systems i...
research
∙
08/04/2022
Impact Makes a Sound and Sound Makes an Impact: Sound Guides Representations and Explorations
Sound is one of the most informative and abundant modalities in the real...
research
∙
07/15/2022
Learning Flexible Translation between Robot Actions and Language Descriptions
Handling various robot action-language translation tasks flexibly is an ...
research
∙
07/06/2022
Knowing Earlier what Right Means to You: A Comprehensive VQA Dataset for Grounding Relative Directions via Multi-Task Learning
Spatial reasoning poses a particular challenge for intelligent agents an...
research
∙
05/05/2022
What is Right for Me is Not Yet Right for You: A Dataset for Grounding Relative Directions via Multi-Task Learning
Understanding spatial relations is essential for intelligent agents to a...
research
∙
02/27/2022
A Multimodal German Dataset for Automatic Lip Reading Systems and Transfer Learning
Large datasets as required for deep learning of lip reading do not exist...
research
∙
01/17/2022
Language Model-Based Paired Variational Autoencoders for Robotic Language Learning
Human infants learn language while interacting with their environment in...
research
∙
12/09/2021
LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Reading
The aim of this work is to investigate the impact of crossmodal self-sup...
research
∙
11/11/2021
Lifelong Learning from Event-based Data
Lifelong learning is a long-standing aim for artificial agents that act ...
research
∙
09/01/2021
FaVoA: Face-Voice Association Favours Ambiguous Speaker Detection
The strong relation between face and voice can aid active speaker detect...
research
∙
08/03/2021
Generalization in Multimodal Language Learning from Simulation
Neural networks can be powerful function approximators, which are able t...
research
∙
07/26/2021
Robotic Occlusion Reasoning for Efficient Object Existence Prediction
Reasoning about potential occlusions is essential for robots to efficien...
research
∙
04/12/2021
Survey on reinforcement learning for language processing
In recent years some researchers have explored the use of reinforcement ...
research
∙
03/29/2021
Visual Distant Supervision for Scene Graph Generation
Scene graph generation aims to identify objects and their relations in i...
research
∙
03/23/2021
A Sub-Layered Hierarchical Pyramidal Neural Architecture for Facial Expression Recognition
In domains where computational resources and labeled data are limited, s...
research
∙
02/10/2021
Improving Model-Based Reinforcement Learning with Internal State Representations through Self-Supervision
Using a model of the environment, reinforcement learning agents can plan...
research
∙
06/24/2020
Crossmodal Language Grounding in an Embodied Neurocognitive Model
Human infants are able to acquire natural language seemingly easily at a...
research
∙
05/17/2020
Multimodal Target Speech Separation with Voice and Face References
Target speech separation refers to isolating target speech from a multi-...
research
∙
04/19/2020
Improving Robot Dual-System Motor Learning with Intrinsically Motivated Meta-Control and Latent-Space Experience Imagination
Combining model-based and model-free learning systems has been shown to ...
research
∙
12/02/2019
Enriching Existing Conversational Emotion Datasets with Dialogue Acts using Neural Annotators
The recognition of emotion and dialogue acts enrich conversational analy...
research
∙
10/10/2019
Efficient Intrinsically Motivated Robotic Grasping with Learning-Adaptive Imagination in Latent Space
Combining model-based and model-free deep reinforcement learning has sho...
research
∙
09/05/2019
What can computational models learn from human selective attention? A review from an audiovisual crossmodal perspective
Selective attention plays an essential role in information acquisition a...
research
∙
05/05/2019
Curious Meta-Controller: Adaptive Alternation between Model-Based and Model-Free Control in Deep Reinforcement Learning
Recent success in deep reinforcement learning for continuous control has...
research
∙
03/01/2019
KT-Speech-Crawler: Automatic Dataset Construction for Speech Recognition from YouTube Videos
In this paper, we describe KT-Speech-Crawler: an approach for automatic ...
research
∙
02/28/2019
Incorporating End-to-End Speech Recognition Models for Sentiment Analysis
Previous work on emotion recognition demonstrated a synergistic effect o...
research
∙
10/26/2018
Deep Intrinsically Motivated Continuous Actor-Critic for Efficient Robotic Visuomotor Skill Learning
In this paper, we present a new intrinsically motivated actor-critic alg...
research
∙
06/29/2018
Discourse-Wizard: Discovering Deep Discourse Structure in your Conversation with RNNs
Spoken language understanding is one of the key factors in a dialogue sy...
research
∙
05/28/2018
Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organization
Humans excel at continually acquiring and fine-tuning knowledge over sus...
research
∙
05/16/2018
A Context-based Approach for Dialogue Act Recognition using Simple Recurrent Neural Networks
Dialogue act recognition is an important part of natural language unders...
research
∙
05/16/2018
Conversational Analysis using Utterance-level Attention-based Bidirectional Recurrent Neural Networks
Recent approaches for dialogue act recognition have shown that context f...
research
∙
04/06/2018
On the Robustness of Speech Emotion Recognition for Human-Robot Interaction with Deep Neural Networks
Speech emotion recognition (SER) is an important aspect of effective hum...
research
∙
04/03/2018
EmoRL: Continuous Acoustic Emotion Classification using Deep Reinforcement Learning
Acoustically expressed emotions can make communication with a robot more...
research
∙
03/30/2018
Reusing Neural Speech Representations for Auditory Emotion Recognition
Acoustic emotion recognition aims to categorize the affective state of t...
research
∙
03/30/2018
Automatically augmenting an emotion dataset improves classification using audio
In this work, we tackle a problem of speech emotion classification. One ...
research
∙
04/25/2017