research
∙
08/22/2023
ViCo: Engaging Video Comment Generation with Human Preference Rewards
Engaging video comments play an important role in video social media, as...
share
research
∙
06/09/2023
Pave the Way to Grasp Anything: Transferring Foundation Models for Universal Pick-Place Robots
Improving the generalization capabilities of general-purpose robotic age...
research
∙
05/30/2023
AlphaBlock: Embodied Finetuning for Vision-Language Reasoning in Robot Manipulation
We propose a novel framework for learning high-level cognitive capabilit...
research
∙
05/20/2023
ComedicSpeech: Text To Speech For Stand-up Comedies in Low-Resource Scenarios
Text to Speech (TTS) models can generate natural and high-quality speech...
research
∙
12/31/2022
Translating Text Synopses to Video Storyboards
A storyboard is a roadmap for video creation which consists of shot-by-s...
research
∙
09/14/2022
CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment
The pre-trained image-text models, like CLIP, have demonstrated the stro...
research
∙
09/02/2022
Multi-Modal Experience Inspired AI Creation
AI creation, such as poem or lyrics generation, has attracted increasing...
research
∙
06/25/2022
Self-supervised Context-aware Style Representation for Expressive Speech Synthesis
Expressive speech synthesis, like audiobook synthesis, is still challeng...
research
∙
04/01/2022
AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios
Adaptive text to speech (TTS) can synthesize new voices in zero-shot sce...
research
∙
12/22/2021
Class-aware Sounding Objects Localization via Audiovisual Correspondence
Audiovisual scenes are pervasive in our daily life. It is commonplace fo...
research
∙
09/12/2021
Stylistic Retrieval-based Dialogue System with Unparallel Training Data
The ability of a dialog system to express consistent language style duri...
research
∙
05/20/2020
ScriptWriter: Narrative-Guided Script Generation
It is appealing to have a system that generates a story or scripts autom...
research
∙
01/03/2020
"Love is as Complex as Math": Metaphor Generation System for Social Chatbot
As the wide adoption of intelligent chatbot in human daily life, user de...
research
∙
11/24/2019
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
A storyboard is a sequence of images to illustrate a story containing mu...
research
∙
08/20/2019
From Text to Sound: A Preliminary Study on Retrieving Sound Effects to Radio Stories
Sound effects play an essential role in producing high-quality radio sto...
research
∙
08/09/2018
Image Inspired Poetry Generation in XiaoIce
Vision is a common source of inspiration for poetry. The objects and the...
research
∙
03/08/2017