research
∙
06/08/2023
BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping
Diffusion models have demonstrated excellent potential for generating di...
share
research
∙
06/05/2023
PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Model
Autoregressive models for text sometimes generate repetitive and low-qua...
research
∙
04/13/2023
Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction
3D-aware image synthesis encompasses a variety of tasks, such as scene g...
research
∙
04/13/2023
Learning Controllable 3D Diffusion Models from Single-view Images
Diffusion models have recently become the de-facto approach for generati...
research
∙
03/11/2023
Stabilizing Transformer Training by Preventing Attention Entropy Collapse
Training stability is of great importance to Transformers. In this work,...
research
∙
03/07/2023
MAST: Masked Augmentation Subspace Training for Generalizable Self-Supervised Priors
Recent Self-Supervised Learning (SSL) methods are able to learn feature ...
research
∙
03/01/2023
Diffusion Probabilistic Fields
Diffusion probabilistic models have quickly become a major approach for ...
research
∙
02/20/2023
NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion
Novel view synthesis from a single image requires inferring occluded reg...
research
∙
10/10/2022
f-DM: A Multi-stage Diffusion Model via Progressive Signal Transformation
Diffusion models (DMs) have recently emerged as SoTA tools for generativ...
research
∙
07/10/2022
Progressively-connected Light Field Network for Efficient View Synthesis
This paper presents a Progressively-connected Light Field network (ProLi...
research
∙
06/05/2022
Multilingual Neural Machine Translation with Deep Encoder and Multiple Shallow Decoders
Recent work in multilingual translation advances translation quality sur...
research
∙
04/12/2022
Detection, Disambiguation, Re-ranking: Autoregressive Entity Linking as a Multi-Task Problem
We propose an autoregressive entity linking model, that is trained with ...
research
∙
04/11/2022
Unified Speech-Text Pre-training for Speech Translation and Recognition
We describe a method to jointly pre-train speech and text in an encoder-...
research
∙
04/09/2022
IDPG: An Instance-Dependent Prompt Generation Method
Prompt tuning is a new, efficient NLP transfer learning paradigm that ad...
research
∙
04/06/2022
Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentation
Direct speech-to-speech translation (S2ST) models suffer from data scarc...
research
∙
02/07/2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language
While the general idea of self-supervised learning is identical across m...
research
∙
12/15/2021
Textless Speech-to-Speech Translation on Real Data
We present a textless speech-to-speech translation (S2ST) system that ca...
research
∙
10/18/2021
StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis
We propose StyleNeRF, a 3D-aware generative model for photo-realistic hi...
research
∙
09/14/2021
fairseq S^2: A Scalable and Integrable Speech Synthesis Toolkit
This paper presents fairseq S^2, a fairseq extension for speech synthesi...
research
∙
07/12/2021
Direct speech-to-speech translation with discrete units
We present a direct speech-to-speech translation (S2ST) model that trans...
research
∙
06/22/2021
Volume Rendering of Neural Implicit Surfaces
Neural volume rendering became increasingly popular recently due to its ...
research
∙
06/03/2021
Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Control
We propose Neural Actor (NA), a new method for high-quality synthesis of...
research
∙
06/02/2021
Lightweight Adapter Tuning for Multilingual Speech Translation
Adapter modules were recently introduced as an efficient alternative to ...
research
∙
12/31/2020
Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade
Fully non-autoregressive neural machine translation (NAT) is proposed to...
research
∙
12/31/2020
CLEAR: Contrastive Learning for Sentence Representation
Pre-trained language models have proven their unique powers in capturing...
research
∙
11/16/2020
Facebook AI's WMT20 News Translation Task Submission
This paper describes Facebook AI's submission to WMT20 shared news trans...
research
∙
11/05/2020
Detecting Hallucinated Content in Conditional Neural Sequence Generation
Neural sequence models can generate highly fluent sentences but recent s...
research
∙
11/02/2020
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation
We introduce dual-decoder Transformer, a new model architecture that joi...
research
∙
08/02/2020
Multilingual Translation with Extensible Multilingual Pretraining and Finetuning
Recent work demonstrates the potential of multilingual pretraining of cr...
research
∙
07/31/2020
SimulEval: An Evaluation Toolkit for Simultaneous Translation
Simultaneous translation on both text and speech focuses on a real-time ...
research
∙
07/22/2020
Neural Sparse Voxel Fields
Photo-realistic free-viewpoint rendering of real-world scenes using clas...
research
∙
07/21/2020
PointContrast: Unsupervised Pre-training for 3D Point Cloud Understanding
Arguably one of the top success stories of deep learning is transfer lea...
research
∙
06/22/2020
Self-Supervised Representations Improve End-to-End Speech Translation
End-to-end speech-to-text translation can provide a simpler and smaller ...
research
∙
06/16/2020
Cross-lingual Retrieval for Iterative Self-Supervised Training
Recent studies have demonstrated the cross-lingual alignment ability of ...
research
∙
06/09/2020
Improving Cross-Lingual Transfer Learning for End-to-End Speech Recognition with Speech Translation
Transfer learning from high-resource languages is known to be an efficie...
research
∙
02/04/2020
CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpus
Spoken language translation has recently witnessed a resurgence in popul...
research
∙
01/22/2020
Multilingual Denoising Pre-training for Neural Machine Translation
This paper demonstrates that multilingual denoising pre-training produce...
research
∙
01/15/2020
Parallel Machine Translation with Disentangled Context Transformer
State-of-the-art neural machine translation models generate a translatio...
research
∙
11/07/2019
Understanding Knowledge Distillation in Non-autoregressive Machine Translation
Non-autoregressive machine translation (NAT) systems predict a sequence ...
research
∙
10/22/2019
Depth-Adaptive Transformer
State of the art sequence-to-sequence models perform a fixed number of c...
research
∙
09/30/2019
Revisiting Self-Training for Neural Sequence Generation
Self-training is one of the earliest and simplest semi-supervised method...
research
∙
09/28/2019
The Source-Target Domain Mismatch Problem in Machine Translation
While we live in an increasingly interconnected world, different places ...
research
∙
09/26/2019
Monotonic Multihead Attention
Simultaneous machine translation models start generating a target sequen...
research
∙
09/19/2019
Improved Variational Neural Machine Translation by Promoting Mutual Information
Posterior collapse plagues VAEs for text, especially for conditional tex...
research
∙
09/14/2019
Harnessing Indirect Training Data for End-to-End Automatic Speech Translation: Tricks of the Trade
For automatic speech translation (AST), end-to-end approaches are outper...
research
∙
09/14/2019
Leveraging Out-of-Task Data for End-to-End Automatic Speech Translation
For automatic speech translation (AST), end-to-end approaches are outper...
research
∙
09/12/2019
VizSeq: A Visual Analysis Toolkit for Text Generation Tasks
Automatic evaluation of text generation tasks (e.g. machine translation,...
research
∙
09/07/2019
Neural Machine Translation with Byte-Level Subwords
Almost all existing machine translation models are built on top of chara...
research
∙
06/04/2019
Improved Zero-shot Neural Machine Translation via Ignoring Spurious Correlations
Zero-shot translation, translating between language pairs on which a Neu...
research
∙
05/27/2019