research
∙
11/09/2022
Efficiently Scaling Transformer Inference
We study the problem of efficient generative inference for Transformer m...
share
research
∙
04/05/2022
PaLM: Scaling Language Modeling with Pathways
Large language models have been shown to achieve remarkable performance ...
research
∙
06/18/2019
Zero-Shot Entity Linking by Reading Entity Descriptions
We present the zero-shot entity linking task, where mentions must be lin...
research
∙
06/12/2019
Synthetic QA Corpora Generation with Roundtrip Consistency
We introduce a novel method of generating synthetic question answering c...
research
∙
01/26/2019
Language Model Pre-training for Hierarchical Document Representations
Hierarchical neural architectures are often used to capture long-distanc...
research
∙
10/11/2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
We introduce a new language representation model called BERT, which stan...
research
∙
05/11/2018
Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis
Program synthesis is the task of automatically generating a program cons...
research
∙
02/15/2018
Universal Neural Machine Translation for Extremely Low Resource Languages
In this paper, we propose a new universal machine translation approach f...
research
∙
10/30/2017
Semantic Code Repair using Neuro-Symbolic Transformation Networks
We study the problem of semantic code repair, which can be broadly defin...
research
∙
10/11/2017
Neural Program Meta-Induction
Most recently proposed methods for Neural Program Induction work under t...
research
∙
05/04/2017
Sharp Models on Dull Hardware: Fast and Accurate Neural Machine Translation Decoding on the CPU
Attentional sequence-to-sequence models have become the new standard for...
research
∙
04/13/2016
Visual Storytelling
We introduce the first dataset for sequential vision-to-language, and ex...
research
∙
03/19/2016
Generating Natural Questions About an Image
There has been an explosion of work in the vision & language community d...
research
∙
11/03/2015
Detecting Interrogative Utterances with Recurrent Neural Networks
In this paper, we explore different neural network architectures that ca...
research
∙
06/23/2015
A Survey of Current Datasets for Vision and Language Research
Integrating vision and language has long been a dream in work on artific...
research
∙
05/07/2015