research
∙
09/18/2023
MindAgent: Emergent Gaming Interaction
Large Language Models (LLMs) have the capacity of performing complex sch...
share
research
∙
02/24/2023
Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback
Large language models (LLMs), such as ChatGPT, are able to generate huma...
research
∙
05/19/2022
Training Vision-Language Transformers from Captions Alone
We show that Vision-Language Transformers can be learned without human l...
research
∙
12/16/2021
KAT: A Knowledge Augmented Transformer for Vision-and-Language
The primary focus of recent work with largescale transformers has been o...
research
∙
10/05/2019
Natural- to formal-language generation using Tensor Product Representations
Generating formal-language represented by relational tuples, such as Lis...
research
∙
09/05/2019
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
Popular metrics used for evaluating image captioning systems, such as BL...
research
∙
09/04/2019
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
This paper presents a new metric called TIGEr for the automatic evaluati...
research
∙
02/27/2019
Object-driven Text-to-Image Synthesis via Adversarial Training
In this paper, we propose Object-driven Attentive Generative Adversarial...
research
∙
11/25/2018
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Vision-language navigation (VLN) is the task of navigating an embodied a...
research
∙
05/21/2018
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
We propose a hierarchically structured reinforcement learning approach t...
research
∙
05/21/2018
Turbo Learning for Captionbot and Drawingbot
We study in this paper the problems of both image captioning and text-to...
research
∙
04/03/2018
Generating Diverse and Accurate Visual Captions by Comparative Adversarial Learning
We study how to generate captions that are not only accurate in describi...
research
∙
02/20/2018
Attentive Tensor Product Learning for Language Generation and Grammar Parsing
This paper proposes a new architecture - Attentive Tensor Product Learni...
research
∙
01/30/2018
Structured Memory based Deep Model to Detect as well as Characterize Novel Inputs
While deep learning has pushed the boundaries in various machine learnin...
research
∙
11/28/2017
AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
In this paper, we propose an Attentional Generative Adversarial Network ...
research
∙
10/29/2017
A Neural-Symbolic Approach to Natural Language Tasks
Deep learning (DL) has in recent years been widely used in natural langu...
research
∙
09/26/2017
Tensor Product Generation Networks for Deep NLP Modeling
We present a new approach to the design of deep networks for natural lan...
research
∙
09/26/2017