research
∙
05/29/2023
Photoswap: Personalized Subject Swapping in Images
In an era where images and visual content dominate our digital landscape...
share
research
∙
05/24/2023
LayoutGPT: Compositional Visual Planning and Generation with Large Language Models
Attaining a high degree of user controllability in visual generation oft...
research
∙
05/23/2023
R2H: Building Multimodal Navigation Helpers that Respond to Help
The ability to assist humans during a navigation task in a supportive ro...
research
∙
05/18/2023
Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation
The field of text-to-image (T2I) generation has garnered significant att...
research
∙
05/18/2023
LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation
Existing automatic evaluation on text-to-image synthesis can only provid...
research
∙
05/18/2023
Discriminative Diffusion Models as Few-shot Vision and Language Learners
Diffusion models, such as Stable Diffusion, have shown incredible perfor...
research
∙
05/02/2023
Multimodal Procedural Planning via Dual Text-Image Prompting
Embodied agents have achieved prominent performance in following human i...
research
∙
05/02/2023
Parameter-Efficient Cross-lingual Transfer of Vision and Language Models via Translation-based Alignment
Pre-trained vision and language models such as CLIP have witnessed remar...
research
∙
04/30/2023
Multimodal Graph Transformer for Multimodal Question Answering
Despite the success of Transformer models in vision and language tasks, ...
research
∙
01/30/2023
ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation
The ability to accurately locate and navigate to a specific object is a ...
research
∙
12/09/2022
Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis
Large-scale diffusion models have achieved state-of-the-art results on t...
research
∙
11/27/2022
Navigation as the Attacker Wishes? Towards Building Byzantine-Robust Embodied Agents under Federated Learning
Federated embodied agent learning protects the data privacy of individua...
research
∙
11/25/2022
ComCLIP: Training-Free Compositional Image and Text Matching
Contrastive Language-Image Pretraining (CLIP) has demonstrated great zer...
research
∙
10/19/2022
CPL: Counterfactual Prompt Learning for Vision and Language Models
Prompt tuning is a new few-shot transfer learning technique that only tu...
research
∙
10/07/2022
Visualize Before You Write: Imagination-Guided Open-Ended Text Generation
Recent advances in text-to-image synthesis make it possible to visualize...
research
∙
09/10/2022
Anticipating the Unseen Discrepancy for Vision and Language Navigation
Vision-Language Navigation requires the agent to follow natural language...
research
∙
08/28/2022
JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents
Building a conversational embodied agent to execute real-life tasks has ...
research
∙
06/17/2022
VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation
Benefiting from language flexibility and compositionality, humans natura...
research
∙
06/06/2022
Neuro-Symbolic Causal Language Planning with Commonsense Prompting
Language planning aims to implement complex high-level goals by decompos...
research
∙
05/24/2022
Aerial Vision-and-Dialog Navigation
The ability to converse with humans and follow commands in natural langu...
research
∙
04/18/2022
Imagination-Augmented Natural Language Understanding
Human brains integrate linguistic and perceptual information simultaneou...
research
∙
03/29/2022
Parameter-efficient Fine-tuning for Vision Transformers
In computer vision, it has achieved great success in adapting large-scal...
research
∙
03/28/2022
FedVLN: Privacy-preserving Federated Vision-and-Language Navigation
Data privacy is a central problem for embodied agents that can perceive ...
research
∙
03/24/2022
Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learning
Temporal grounding in videos aims to localize one target video segment t...
research
∙
03/22/2022
Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions
A long-term goal of AI research is to build intelligent agents that can ...
research
∙
12/02/2021
Relational Graph Learning for Grounded Video Description Generation
Grounded video description (GVD) encourages captioning models to attend ...
research
∙
06/21/2021
CUDA-GR: Controllable Unsupervised Domain Adaptation for Gaze Redirection
The aim of gaze redirection is to manipulate the gaze in an image to the...
research
∙
06/10/2021
ImaginE: An Imagination-Based Automatic Evaluation Metric for Natural Language Generation
Automatic evaluations for natural language generation (NLG) conventional...
research
∙
06/08/2021
VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
Most existing video-and-language (VidL) research focuses on a single dat...
research
∙
06/01/2021
Language-Driven Image Style Transfer
Despite having promising results, style transfer, which requires prepari...
research
∙
04/02/2021
Language-based Video Editing via Multi-Modal Multi-Level Transformer
Video editing tools are widely used nowadays for digital design. Althoug...
research
∙
03/30/2021
Diagnosing Vision-and-Language Navigation: What Really Matters
Vision-and-language navigation (VLN) is a multimodal task where an agent...
research
∙
02/03/2021
L2C: Describing Visual Differences Needs Semantic Understanding of Individuals
Recent advances in language and vision push forward the research of capt...
research
∙
10/07/2020
Towards Understanding Sample Variance in Visually Grounded Language Generation: Evaluations and Observations
A major challenge in visually grounded language generation is to build r...
research
∙
09/28/2020
Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation
Vision-and-Language Navigation (VLN) is a natural language grounding tas...
research
∙
09/21/2020