research
∙
08/21/2023
UnLoc: A Unified Framework for Video Localization Tasks
While large-scale image-text pretrained models such as CLIP have been us...
share
research
∙
07/17/2023
Does Visual Pretraining Help End-to-End Reasoning?
We aim to investigate whether end-to-end learning of visual reasoning ca...
research
∙
06/20/2023
Dense Video Object Captioning from Disjoint Supervision
We propose a new task and model for dense video object captioning – dete...
research
∙
06/20/2023
How can objects help action recognition?
Current state-of-the-art video models process a video clip as a long seq...
research
∙
06/07/2023
Optimizing ViViT Training: Time and Memory Reduction for Action Recognition
In this paper, we address the challenges posed by the substantial traini...
research
∙
04/24/2023
End-to-End Spatio-Temporal Action Localisation with Video Transformers
The most performant spatio-temporal action localisation models use exter...
research
∙
04/05/2023
VicTR: Video-conditioned Text Representations for Activity Recognition
Vision-Language models have shown strong performance in the image-domain...
research
∙
03/21/2023
CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation
Existing works on open-vocabulary semantic segmentation have utilized la...
research
∙
12/09/2022
Audiovisual Masked Autoencoders
Can we leverage the audiovisual information already present in video to ...
research
∙
11/16/2022
Token Turing Machines
We propose Token Turing Machines (TTM), a sequential, autoregressive Tra...
research
∙
09/20/2022
Dynamic Graph Message Passing Networks for Visual Recognition
Modelling long-range dependencies is critical for scene understanding ta...
research
∙
07/08/2022
Beyond Transfer Learning: Co-finetuning for Action Localisation
Transfer learning is the predominant paradigm for training deep networks...
research
∙
06/20/2022
M M Mix: A Multimodal Multiview Transformer Ensemble
This report describes the approach behind our winning solution to the 20...
research
∙
02/04/2022
Learning with Neighbor Consistency for Noisy Labels
Recent advances in deep learning have relied on large, labelled datasets...
research
∙
01/20/2022
End-to-end Generative Pretraining for Multimodal Video Captioning
Recent video and language pretraining frameworks lack the ability to gen...
research
∙
11/25/2021
PolyViT: Co-training Vision Transformers on Images, Videos and Audio
Can we train a single transformer model capable of processing multiple m...
research
∙
10/25/2021
The Efficiency Misnomer
Model efficiency is a critical aspect of developing and deploying machin...
research
∙
10/18/2021
SCENIC: A JAX Library for Computer Vision Research and Beyond
Scenic is an open-source JAX library with a focus on Transformer-based m...
research
∙
09/27/2021
Compressive Visual Representations
Learning effective visual representations that generalize well without h...
research
∙
06/30/2021
Attention Bottlenecks for Multimodal Fusion
Humans perceive the world by concurrently processing and fusing high-dim...
research
∙
06/21/2021
TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?
In this paper, we introduce a novel visual representation learning which...
research
∙
03/29/2021
ViViT: A Video Vision Transformer
We present pure-transformer based models for video classification, drawi...
research
∙
03/29/2021
Unified Graph Structured Models for Video Understanding
Accurate video understanding involves reasoning about the relationships ...
research
∙
07/21/2020
Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
Despite the recent advances in video classification, progress in spatio-...
research
∙
09/13/2019
Dual Graph Convolutional Network for Semantic Segmentation
Exploiting long-range contextual information is key for pixel-wise predi...
research
∙
08/19/2019
Dynamic Graph Message Passing Networks
Modelling long-range dependencies is critical for complex scene understa...
research
∙
05/10/2019
Exploiting temporal context for 3D human pose estimation in the wild
We present a bundle-adjustment-based algorithm for recovering accurate 3...
research
∙
08/10/2018
Weakly- and Semi-Supervised Panoptic Segmentation
We present a weakly supervised model that jointly performs both semantic...
research
∙
11/27/2017
On the Robustness of Semantic Segmentation Models to Adversarial Attacks
Deep Neural Networks (DNNs) have been demonstrated to perform exceptiona...
research
∙
09/11/2017
Holistic, Instance-Level Human Parsing
Object parsing -- the task of decomposing an object into its semantic pa...
research
∙
04/07/2017
Pixelwise Instance Segmentation with a Dynamically Instantiated Network
Semantic segmentation and object detection research have recently achiev...
research
∙
01/24/2017
Learning Arbitrary Pairwise Potentials in CRFs for Semantic Segmentation
Are we using the right potential functions in the Conditional Random Fie...
research
∙
09/08/2016
Bottom-up Instance Segmentation using Deep Higher-Order CRFs
Traditional Scene Understanding problems such as Object Detection and Se...
research
∙
01/10/2016
Joint Object-Material Category Segmentation from Audio-Visual Cues
It is not always possible to recognise objects and infer material proper...
research
∙
10/13/2015