research
∙
09/19/2023
RUEL: Retrieval-Augmented User Representation with Edge Browser Logs for Sequential Recommendation
Online recommender systems (RS) aim to match user needs with the vast am...
share
research
∙
07/28/2023
Investigating the Learning Behaviour of In-context Learning: A Comparison with Supervised Learning
Large language models (LLMs) have shown remarkable capacity for in-conte...
research
∙
06/14/2023
WizardCoder: Empowering Code Large Language Models with Evol-Instruct
Code Large Language Models (Code LLMs), such as StarCoder, have demonstr...
research
∙
05/12/2023
Knowledge Refinement via Interaction Between Search Engines and Large Language Models
Information retrieval (IR) plays a crucial role in locating relevant res...
research
∙
05/08/2023
Augmented Large Language Models with Parametric Knowledge Guiding
Large Language Models (LLMs) have significantly advanced natural languag...
research
∙
05/08/2023
Code Execution with Pre-trained Language Models
Code execution is a fundamental aspect of programming language semantics...
research
∙
04/27/2023
Large Language Models are Strong Zero-Shot Retriever
In this work, we propose a simple method that applies a large language m...
research
∙
04/24/2023
WizardLM: Empowering Large Language Models to Follow Complex Instructions
Training large language models (LLM) with open-domain instruction follow...
research
∙
04/17/2023
Typos-aware Bottlenecked Pre-Training for Robust Dense Retrieval
Current dense retrievers (DRs) are limited in their ability to effective...
research
∙
03/27/2023
Large Language Models are Diverse Role-Players for Summarization Evaluation
Text summarization has a wide range of applications in many scenarios. T...
research
∙
03/27/2023
Empowering Dual-Encoder with Query Generator for Cross-Lingual Dense Retrieval
In monolingual dense retrieval, lots of works focus on how to distill kn...
research
∙
03/27/2023
Lexicon-Enhanced Self-Supervised Training for Multilingual Dense Retrieval
Recent multilingual pre-trained models have shown better performance in ...
research
∙
02/06/2023
LexLIP: Lexicon-Bottlenecked Language-Image Pre-Training for Large-Scale Image-Text Retrieval
Image-text retrieval (ITR) is a task to retrieve the relevant images/tex...
research
∙
02/03/2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval
Recently multi-lingual pre-trained language models (PLM) such as mBERT a...
research
∙
12/20/2022
Fine-Grained Distillation for Long Document Retrieval
Long document retrieval aims to fetch query-relevant documents from a la...
research
∙
12/20/2022
Adam: Dense Retrieval Distillation with Adaptive Dark Examples
To improve the performance of the dual-encoder retriever, one effective ...
research
∙
12/15/2022
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers
Dense retrieval aims to map queries and passages into low-dimensional ve...
research
∙
12/10/2022
LEAD: Liberal Feature-based Distillation for Dense Retrieval
Knowledge distillation is often used to transfer knowledge from a strong...
research
∙
11/21/2022
VATLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning
Although speech is a simple and effective way for humans to communicate ...
research
∙
10/18/2022
Soft-Labeled Contrastive Pre-training for Function-level Code Representation
Code contrastive pre-training has recently achieved significant progress...
research
∙
10/11/2022
Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA
Retrieving evidences from tabular and textual resources is essential for...
research
∙
09/27/2022
PROD: Progressive Distillation for Dense Retrieval
Knowledge distillation is an effective way to transfer knowledge from a ...
research
∙
08/31/2022
LexMAE: Lexicon-Bottlenecked Pretraining for Large-Scale Retrieval
In large-scale retrieval, the lexicon-weighting paradigm, learning weigh...
research
∙
08/29/2022
LED: Lexicon-Enlightened Dense Retriever for Large-Scale Retrieval
Retrieval models based on dense representations in semantic space have b...
research
∙
07/06/2022
Rethinking the Value of Gazetteer in Chinese Named Entity Recognition
Gazetteer is widely used in Chinese named entity recognition (NER) to en...
research
∙
06/21/2022
KnowDA: All-in-One Knowledge Mixture Model for Data Augmentation in Few-Shot NLP
This paper focuses on text data augmentation for few-shot NLP tasks. The...
research
∙
06/21/2022
Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generation
The Differentiable Search Index (DSI) is a new, emerging paradigm for in...
research
∙
06/16/2022
Towards Robust Ranker for Text Retrieval
A ranker plays an indispensable role in the de facto 'retrieval rera...
research
∙
06/07/2022
Unsupervised Context Aware Sentence Representation Pretraining for Multi-lingual Dense Retrieval
Recent research demonstrates the effectiveness of using pretrained langu...
research
∙
06/01/2022
Task-Specific Expert Pruning for Sparse Mixture-of-Experts
The sparse Mixture-of-Experts (MoE) model is powerful for large-scale pr...
research
∙
06/01/2022
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption
As more and more pre-trained language models adopt on-cloud deployment, ...
research
∙
06/01/2022
Negative Sampling for Contrastive Representation Learning: A Review
The learn-to-compare paradigm of contrastive representation learning (CR...
research
∙
05/23/2022
UnifieR: A Unified Retriever for Large-Scale Retrieval
Large-scale retrieval is to recall relevant documents from a huge collec...
research
∙
05/07/2022
Multi-level Contrastive Learning for Cross-lingual Spoken Language Understanding
Although spoken language understanding (SLU) has achieved great success ...
research
∙
04/12/2022
Stylized Knowledge-Grounded Dialogue Generation via Disentangled Template Rewriting
Current Knowledge-Grounded Dialogue Generation (KDG) models specialize i...
research
∙
04/02/2022
Transformer-Empowered Content-Aware Collaborative Filtering
Knowledge graph (KG) based Collaborative Filtering is an effective appro...
research
∙
03/18/2022
FORCE: A Framework of Rule-Based Conversational Recommender System
The conversational recommender systems (CRSs) have received extensive at...
research
∙
03/16/2022
TegTok: Augmenting Text Generation via Task-specific and Open-world Knowledge
Generating natural and informative texts has been a long-standing proble...
research
∙
03/16/2022
HeterMPC: A Heterogeneous Graph Neural Network for Response Generation in Multi-Party Conversations
Recently, various response generation models for two-party conversations...
research
∙
03/16/2022
Multi-View Document Representation Learning for Open-Domain Dense Retrieval
Dense retrieval has achieved impressive advances in first-stage retrieva...
research
∙
03/04/2022
ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classification
Generating new events given context with correlated ones plays a crucial...
research
∙
02/25/2022
PromDA: Prompt-based Data Augmentation for Low-Resource NLU Tasks
This paper focuses on the Data Augmentation for low-resource Natural Lan...
research
∙
02/10/2022
NÜWA-LIP: Language Guided Image Inpainting with Defect-free VQGAN
Language guided image inpainting aims to fill in the defective regions o...
research
∙
01/28/2022
PCL: Peer-Contrastive Learning with Diverse Augmentations for Unsupervised Sentence Embeddings
Learning sentence embeddings in an unsupervised manner is fundamental in...
research
∙
01/26/2022
CodeRetriever: Unimodal and Bimodal Contrastive Learning
In this paper, we propose the CodeRetriever model, which combines the un...
research
∙
11/24/2021
NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion
This paper presents a unified multimodal pre-trained model called NÜWA t...
research
∙
11/19/2021
Small Changes Make Big Differences: Improving Multi-turn Response Selection in Dialogue Systems via Fine-Grained Contrastive Learning
Retrieve-based dialogue response selection aims to find a proper respons...
research
∙
10/16/2021
Multimodal Dialogue Response Generation
Responsing with image has been recognized as an important capability for...
research
∙
10/14/2021
Finetuning Large-Scale Pre-trained Language Models for Conversational Recommendation with Knowledge Graph
In this paper, we present a pre-trained language model (PLM) based frame...
research
∙
10/13/2021