research
∙
09/19/2023
RUEL: Retrieval-Augmented User Representation with Edge Browser Logs for Sequential Recommendation
Online recommender systems (RS) aim to match user needs with the vast am...
share
research
∙
04/17/2023
Typos-aware Bottlenecked Pre-Training for Robust Dense Retrieval
Current dense retrievers (DRs) are limited in their ability to effective...
research
∙
03/29/2023
TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs
Artificial Intelligence (AI) has made incredible progress recently. On t...
research
∙
03/27/2023
Large Language Models are Diverse Role-Players for Summarization Evaluation
Text summarization has a wide range of applications in many scenarios. T...
research
∙
03/27/2023
Empowering Dual-Encoder with Query Generator for Cross-Lingual Dense Retrieval
In monolingual dense retrieval, lots of works focus on how to distill kn...
research
∙
03/27/2023
Lexicon-Enhanced Self-Supervised Training for Multilingual Dense Retrieval
Recent multilingual pre-trained models have shown better performance in ...
research
∙
02/03/2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval
Recently multi-lingual pre-trained language models (PLM) such as mBERT a...
research
∙
10/11/2022
Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA
Retrieving evidences from tabular and textual resources is essential for...
research
∙
06/21/2022
Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generation
The Differentiable Search Index (DSI) is a new, emerging paradigm for in...
research
∙
06/07/2022
Unsupervised Context Aware Sentence Representation Pretraining for Multi-lingual Dense Retrieval
Recent research demonstrates the effectiveness of using pretrained langu...
research
∙
06/01/2022
Negative Sampling for Contrastive Representation Learning: A Review
The learn-to-compare paradigm of contrastive representation learning (CR...
research
∙
05/07/2022
Multi-level Contrastive Learning for Cross-lingual Spoken Language Understanding
Although spoken language understanding (SLU) has achieved great success ...
research
∙
04/02/2022
Transformer-Empowered Content-Aware Collaborative Filtering
Knowledge graph (KG) based Collaborative Filtering is an effective appro...
research
∙
03/16/2022
Multi-View Document Representation Learning for Open-Domain Dense Retrieval
Dense retrieval has achieved impressive advances in first-stage retrieva...
research
∙
09/03/2021
Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding
Lack of training data presents a grand challenge to scaling out spoken l...
research
∙
07/25/2021
A Joint and Domain-Adaptive Approach to Spoken Language Understanding
Spoken Language Understanding (SLU) is composed of two subtasks: intent ...
research
∙
06/01/2021
Reinforced Iterative Knowledge Distillation for Cross-Lingual Named Entity Recognition
Named entity recognition (NER) is a fundamental component in many applic...
research
∙
04/05/2021
WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach
Producing the embedding of a sentence in an unsupervised way is valuable...
research
∙
02/22/2021
Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model
Modern Automatic Speech Recognition (ASR) systems can achieve high perfo...
research
∙
02/12/2021
Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders
Recently, universal neural machine translation (NMT) with shared encoder...
research
∙
12/28/2020
Syntax-Enhanced Pre-trained Model
We study the problem of leveraging the syntactic structure of text to en...
research
∙
12/11/2020
Reinforced Multi-Teacher Selection for Knowledge Distillation
In natural language processing (NLP) tasks, slow inference speed and hug...
research
∙
11/11/2020
CalibreNet: Calibration Networks for Multilingual Sequence Labeling
Lack of training data in low-resource languages presents huge challenges...
research
∙
10/27/2020
Cross-lingual Machine Reading Comprehension with Language Branch Knowledge Distillation
Cross-lingual Machine Reading Comprehension (CLMRC) remains a challengin...
research
∙
10/14/2020
A Graph Representation of Semi-structured Data for Web Question Answering
The abundant semi-structured data on the Web, such as HTML-based tables ...
research
∙
10/13/2020
Experimental Quantum Generative Adversarial Networks for Image Generation
Quantum machine learning is expected to be one of the first practical ap...
research
∙
09/29/2020
MaP: A Matrix-based Prediction Approach to Improve Span Extraction in Machine Reading Comprehension
Span extraction is an essential problem in machine reading comprehension...
research
∙
09/25/2020
No Answer is Better Than Wrong Answer: A Reflection Model for Document Level Machine Reading Comprehension
The Natural Questions (NQ) benchmark set brings new challenges to Machin...
research
∙
09/16/2020
Tag and Correct: Question aware Open Information Extraction with Two-stage Decoding
Question Aware Open Information Extraction (Question aware Open IE) take...
research
∙
06/13/2020
Mining Implicit Relevance Feedback from User Behavior for Web Question Answering
Training and refreshing a web-scale Question Answering (QA) system for a...
research
∙
06/13/2020
Mining Implicit Relevance Feedback from User Behavior forWeb Question Answering
Training and refreshing a web-scale Question Answering (QA) system for a...
research
∙
04/29/2020
Enhancing Answer Boundary Detection for Multilingual Machine Reading Comprehension
Multilingual pre-trained models could leverage the training data from a ...
research
∙
04/28/2020
LogicalFactChecker: Leveraging Logical Operations for Fact Checking with Graph Module Network
Verifying the correctness of a textual statement requires not only seman...
research
∙
04/12/2020
Pre-training Text Representations as Meta Learning
Pre-training text representations has recently been shown to significant...
research
∙
04/09/2020
Improving Readability for Automatic Speech Recognition Transcription
Modern Automatic Speech Recognition (ASR) systems can achieve high perfo...
research
∙
04/07/2020
Inferential Text Generation with Multiple Knowledge Sources and Meta-Learning
We study the problem of generating inferential texts of events for a var...
research
∙
04/03/2020
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation
In this paper, we introduce XGLUE, a new benchmark dataset to train larg...
research
∙
02/27/2020
TGGLines: A Robust Topological Graph Guided Line Segment Detector for Low Quality Binary Images
Line segment detection is an essential task in computer vision and image...
research
∙
02/19/2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
We present CodeBERT, a bimodal pre-trained model for programming languag...
research
∙
10/18/2019
Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System
Deep pre-training and fine-tuning models (such as BERT and OpenAI GPT) h...
research
∙
09/09/2019
Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answering
Commonsense question answering aims to answer questions which require ba...
research
∙
09/03/2019
Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks
We present Unicoder, a universal language encoder that is insensitive to...
research
∙
04/21/2019
Model Compression with Multi-Task Knowledge Distillation for Web-scale Question Answering System
Deep pre-training and fine-tuning models (like BERT, OpenAI GPT) have de...
research
∙
04/21/2019
NeuronBlocks -- Building Your NLP DNN Models Like Playing Lego
When building deep neural network models for natural language processing...
research
∙
02/25/2019
Pretraining-Based Natural Language Generation for Text Summarization
In this paper, we propose a novel pretraining-based encoder-decoder fram...
research
∙
05/31/2017