research
∙
09/03/2023
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models
While large language models (LLMs) have demonstrated remarkable capabili...
share
research
∙
07/16/2023
Disco-Bench: A Discourse-Aware Evaluation Benchmark for Language Modelling
Modeling discourse – the linguistic phenomena that go beyond individual ...
research
∙
07/06/2023
On the Cultural Gap in Text-to-Image Generation
One challenge in text-to-image (T2I) generation is the inadvertent refle...
research
∙
06/15/2023
Macaw-LLM: Multi-Modal Language Modeling with Image, Audio, Video, and Text Integration
Although instruction-tuned large language models (LLMs) have exhibited r...
research
∙
05/31/2023
How Does Pretraining Improve Discourse-Aware Translation?
Pretrained language models (PLMs) have produced substantial improvements...
research
∙
05/25/2023
Revisiting Non-Autoregressive Translation at Scale
In real-world systems, scaling has been critical for improving the trans...
research
∙
05/22/2023
Deepfake Text Detection in the Wild
Recent advances in large language models have enabled them to reach a le...
research
∙
05/17/2023
A Survey on Zero Pronoun Translation
Zero pronouns (ZPs) are frequently omitted in pro-drop languages (e.g. C...
research
∙
05/02/2023
New Trends in Machine Translation using Large Language Models: Case Examples with ChatGPT
Machine Translation (MT) has made significant progress in recent years u...
research
∙
04/20/2023
Prompt-Learning for Cross-Lingual Relation Extraction
Relation Extraction (RE) is a crucial task in Information Extraction, wh...
research
∙
04/05/2023
Document-Level Machine Translation with Large Language Models
Large language models (LLMs) such as Chat-GPT can produce coherent, cohe...
research
∙
02/16/2023
Search-Engine-augmented Dialogue Response Generation with Cheaply Supervised Query Production
Knowledge-aided dialogue response generation aims at augmenting chatbots...
research
∙
10/08/2022
ngram-OAXE: Phrase-Based Order-Agnostic Cross Entropy for Non-Autoregressive Machine Translation
Recently, a new training oaxe loss has proven effective to ameliorate th...
research
∙
10/05/2021
On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translation
Pre-training (PT) and back-translation (BT) are two simple and powerful ...
research
∙
07/17/2021
On the Copying Behaviors of Pre-Training for Neural Machine Translation
Previous studies have shown that initializing neural machine translation...
research
∙
06/10/2021
Progressive Multi-Granularity Training for Non-Autoregressive Translation
Non-autoregressive translation (NAT) significantly accelerates the infer...
research
∙
06/02/2021
Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation
Knowledge distillation (KD) is commonly used to construct synthetic data...
research
∙
05/27/2021
TranSmart: A Practical Interactive Machine Translation System
Automatic machine translation is super efficient to produce translations...
research
∙
12/29/2020
Understanding and Improving Encoder Layer Fusion in Sequence-to-Sequence Learning
Encoder layer fusion (EncoderFusion) is a technique to fuse all the enco...
research
∙
12/29/2020
Understanding and Improving Lexical Choice in Non-Autoregressive Translation
Knowledge distillation (KD) is essential for training non-autoregressive...
research
∙
11/02/2020
Context-Aware Cross-Attention for Non-Autoregressive Translation
Non-autoregressive translation (NAT) significantly accelerates the infer...
research
∙
10/06/2020
On the Sub-Layer Functionalities of Transformer Decoder
There have been significant efforts to interpret the encoder of Transfor...
research
∙
10/06/2020
On the Sparsity of Neural Machine Translation Models
Modern neural machine translation (NMT) models employ a large number of ...
research
∙
05/03/2020
How Does Selective Mechanism Improve Self-Attention Networks?
Self-attention networks (SANs) with selective mechanism has produced sub...
research
∙
04/28/2020
Self-Attention with Cross-Lingual Position Representation
Position encoding (PE), an essential part of self-attention networks (SA...
research
∙
11/22/2019
Go From the General to the Particular: Multi-Domain Translation with Domain Transformation Networks
The key challenge of multi-domain translation lies in simultaneously enc...
research
∙
09/01/2019
Self-Attention with Structural Position Representations
Although self-attention networks (SANs) have advanced the state-of-the-a...
research
∙
09/01/2019
One Model to Learn Both: Zero Pronoun Prediction and Translation
Zero pronouns (ZPs) are frequently omitted in pro-drop languages, but sh...
research
∙
09/01/2019
Towards Understanding Neural Machine Translation with Word Importance
Although neural machine translation (NMT) has advanced the state-of-the-...
research
∙
06/04/2019
Exploiting Sentential Context for Neural Machine Translation
In this work, we present novel approaches to exploit sentential context ...
research
∙
06/03/2019
Assessing the Ability of Self-Attention Networks to Learn Word Order
Self-attention networks (SAN) have attracted a lot of interests due to t...
research
∙
04/05/2019
Convolutional Self-Attention Networks
Self-attention networks (SANs) have drawn increasing interest due to the...
research
∙
04/05/2019
Modeling Recurrence for Transformer
Recently, the Transformer model that is based solely on attention mechan...
research
∙
02/15/2019
Dynamic Layer Aggregation for Neural Machine Translation with Routing-by-Agreement
With the promising progress of deep neural networks, layer aggregation h...
research
∙
12/26/2018
Learning to Refine Source Representations for Neural Machine Translation
Neural machine translation (NMT) models generally adopt an encoder-decod...
research
∙
10/31/2018
Convolutional Self-Attention Network
Self-attention network (SAN) has recently attracted increasing interest ...
research
∙
10/15/2018
Learning to Jointly Translate and Predict Dropped Pronouns with a Shared Reconstruction Mechanism
Pronouns are frequently omitted in pro-drop languages, such as Chinese, ...
research
∙
04/05/2018
Chinese-Portuguese Machine Translation: A Study on Building Parallel Corpora from Comparable Texts
Although there are increasing and significant ties between China and Por...
research
∙
04/05/2018
Domain Adaptation for Statistical Machine Translation
Statistical machine translation (SMT) systems perform poorly when it is ...
research
∙
01/10/2018
Translating Pro-Drop Languages with Reconstruction Models
Pronouns are frequently omitted in pro-drop languages, such as Chinese, ...
research
∙
04/14/2017
Exploiting Cross-Sentence Context for Neural Machine Translation
In translation, considering the document as a whole can help to resolve ...
research
∙
05/22/2016
Automatic Construction of Discourse Corpora for Dialogue Translation
In this paper, a novel approach is proposed to automatically construct p...
research
∙
04/21/2016