research
∙
09/20/2023
A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models
Generative Large Language Models (LLMs) have achieved remarkable advance...
share
research
∙
08/16/2023
FineQuant: Unlocking Efficiency with Fine-Grained Weight-Only Quantization for LLMs
Large Language Models (LLMs) have achieved state-of-the-art performance ...
research
∙
02/18/2023
How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation
Generative Pre-trained Transformer (GPT) models have shown remarkable ca...
research
∙
11/18/2022
Who Says Elephants Can't Run: Bringing Large Scale MoE Models into Cloud Scale Production
Mixture of Experts (MoE) models with conditional execution of sparsely a...
research
∙
08/11/2022
Language Tokens: A Frustratingly Simple Approach Improves Zero-Shot Performance of Multilingual Translation
This paper proposes a simple yet effective method to improve direct (X-t...
research
∙
06/30/2022
Building Multilingual Machine Translation Systems That Serve Arbitrary X-Y Translations
Multilingual Neural Machine Translation (MNMT) enables one system to tra...
research
∙
05/28/2022
Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers
Sparsely activated transformers, such as Mixture of Experts (MoE), have ...
research
∙
11/26/2021
Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs
This paper describes our submission to the constrained track of WMT21 sh...
research
∙
11/03/2021
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task
This report describes Microsoft's machine translation systems for the WM...
research
∙
09/22/2021
Scalable and Efficient MoE Training for Multitask Multilingual Models
The Mixture of Experts (MoE) models are an emerging class of sparsely ac...
research
∙
06/25/2021
DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders
While pretrained encoders have achieved success in various natural langu...
research
∙
12/31/2020
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders
Multilingual machine translation enables a single model to translate bet...
research
∙
11/16/2020
Score Combination for Improved Parallel Corpus Filtering for Low Resource Conditions
This paper describes our submission to the WMT20 sentence filtering task...
research
∙
10/26/2020
FastFormers: Highly Efficient Transformer Models for Natural Language Understanding
Transformer-based models are the state-of-the-art for Natural Language U...
research
∙
10/06/2020
Multi-task Learning for Multilingual Neural Machine Translation
While monolingual data has been shown to be useful in improving bilingua...
research
∙
11/03/2015