research
∙
06/08/2023
Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts
Weight-sharing supernet has become a vital component for performance est...
share
research
∙
06/05/2023
Orca: Progressive Learning from Complex Explanation Traces of GPT-4
Recent research has focused on enhancing the capability of smaller model...
research
∙
10/14/2022
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
Neural architecture search (NAS) has demonstrated promising results on i...
research
∙
03/19/2022
Automatic Detection of Entity-Manipulated Text using Factual Knowledge
In this work, we focus on the problem of distinguishing a human written ...
research
∙
03/15/2022
InfoDCL: A Distantly Supervised Contrastive Learning Framework for Social Meaning
Existing supervised contrastive learning frameworks suffer from two majo...
research
∙
12/28/2021
Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corpora
The problem of comparing two bodies of text and searching for words that...
research
∙
05/18/2021
Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixing
We describe models focused at the understudied problem of translating be...
research
∙
11/02/2020