research
∙
09/16/2023
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference Using Sorted Fine-Tuning (SoFT)
The rapid advancement of large language models (LLMs) has revolutionized...
share
research
∙
09/01/2023
SortedNet, a Place for Every Network and Every Network in its Place: Towards a Generalized Solution for Training Many-in-One Neural Networks
As the size of deep learning models continues to grow, finding optimal m...
research
∙
05/23/2023
On the Transferability of Whisper-based Representations for "In-the-Wild" Cross-Task Downstream Speech Applications
Large self-supervised pre-trained speech models have achieved remarkable...
research
∙
12/20/2022
KronA: Parameter Efficient Tuning with Kronecker Adapter
Fine-tuning a Pre-trained Language Model (PLM) on a specific downstream ...
research
∙
10/15/2021
Kronecker Decomposition for GPT Compression
GPT is an auto-regressive Transformer-based pre-trained language model w...
research
∙
03/09/2020