research
∙
04/11/2023
Training Large Language Models Efficiently with Sparsity and Dataflow
Large foundation language models have shown their versatility in being a...
share
research
∙
02/02/2022
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts
PromptSource is a system for creating, sharing, and using natural langua...
research
∙
10/15/2021
Multitask Prompted Training Enables Zero-Shot Task Generalization
Large language models have recently been shown to attain reasonable zero...
research
∙
02/14/2021
Doping: A technique for efficient compression of LSTM models using sparse structured additive matrices
Structured matrices, such as those derived from Kronecker products (KP),...
research
∙
10/06/2020
Rank and run-time aware compression of NLP Applications
Sequence model based NLP applications can be large. Yet, many applicatio...
research
∙
03/10/2020
Benchmarking TinyML Systems: Challenges and Direction
Recent advancements in ultra-low-power machine learning (TinyML) hardwar...
research
∙
01/24/2020
Compressing Language Models using Doped Kronecker Products
Kronecker Products (KP) have been used to compress IoT RNN Applications ...
research
∙
11/04/2019
Ternary MobileNets via Per-Layer Hybrid Filter Banks
MobileNets family of computer vision neural networks have fueled tremend...
research
∙
10/04/2019
Pushing the limits of RNN Compression
Recurrent Neural Networks (RNN) can be difficult to deploy on resource c...
research
∙
06/18/2019
A Static Analysis-based Cross-Architecture Performance Prediction Using Machine Learning
Porting code from CPU to GPU is costly and time-consuming; Unless much t...
research
∙
06/12/2019
Run-Time Efficient RNN Compression for Inference on Edge Devices
Recurrent neural networks can be large and compute-intensive, yet many a...
research
∙
06/07/2019
Compressing RNNs for IoT devices by 15-38x using Kronecker Products
Recurrent Neural Networks (RNN) can be large and compute-intensive, maki...
research
∙
04/05/2019