research
∙
05/31/2023
Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning
The relational data model was designed to facilitate large-scale data ma...
share
research
∙
03/13/2023
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
The high computational and memory requirements of large language model (...
research
∙
11/16/2022
Holistic Evaluation of Language Models
Language models (LMs) are becoming the foundation for almost all major l...
research
∙
06/12/2022
Stochastic Gradient Descent without Full Data Shuffle
Stochastic gradient descent (SGD) is the cornerstone of modern machine l...
research
∙
06/02/2022
Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees
Communication compression is a crucial technique for modern distributed ...
research
∙
06/02/2022
Decentralized Training of Foundation Models in Heterogeneous Environments
Training foundation models, such as GPT-3 and PaLM, can be extremely exp...
research
∙
09/01/2020
Tensor Relational Algebra for Machine Learning System Design
Machine learning (ML) systems have to support various tensor operations....
research
∙
06/30/2020
Lachesis: Automated Generation of Persistent Partitionings for UDF-Centric Analytics
Persistent partitioning is effective in avoiding expensive shuffling ope...
research
∙
05/07/2020
A Federated Learning Framework for Healthcare IoT devices
The Internet of Things (IoT) revolution has shown potential to give rise...
research
∙
10/04/2019
Distributed Learning of Deep Neural Networks using Independent Subnet Training
Stochastic gradient descent (SGD) is the method of choice for distribute...
research
∙
08/15/2019
Diagnosing Cardiac Abnormalities from 12-Lead Electrocardiograms Using Enhanced Deep Convolutional Neural Networks
We train an enhanced deep convolutional neural network in order to ident...
research
∙
04/25/2019
Declarative Recursive Computation on an RDBMS, or, Why You Should Use a Database For Distributed Machine Learning
A number of popular systems, most notably Google's TensorFlow, have been...
research
∙
02/14/2019
WaveletFCNN: A Deep Time Series Classification Model for Wind Turbine Blade Icing Detection
Wind power, as an alternative to burning fossil fuels, is plentiful and ...
research
∙
11/15/2017