research
∙
05/22/2023
A Framework for Fine-Grained Synchronization of Dependent GPU Kernels
Machine Learning (ML) models contain highly-parallel computations, such ...
share
research
∙
01/27/2022
GC3: An Optimizing Compiler for GPU Collective Communication
Machine learning models made up of millions or billions of parameters ar...
research
∙
11/08/2021
Synthesizing Collective Communication Algorithms for Heterogeneous Networks with TACCL
Large ML models and datasets have necessitated the use of multi-GPU syst...
research
∙
08/19/2020
Synthesizing Optimal Collective Algorithms
Collective communication algorithms are an important component of distri...
research
∙
06/04/2020
Scaling Distributed Training with Adaptive Summation
Stochastic gradient descent (SGD) is an inherently sequential training a...
research
∙
12/27/2019
EVA: An Encrypted Vector Arithmetic Language and Compiler for Efficient Homomorphic Computation
Fully-Homomorphic Encryption (FHE) offers powerful capabilities by enabl...
research
∙
10/04/2019
Succinct Determinisation of Counting Automata via Sphere Construction (Technical Report)
We propose an efficient algorithm for determinising counting automata (C...
research
∙
09/08/2019
Distributed Word2Vec using Graph Analytics Frameworks
Word embeddings capture semantic and syntactic similarities of words, re...
research
∙
10/01/2018