research
∙
01/29/2023
Pipe-BD: Pipelined Parallel Blockwise Distillation
Training large deep neural network models is highly challenging due to t...
share
research
∙
01/25/2023
SGCN: Exploiting Compressed-Sparse Features in Deep Graph Convolutional Network Accelerators
Graph convolutional networks (GCNs) are becoming increasingly popular as...
research
∙
01/24/2023
Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression
In training of modern large natural language processing (NLP) models, it...
research
∙
01/24/2023