research
∙
08/30/2023
Hanayo: Harnessing Wave-like Pipeline Parallelism for Enhanced Large Model Training Efficiency
Large-scale language models have become increasingly challenging and exp...
share
research
∙
01/20/2023
ATP: Adaptive Tensor Parallelism for Foundation Models
Foundation models have impressive performance and generalization capabil...
research
∙
03/02/2022
FastFold: Reducing AlphaFold Training Time from 11 Days to 67 Hours
Protein structure prediction is an important method for understanding ge...
research
∙
04/23/2021
tcFFT: Accelerating Half-Precision FFT through Tensor Cores
Fast Fourier Transform (FFT) is an essential tool in scientific and engi...
research
∙
03/09/2020