Hanayo: Harnessing Wave-like Pipeline Parallelism for Enhanced Large Model Training Efficiency
Paper
•
2308.15762
•
Published
•
1
Cheng Shenggan
shenggan
AI & ML interests
Machine Learning System, High Performance Computing
Organizations
None yet
authored
4
papers
3 months ago
HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices
Paper
•
2403.01164
•
Published
DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers
Paper
•
2403.10266
•
Published
SRDiffusion: Accelerate Video Diffusion Inference via Sketching-Rendering Cooperation
Paper
•
2505.19151
•
Published
•
2