add day 4

This commit is contained in:
hpp 2025-02-27 10:39:41 +08:00
parent 92b859fe9f
commit bf880385d0

View file

@ -56,6 +56,15 @@ Introducing DeepGEMM - an FP8 GEMM library that supports both dense and MoE GEMM
🔗 GitHub: https://github.com/deepseek-ai/DeepGEMM
### Day 4 - Optimized Parallelism Strategies
✅ DualPipe - a bidirectional pipeline parallelism algorithm for computation-communication overlap in V3/R1 training.
🔗 https://github.com/deepseek-ai/DualPipe
✅ EPLB - an expert-parallel load balancer for V3/R1.
🔗 https://github.com/deepseek-ai/eplb
📊 Analyze computation-communication overlap in V3/R1.
🔗 https://github.com/deepseek-ai/profile-data
### Ongoing Releases...