mirror of
https://github.com/deepseek-ai/open-infra-index.git
synced 2025-03-31 07:46:39 +00:00
add day 4
This commit is contained in:
parent
92b859fe9f
commit
bf880385d0
1 changed files with 9 additions and 0 deletions
|
@ -56,6 +56,15 @@ Introducing DeepGEMM - an FP8 GEMM library that supports both dense and MoE GEMM
|
|||
|
||||
🔗 GitHub: https://github.com/deepseek-ai/DeepGEMM
|
||||
|
||||
### Day 4 - Optimized Parallelism Strategies
|
||||
✅ DualPipe - a bidirectional pipeline parallelism algorithm for computation-communication overlap in V3/R1 training.
|
||||
🔗 https://github.com/deepseek-ai/DualPipe
|
||||
|
||||
✅ EPLB - an expert-parallel load balancer for V3/R1.
|
||||
🔗 https://github.com/deepseek-ai/eplb
|
||||
|
||||
📊 Analyze computation-communication overlap in V3/R1.
|
||||
🔗 https://github.com/deepseek-ai/profile-data
|
||||
|
||||
### Ongoing Releases...
|
||||
|
||||
|
|
Loading…
Add table
Reference in a new issue