mirror of
https://github.com/deepseek-ai/open-infra-index.git
synced 2025-04-03 16:54:04 +00:00
add day 4
This commit is contained in:
parent
92b859fe9f
commit
bf880385d0
1 changed files with 9 additions and 0 deletions
|
@ -56,6 +56,15 @@ Introducing DeepGEMM - an FP8 GEMM library that supports both dense and MoE GEMM
|
||||||
|
|
||||||
🔗 GitHub: https://github.com/deepseek-ai/DeepGEMM
|
🔗 GitHub: https://github.com/deepseek-ai/DeepGEMM
|
||||||
|
|
||||||
|
### Day 4 - Optimized Parallelism Strategies
|
||||||
|
✅ DualPipe - a bidirectional pipeline parallelism algorithm for computation-communication overlap in V3/R1 training.
|
||||||
|
🔗 https://github.com/deepseek-ai/DualPipe
|
||||||
|
|
||||||
|
✅ EPLB - an expert-parallel load balancer for V3/R1.
|
||||||
|
🔗 https://github.com/deepseek-ai/eplb
|
||||||
|
|
||||||
|
📊 Analyze computation-communication overlap in V3/R1.
|
||||||
|
🔗 https://github.com/deepseek-ai/profile-data
|
||||||
|
|
||||||
### Ongoing Releases...
|
### Ongoing Releases...
|
||||||
|
|
||||||
|
|
Loading…
Add table
Reference in a new issue