mirror of
https://github.com/deepseek-ai/open-infra-index.git
synced 2025-05-11 14:11:41 -04:00
Merge pull request #22 from deepseek-ai/youkaichao-patch-1
去除具体的框架名,未来的开源合作是面向整个开源社区的,不局限于具体某些项目
This commit is contained in:
commit
7140464e97
1 changed files with 3 additions and 5 deletions
|
@ -24,14 +24,12 @@ While we initially considered open-sourcing our full internal inference engine,
|
|||
- **Limited Maintenance Bandwidth**: As a small research team focused on developing better models, we lack bandwidth to
|
||||
maintain a large open-source project.
|
||||
|
||||
Considering these challenges, we’ve decided to collaborate with the SGLang project and vLLM project as more sustainable alternatives.
|
||||
Considering these challenges, we’ve decided to collaborate with existing open-source projects as more sustainable alternatives.
|
||||
|
||||
SGLang and vLLM stand out for its broad hardware support, extensive model compatibility, and state-of-the-art performance. Its modular architecture gives us confidence that we can adapt and contribute key components from our internal engine to benefit the wider community.
|
||||
|
||||
Moving forward, we will work closely with the SGLang team and vLLM team to:
|
||||
Moving forward, we will work closely with existing open-source projects to:
|
||||
|
||||
- **Extract Standalone Features**: Modularize and contribute reusable components as independent libraries.
|
||||
- **Share Optimizations**: Contribute design improvements and implementation details directly to SGLang and vLLM.
|
||||
- **Share Optimizations**: Contribute design improvements and implementation details directly.
|
||||
|
||||
We are profoundly grateful for the open-source movement - from operating systems and programming languages to machine
|
||||
learning frameworks and inference engines. It’s an honor to contribute to this thriving ecosystem and to see our models
|
||||
|
|
Loading…
Add table
Reference in a new issue