docs: add deepseek-tokenizer to integration list

This commit is contained in:
Anderson 2025-02-03 14:19:47 +08:00
parent bd3ef90cc1
commit 32936daf19
2 changed files with 10 additions and 0 deletions

View file

@ -333,4 +333,9 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
<td> <a href="docs/promptfoo/README.md"> promptfoo </a> </td>
<td> Test and evaluate LLM prompts, including DeepSeek models. Compare different LLM providers, catch regressions, and evaluate responses. </td>
</tr>
<tr>
<td> </td>
<td> <a href="https://github.com/AndersonBY/deepseek-tokenizer"> deepseek-tokenizer </a> </td>
<td> An efficient and lightweight tokenization library for DeepSeek models, relying solely on the `tokenizers` library without heavy dependencies like `transformers`. </td>
</tr>
</table>