mirror of
https://github.com/deepseek-ai/awesome-deepseek-integration.git
synced 2025-04-04 19:14:02 +00:00
Merge branch 'deepseek-ai:main' into main
This commit is contained in:
commit
c121c92222
6 changed files with 323 additions and 6 deletions
56
README.md
56
README.md
|
@ -152,8 +152,8 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://github.com/ZGGSONG/STranslate/raw/main/img/favicon.svg" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://bobtranslate.com/">STranslate</a></td>
|
||||
<td> <a href="https://bobtranslate.com/">STranslate</a>(Windows) is a ready-to-go translation ocr tool developed by WPF </td>
|
||||
<td> <a href="https://stranslate.zggsong.com/en/">STranslate</a></td>
|
||||
<td> <a href="https://stranslate.zggsong.com/en/">STranslate</a>(Windows) is a ready-to-go translation ocr tool developed by WPF </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://github.com/user-attachments/assets/5e16beb0-993e-47bf-807e-7c8804b313a2" alt="Asp Client" width="64" height="auto" /> </td>
|
||||
|
@ -194,6 +194,11 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
### AI Agent frameworks
|
||||
|
||||
<table>
|
||||
<tr>
|
||||
<td><img src="https://yomo.run/yomo-logo.png" alt="Icon" width="64" height="auto" /></td>
|
||||
<td><a href="https://github.com/deepseek-ai/awesome-deepseek-integration/blob/main/docs/yomo/README.md">YoMo</a></td>
|
||||
<td>Stateful Serverless LLM Function Calling Framework with Strongly-typed Language Support</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://raw.githubusercontent.com/superagentxai/superagentX/refs/heads/master/docs/logo/icononly_transparent_nobuffer.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/deepseek-ai/awesome-deepseek-integration/blob/main/docs/superagentx/README.md">SuperAgentX</a> </td>
|
||||
|
@ -204,7 +209,7 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
<td> <a href="https://github.com/deepseek-ai/awesome-deepseek-integration/blob/main/docs/anda/README.md">Anda</a> </td>
|
||||
<td>A Rust framework for AI agent development, designed to build a highly composable, autonomous, and perpetually memorizing network of AI agents.</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<tr>
|
||||
<td> <img src="https://raw.githubusercontent.com/longevity-genie/chat-ui/11c6647c83f9d2de21180b552474ac5ffcf53980/static/geneticsgenie/icon-128x128.png" alt="Icon" width="64" height="auto"/> </td>
|
||||
<td> <a href="https://github.com/longevity-genie/just-agents">Just-Agents</a> </td>
|
||||
<td>A lightweight, straightforward library for LLM agents - no over-engineering, just simplicity!</td>
|
||||
|
@ -213,6 +218,11 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
<td> <a href="https://github.com/bob-robert-ai/bob/blob/main/alice/readme.md">Alice</a> </td>
|
||||
<td>An autonomous AI agent on ICP, leveraging LLMs like DeepSeek for on-chain decision-making. Alice combines real-time data analysis with a playful personality to manage tokens, mine BOB, and govern ecosystems.</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://github.com/Upsonic/Upsonic/blob/9d2e6d43b44defc6744817330625661ca3a2184e/Upsonic%20pp.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/Upsonic/Upsonic">Upsonic</a> </td>
|
||||
<td>Upsonic offers a cutting-edge enterprise-ready agent framework where you can orchestrate LLM calls, agents, and computer use to complete tasks cost-effectively.</td>
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
### RAG frameworks
|
||||
|
@ -225,6 +235,16 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
</tr>
|
||||
</table>
|
||||
|
||||
### Solana frameworks
|
||||
|
||||
<table>
|
||||
<tr>
|
||||
<td> <img src="./docs/solana-agent-kit/assets/sendai-logo.png" alt="Icon" width="128" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/deepseek-ai/awesome-deepseek-integration/blob/main/docs/ragflow/README.md"> Solana Agent Kit </a> </td>
|
||||
<td>An open-source toolkit for connecting AI agents to Solana protocols. Now, any agent, using any Deepseek LLM, can autonomously perform 60+ Solana actions: </td>
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
|
||||
### Synthetic data curation
|
||||
|
||||
|
@ -250,6 +270,11 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
<td> <a href="https://github.com/RockChinQ/LangBot">LangBot<br/>(QQ, Lark, WeCom)</a> </td>
|
||||
<td> LLM-based IM bots framework, supports QQ, Lark, WeCom, and more platforms.</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://nonebot.dev/logo.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/KomoriDev/nonebot-plugin-deepseek">NoneBot<br/>(QQ, Lark, Discord, TG, etc.)</a> </td>
|
||||
<td> Based on NoneBot framework, provide intelligent chat and deep thinking functions, supports QQ, Lark, Discord, TG, and more platforms.</td>
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
### Browser Extensions
|
||||
|
@ -290,6 +315,11 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
<td> <a href="https://www.ncurator.com/"> Ncurator </a> </td>
|
||||
<td> Knowledge Base AI Q&A Assistant - Let AI help you organize and analyze knowledge</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://github.com/oinzen/RSSFlow-doc/blob/main/docs/images/en/icon64.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://rssflow.oinchain.com"> RssFlow </a> </td>
|
||||
<td>An intelligent RSS reader browser extension with AI-powered RSS summarization and multi-dimensional feed views. Supports DeepSeek model configuration for enhanced content understanding. </td>
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
### VS Code Extensions
|
||||
|
@ -400,6 +430,11 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
<td> <a href="https://github.com/djcopley/ShellOracle/"> ShellOracle </a> </td>
|
||||
<td> A terminal utility for intelligent shell command generation. </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://avatars.githubusercontent.com/u/178783630?s=200&v=4" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/bolna-ai/bolna/"> Bolna </a> </td>
|
||||
<td> Use DeepSeek as the LLM for conversational voice AI agents</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://github.com/deepseek-ai/awesome-deepseek-integration/assets/59196087/c1e47b01-1766-4f7e-bfe6-ab3cb3991c30" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/deepseek-ai/awesome-deepseek-integration/tree/main/docs/siri_deepseek_shortcut"> siri_deepseek_shortcut </a> </td>
|
||||
|
@ -410,6 +445,11 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
<td> <a href="https://github.com/rubickecho/n8n-deepseek"> n8n-nodes-deepseek </a> </td>
|
||||
<td> An N8N community node that supports direct integration with the DeepSeek API into workflows. </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://framerusercontent.com/images/TSKshn2UFdTyvUi85EDMIXrXgs.png?scale-down-to=512" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/Portkey-AI/gateway"> Portkey AI </a> </td>
|
||||
<td> Portkey is a unified API for interacting with over 1600+ LLM models, offering advanced tools for control, visibility, and security in your DeepSeek apps. Python & Node SDK available. </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://framerusercontent.com/images/8rF2JOaZ8l9AvM4H6ezliw44aI.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/BerriAI/litellm"> LiteLLM </a> </td>
|
||||
|
@ -425,6 +465,11 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
<td> <a href="docs/promptfoo/README.md"> promptfoo </a> </td>
|
||||
<td> Test and evaluate LLM prompts, including DeepSeek models. Compare different LLM providers, catch regressions, and evaluate responses. </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> </td>
|
||||
<td> <a href="https://github.com/AndersonBY/deepseek-tokenizer"> deepseek-tokenizer </a> </td>
|
||||
<td> An efficient and lightweight tokenization library for DeepSeek models, relying solely on the `tokenizers` library without heavy dependencies like `transformers`. </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://langfuse.com/icon.svg" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://langfuse.com/docs/integrations/deepseek"> Langfuse </a> </td>
|
||||
|
@ -440,4 +485,9 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati
|
|||
<td> <a href="https://youtu.be/T1my2gqi-7Q"> GPTLocalost </a> </td>
|
||||
<td> Use DeepSeek-R1 in Microsoft Word Locally. No inference costs. </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://github.com/suqicloud/wp-ai-chat/raw/main/ic_logo.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/suqicloud/wp-ai-chat"> WordPress ai助手 </a> </td>
|
||||
<td> Docking Deepseek api for WordPress site ai conversation assistant, post generation, post summary plugin. </td>
|
||||
</tr>
|
||||
</table>
|
||||
|
|
40
README_cn.md
40
README_cn.md
|
@ -50,7 +50,7 @@
|
|||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://raw.githubusercontent.com/rss-translator/RSS-Translator/main/core/static/favicon.ico" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="hhttps://github.com/deepseek-ai/awesome-deepseek-integration/blob/main/docs/rss_translator/README_cn.md"> RSS翻译器 </a> </td>
|
||||
<td> <a href="https://github.com/deepseek-ai/awesome-deepseek-integration/blob/main/docs/rss_translator/README_cn.md"> RSS翻译器 </a> </td>
|
||||
<td> 开源、简洁、可自部署的RSS翻译器 </td>
|
||||
</tr>
|
||||
<tr>
|
||||
|
@ -120,8 +120,8 @@
|
|||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://github.com/ZGGSONG/STranslate/raw/main/img/favicon.svg" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://bobtranslate.com/">STranslate</a></td>
|
||||
<td> <a href="https://bobtranslate.com/">STranslate</a>(Windows) 是 WPF 开发的一款即用即走的翻译、OCR工具 </td>
|
||||
<td> <a href="https://stranslate.zggsong.com/">STranslate</a></td>
|
||||
<td> <a href="https://stranslate.zggsong.com/">STranslate</a>(Windows) 是 WPF 开发的一款即用即走的翻译、OCR工具 </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://www.gptaiflow.tech/logo.png" alt="gpt-ai-flow-logo" width="64" height="auto" /> </td>
|
||||
|
@ -157,6 +157,11 @@
|
|||
<td>一个专为 AI 智能体开发设计的 Rust 语言框架,致力于构建高度可组合、自主运行且具备永久记忆能力的 AI 智能体网络。</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td><img src="https://yomo.run/yomo-logo.png" alt="Icon" width="64" height="auto" /></td>
|
||||
<td><a href="https://github.com/deepseek-ai/awesome-deepseek-integration/blob/main/docs/yomo/README.md">YoMo</a></td>
|
||||
<td>Stateful Serverless LLM Function Calling Framework with Strongly-typed Language Support</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://alice.fun/alice-logo.png" alt="图标" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/bob-robert-ai/bob/blob/main/alice/readme.md">Alice</a> </td>
|
||||
<td>一个基于 ICP 的自主 AI 代理,利用 DeepSeek 等大型语言模型进行链上决策。Alice 结合实时数据分析和独特的个性,管理代币、挖掘 BOB 并参与生态系统治理。</td>
|
||||
|
@ -173,6 +178,16 @@
|
|||
</tr>
|
||||
</table>
|
||||
|
||||
### Solana 框架
|
||||
|
||||
<table>
|
||||
<tr>
|
||||
<td> <img src="./docs/solana-agent-kit/assets/sendai-logo.png" alt="Icon" width="128" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/deepseek-ai/awesome-deepseek-integration/blob/main/docs/ragflow/README.md"> Solana Agent Kit </a> </td>
|
||||
<td>一个用于连接 AI 智能体到 Solana 协议的开源工具包。现在,任何使用 Deepseek LLM 的智能体都可以自主执行 60+ 种 Solana 操作:</td>
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
### 即时通讯插件
|
||||
|
||||
<table>
|
||||
|
@ -186,6 +201,11 @@
|
|||
<td> <a href="https://github.com/RockChinQ/LangBot">LangBot<br/>(QQ, 企微, 飞书)</a> </td>
|
||||
<td> 大模型原生即时通信机器人平台,适配 QQ / QQ频道 / 飞书 / OneBot / 企业微信(wecom) 等多种消息平台 </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://nonebot.dev/logo.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/KomoriDev/nonebot-plugin-deepseek"">NoneBot<br/>(QQ, 飞书, Discord, TG, etc.)</a> </td>
|
||||
<td> 基于 NoneBot 框架,支持智能对话与深度思考功能。适配 QQ / 飞书 / Discord, TG 等多种消息平台 </td>
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
### 浏览器插件
|
||||
|
@ -226,6 +246,11 @@
|
|||
<td> <a href="https://www.ncurator.com/"> 馆长 </a> </td>
|
||||
<td> 知识库AI问答助手 - 让AI帮助你整理与分析知识</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://github.com/oinzen/RSSFlow-doc/blob/main/docs/images/en/icon64.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://rssflow.oinchain.com"> RssFlow </a> </td>
|
||||
<td>一款智能的RSS阅读器浏览器扩展,具有AI驱动的RSS摘要和多维度订阅视图功能。支持配置DeepSeek模型以增强内容理解能力。</td>
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
### VS Code 插件
|
||||
|
@ -302,8 +327,17 @@
|
|||
<td> 测试和评估LLM提示,包括DeepSeek模型。比较不同的LLM提供商,捕获回归,并评估响应。 </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> </td>
|
||||
<td> <a href="https://github.com/AndersonBY/deepseek-tokenizer"> deepseek-tokenizer </a> </td>
|
||||
<td> 一个高效的轻量级tokenization库,仅依赖`tokenizers`库,不依赖`transformers`等重量级依赖。 </td>
|
||||
</tr>
|
||||
<td> CR </td>
|
||||
<td> <a href="https://github.com/hustcer/deepseek-review"> deepseek-review </a> </td>
|
||||
<td> 🚀 使用 Deepseek 进行代码审核,支持 GitHub Action 和本地 🚀 </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://github.com/suqicloud/wp-ai-chat/raw/main/ic_logo.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/suqicloud/wp-ai-chat"> WordPress ai助手 </a> </td>
|
||||
<td> 对接Deepseek api用于WordPress站点的ai对话助手、ai文章生成、ai文章总结插件。 </td>
|
||||
</tr>
|
||||
</table>
|
||||
|
|
20
README_ja.md
20
README_ja.md
|
@ -165,6 +165,16 @@ DeepSeek APIを人気のソフトウェアに統合します。APIキーを取
|
|||
</tr>
|
||||
</table>
|
||||
|
||||
### Solanaフレームワーク
|
||||
|
||||
<table>
|
||||
<tr>
|
||||
<td> <img src="./docs/solana-agent-kit/assets/sendai-logo.png" alt="Icon" width="128" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/deepseek-ai/awesome-deepseek-integration/blob/main/docs/ragflow/README.md"> Solana Agent Kit </a> </td>
|
||||
<td>AIエージェントをSolanaプロトコルに接続するためのオープンソースツールキット。DeepSeek LLMを使用する任意のエージェントが、60以上のSolanaアクションを自律的に実行できます。</td>
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
### IMアプリケーションプラグイン
|
||||
|
||||
<table>
|
||||
|
@ -178,6 +188,11 @@ DeepSeek APIを人気のソフトウェアに統合します。APIキーを取
|
|||
<td> <a href="https://github.com/RockChinQ/QChatGPT">QChatGPT<br/>(QQ)</a> </td>
|
||||
<td> 高い安定性、プラグインサポート、リアルタイムネットワーキングを備えたQQチャットボット。 </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://nonebot.dev/logo.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://github.com/KomoriDev/nonebot-plugin-deepseek"">NoneBot<br/>(QQ, Lark, Discord, TG, etc.)</a> </td>
|
||||
<td> NoneBotフレームワークを基に、インテリジェントな会話と深い思考機能をサポートします。QQ/飛書/Discord/Telegram等多种多様なメッセージプラットフォームに対応しています </td>
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
### ブラウザ拡張機能
|
||||
|
@ -213,6 +228,11 @@ DeepSeek APIを人気のソフトウェアに統合します。APIキーを取
|
|||
<td> <a href="https://fluent.thinkstu.com/"> FluentRead </a> </td>
|
||||
<td> 誰もが母国語のような読書体験を持つことができる革新的なオープンソースのブラウザ翻訳プラグイン </td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td> <img src="https://github.com/oinzen/RSSFlow-doc/blob/main/docs/images/en/icon64.png" alt="Icon" width="64" height="auto" /> </td>
|
||||
<td> <a href="https://rssflow.oinchain.com"> RssFlow </a> </td>
|
||||
<td>AIを活用したRSS要約と多次元フィードビューを備えたインテリジェントなRSSリーダーブラウザ拡張機能。コンテンツ理解を強化するためのDeepSeekモデル設定をサポートしています。</td>
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
### VS Code拡張機能
|
||||
|
|
67
docs/solana-agent-kit/README.md
Normal file
67
docs/solana-agent-kit/README.md
Normal file
|
@ -0,0 +1,67 @@
|
|||
# README
|
||||
|
||||
<img src="assets/sendai-logo.png" width="64" height="auto" alt="logo">
|
||||
|
||||
---
|
||||
|
||||
An open-source toolkit for connecting AI agents to Solana protocols. Now, any agent, using any model can autonomously perform 60+ Solana actions:
|
||||
|
||||
|
||||
## STEP1.
|
||||
|
||||
Apply a token from [deepseek open platform](https://platform.deepseek.com/)
|
||||
|
||||
## STEP 2
|
||||
|
||||
Intialize the DeepSeek LLM
|
||||
|
||||
```
|
||||
import { ChatDeepSeek } from "@langchain/deepseek";
|
||||
|
||||
const deepseek = new ChatDeepSeek({
|
||||
model: "deepseek-chat",
|
||||
temperature: 0,
|
||||
});
|
||||
```
|
||||
|
||||
## STEP 3
|
||||
|
||||
Intialize the Solana Agent Kit with DeepSeek
|
||||
|
||||
```typescript
|
||||
const solanaAgent = new SolanaAgentKit(
|
||||
process.env.SOLANA_PRIVATE_KEY!,
|
||||
process.env.RPC_URL!,
|
||||
{
|
||||
OPENAI_API_KEY: process.env.OPENAI_API_KEY!,
|
||||
HELIUS_API_KEY: process.env.HELIUS_API_KEY!,
|
||||
PERPLEXITY_API_KEY: process.env.PERPLEXITY_API_KEY!,
|
||||
},
|
||||
);
|
||||
|
||||
const tools = createSolanaTools(solanaAgent);
|
||||
|
||||
const agent = createReactAgent({
|
||||
llm: deepseek,
|
||||
tools,
|
||||
checkpointSaver: memory,
|
||||
messageModifier: `
|
||||
You are a helpful agent that can interact onchain using the Solana Agent Kit. You are
|
||||
empowered to interact onchain using your tools. If you ever need funds, you can request them from the
|
||||
faucet. If not, you can provide your wallet details and request funds from the user. If there is a 5XX
|
||||
(internal) HTTP error code, ask the user to try again later. If someone asks you to do something you
|
||||
can't do with your currently available tools, you must say so, and encourage them to implement it
|
||||
themselves using the Solana Agent Kit, recommend they go to https://www.solanaagentkit.xyz for more information. Be
|
||||
concise and helpful with your responses. Refrain from restating your tools' descriptions unless it is explicitly requested.
|
||||
`,
|
||||
});
|
||||
|
||||
const stream = await agent.stream(
|
||||
{ messages: [new HumanMessage(userInput)] },
|
||||
config,
|
||||
);
|
||||
```
|
||||
|
||||
More guides can be found in the [Solana Agent Kit](https://docs.solanaagentkit.xyz/v0/introduction)
|
||||
|
||||
|
BIN
docs/solana-agent-kit/assets/sendai-logo.png
Normal file
BIN
docs/solana-agent-kit/assets/sendai-logo.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 26 KiB |
146
docs/yomo/README.md
Normal file
146
docs/yomo/README.md
Normal file
|
@ -0,0 +1,146 @@
|
|||
# YoMo Framework - Deepseek Provider
|
||||
|
||||
YoMo is an open-source LLM Function Calling Framework for building Geo-distributed AI agents. Built atop QUIC Transport Protocol and Strongly-typed Stateful Serverless architecture, makes your AI agents low-latency, reliable, secure, and easy.
|
||||
|
||||
## 🚀 Getting Started
|
||||
|
||||
Let's implement a function calling serverless `sfn-get-ip-latency`:
|
||||
|
||||
### Step 1. Install CLI
|
||||
|
||||
```bash
|
||||
curl -fsSL https://get.yomo.run | sh
|
||||
```
|
||||
|
||||
### Step 2. Start the server
|
||||
|
||||
Prepare the configuration as `my-agent.yaml`
|
||||
|
||||
```yaml
|
||||
name: ai-zipper
|
||||
host: 0.0.0.0
|
||||
port: 9000
|
||||
|
||||
auth:
|
||||
type: token
|
||||
token: SECRET_TOKEN
|
||||
|
||||
bridge:
|
||||
ai:
|
||||
server:
|
||||
addr: 0.0.0.0:9000 ## Restful API endpoint
|
||||
provider: deepseek ## LLM API Service we will use
|
||||
|
||||
providers:
|
||||
deepseek:
|
||||
api_key: <DEEPSEEK_API_KEY>
|
||||
model: deepseek-reasoner
|
||||
```
|
||||
|
||||
Start the server:
|
||||
|
||||
```sh
|
||||
YOMO_LOG_LEVEL=debug yomo serve -c my-agent.yaml
|
||||
```
|
||||
|
||||
### Step 3. Write the function
|
||||
|
||||
First, let's define what this function do and how's the parameters required, these will be combined to prompt when invoking LLM.
|
||||
|
||||
```golang
|
||||
type Parameter struct {
|
||||
Domain string `json:"domain" jsonschema:"description=Domain of the website,example=example.com"`
|
||||
}
|
||||
|
||||
func Description() string {
|
||||
return `if user asks ip or network latency of a domain, you should return the result of the giving domain. try your best to dissect user expressions to infer the right domain names`
|
||||
}
|
||||
|
||||
func InputSchema() any {
|
||||
return &Parameter{}
|
||||
}
|
||||
```
|
||||
|
||||
Create a Stateful Serverless Function to get the IP and Latency of a domain:
|
||||
|
||||
```golang
|
||||
func Handler(ctx serverless.Context) {
|
||||
var msg Parameter
|
||||
ctx.ReadLLMArguments(&msg)
|
||||
|
||||
// get ip of the domain
|
||||
ips, _ := net.LookupIP(msg.Domain)
|
||||
|
||||
// get ip[0] ping latency
|
||||
pinger, _ := ping.NewPinger(ips[0].String())
|
||||
pinger.Count = 3
|
||||
pinger.Run()
|
||||
stats := pinger.Statistics()
|
||||
|
||||
val := fmt.Sprintf("domain %s has ip %s with average latency %s", msg.Domain, ips[0], stats.AvgRtt)
|
||||
ctx.WriteLLMResult(val)
|
||||
}
|
||||
|
||||
```
|
||||
|
||||
Finally, let's run it
|
||||
|
||||
```bash
|
||||
$ yomo run app.go
|
||||
|
||||
time=2025-01-29T21:43:30.583+08:00 level=INFO msg="connected to zipper" component=StreamFunction sfn_id=B0ttNSEKLSgMjXidB11K1 sfn_name=fn-get-ip-from-domain zipper_addr=localhost:9000
|
||||
time=2025-01-29T21:43:30.584+08:00 level=INFO msg="register ai function success" component=StreamFunction sfn_id=B0ttNSEKLSgMjXidB11K1 sfn_name=fn-get-ip-from-domain zipper_addr=localhost:9000 name=fn-get-ip-from-domain tag=16
|
||||
```
|
||||
|
||||
### Done, let's have a try
|
||||
|
||||
```sh
|
||||
$ curl -i http://127.0.0.1:9000/v1/chat/completions -H "Content-Type: application/json" -d '{
|
||||
"messages": [
|
||||
{
|
||||
"role": "system",
|
||||
"content": "You are a test assistant."
|
||||
},
|
||||
{
|
||||
"role": "user",
|
||||
"content": "Compare website speed between Nike and Puma"
|
||||
}
|
||||
],
|
||||
"stream": false
|
||||
}'
|
||||
|
||||
HTTP/1.1 200 OK
|
||||
Content-Length: 944
|
||||
Connection: keep-alive
|
||||
Content-Type: application/json
|
||||
Date: Wed, 29 Jan 2025 13:30:14 GMT
|
||||
Keep-Alive: timeout=4
|
||||
Proxy-Connection: keep-alive
|
||||
|
||||
{
|
||||
"Content": "Based on the data provided for the domains nike.com and puma.com which include IP addresses and average latencies, we can infer the following about their website speeds:
|
||||
- Nike.com has an IP address of 13.225.183.84 with an average latency of 65.568333 milliseconds.
|
||||
- Puma.com has an IP address of 151.101.194.132 with an average latency of 54.563666 milliseconds.
|
||||
|
||||
Comparing these latencies, Puma.com is faster than Nike.com as it has a lower average latency.
|
||||
|
||||
Please be aware, however, that website speed can be influenced by many factors beyond latency, such as server processing time, content size, and delivery networks among others. To get a more comprehensive understanding of website speed, you would need to consider additional metrics and possibly conductreal-time speed tests.",
|
||||
"FinishReason": "stop"
|
||||
}
|
||||
```
|
||||
|
||||
### Full Example Code
|
||||
|
||||
[Full LLM Function Calling Codes](https://github.com/yomorun/llm-function-calling-examples)
|
||||
|
||||
## 🎯 Focuses on Geo-distributed AI Inference Infra
|
||||
|
||||
It’s no secret that today’s users want instant AI inference, every AI
|
||||
application is more powerful when it response quickly. But, currently, when we
|
||||
talk about `distribution`, it represents **distribution in data center**. The AI model is
|
||||
far away from their users from all over the world.
|
||||
|
||||
If an application can be deployed anywhere close to their end users, solve the
|
||||
problem, this is **Geo-distributed System Architecture**:
|
||||
|
||||
<img width="580" alt="yomo geo-distributed system" src="https://user-images.githubusercontent.com/65603/162367572-5a0417fa-e2b2-4d35-8c92-2c95d461706d.png">
|
Loading…
Add table
Reference in a new issue