docs: add AI Cloud LLM service documentation#522
Open
swordqiu wants to merge 2 commits intoyunionio:masterfrom
Open
docs: add AI Cloud LLM service documentation#522swordqiu wants to merge 2 commits intoyunionio:masterfrom
swordqiu wants to merge 2 commits intoyunionio:masterfrom
Conversation
swordqiu
commented
Mar 2, 2026
docs/aicloud/llm.md
Outdated
| - **弹性扩缩容**:基于容器化技术,支持灵活的弹性伸缩 | ||
| - **Dify 集成**:内置 Dify 知识库和 AI 工作流平台 | ||
| - **MCP Agent**:支持 Model Context Protocol,实现 AI 智能体与云平台的无缝交互 | ||
| - **GPU 调度优化**:支持 NVIDIA GPU 等异构计算资源的智能调度 |
docs/aicloud/llm.md
Outdated
|
|
||
| - **多模型支持**:支持 Ollama、vLLM 等多种 LLM 运行框架 | ||
| - **即时模型管理**:提供预置模型镜像,实现秒级模型部署 | ||
| - **弹性扩缩容**:基于容器化技术,支持灵活的弹性伸缩 |
docs/aicloud/llm.md
Outdated
| - **MCP Agent**:支持 Model Context Protocol,实现 AI 智能体与云平台的无缝交互 | ||
| - **GPU 调度优化**:支持 NVIDIA GPU 等异构计算资源的智能调度 | ||
|
|
||
| ## 架构设计 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
添加 Cloudpods LLM 服务的完整文档,包括功能介绍、使用指南和最佳实践。
文档内容
文档路径
该文档基于 cloudpods/pkg/llm 源码的实际功能编写。