Skip to content

Server-side LLM agent#286

Open
FrancescAlted wants to merge 6 commits intomainfrom
ss-llm-agent
Open

Server-side LLM agent#286
FrancescAlted wants to merge 6 commits intomainfrom
ss-llm-agent

Conversation

@FrancescAlted
Copy link
Member

Work in progress

  - vendor LLM agent core under caterva2.services.llm_agent
  - add FastAPI session and chat endpoints
  - add Caterva2 client helpers for LLM sessions
  - support mock and Groq providers
  - add notebook example using server-side sessions
  - add staging wheel publishing channel and release docs
  - add tests for LLM session lifecycle and ownership
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant