Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
-
Updated
Feb 27, 2026 - TypeScript
#
private-llm
Here are 9 public repositories matching this topic...
The Privacy Firewall for LLMs
privacy mcp claude anonymization pdf-processing pseudonymization pdf-redaction private-llm model-context-protocol mcp-server pdf-pseudonymization
-
Updated
Aug 11, 2025 - Python
Multi-model LLM serving for NVIDIA DGX Spark with vLLM, web UI, and tool calling
-
Updated
Jan 24, 2026 - Python
Verify claims using AI agents that debate using scraped evidence and local language models.
python scraping beautifulsoup autonomous-agents local-inference qwen lm-studio langgraph private-llm agentic-ai claim-verification phi-4-mini evidence-based-ai
-
Updated
Jun 1, 2025 - Python
AI tool to help users research using local LLMs and automated web search.
python google gemma streamlit lm-studio langgraph private-llm tavily-api privacy-first-ai tavily-search next-gen-ai google-gemma-3-1b instruction-tuned-llm gguf-model-support
-
Updated
Jun 9, 2025 - Python
Create a Small LLM using EleutherAI/gpt-neo-2.7B - Fine Tune It for a Specalized Purpouse and Leverage as a Co-Pilot
-
Updated
May 23, 2024 - HTML
Private Retrieval-Augmented Generation (RAG) runtime enabling offline document intelligence using local embeddings and Ollama-hosted LLMs.
offline-first private privacy-preserving rag llm generative-ai local-llm retrieval-augmented-generation local-ai offline-llm offline-ai rag-chatbot private-ai private-llm laptop-llm
-
Updated
Feb 20, 2026 - Python
Sovereign AI Infrastructure: A Hardened-by-Design approach to private LLM deployment. Engineered for Fiscal Efficiency and zero-trust security.
devsecops zero-trust finops pulumi cloud-cost-optimization private-llm sovereign-ai hardened-by-design
-
Updated
Feb 9, 2026 - Python
Bot for IRC and Discord with LocalLLM and LLM support
-
Updated
Dec 27, 2025 - Python
Improve this page
Add a description, image, and links to the private-llm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the private-llm topic, visit your repo's landing page and select "manage topics."