Skip to content

Ker102/ViperMesh

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

282 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

🐍 ViperMesh

AI-Powered Blender Assistant & Neural 3D Hub

Transform your 3D workflow with AI-powered Blender automation and neural generation.
Create, modify, and enhance your Blender projects through natural conversation and visual tools.

Next.js 16 β€’ TypeScript β€’ Tailwind β€’ Supabase β€’ LangChain β€’ Electron β€’ Blender


Features β€’ Agent Tools β€’ Quick Start β€’ Neural Pipeline β€’ Contributing


πŸš€ Features

ViperMesh is a comprehensive platform that brings next-gen AI capabilities to Blender through an intelligent agent, a proprietary RAG pipeline, dynamic addon adaptation, and hybrid neural 3D generation.

πŸ€– LangChain v1 Agent

  • ReAct Loop: Built on LangChain 1.x createAgent + LangGraph with hallucinated tool-call recovery
  • 22 Native Tools: Direct Blender manipulation without writing Python (transforms, modifiers, parenting, export, and more)
  • Middleware Stack: Viewport screenshots after code execution, RAG context injection
  • Session Persistence: MemorySaver with thread_id keyed to project ID

🧠 Dynamic Addon Detection

  • Auto-Discovery: Agent calls list_installed_addons to introspect enabled Blender addons at session start
  • Addon Registry: Known addon profiles (Node Wrangler, Rigify, LoopTools, Bool Tool, etc.)
  • Prompt Injection: System prompt is dynamically extended with addon-specific operators and usage tips
  • Zero Configuration: Install an addon β†’ the agent adapts automatically

πŸ“š Hybrid RAG Pipeline

  • Context-Aware Generation: Leverages professional Blender scripts for accurate code generation
  • Semantic Search: Uses Gemini embeddings for high-quality retrieval
  • CRAG Architecture: Corrective RAG with quality grading and fallback strategies
  • Knowledge Base: Covers modeling, rigging, shading, geometry nodes, animation, and lighting

🌐 Premium Web Dashboard UI

  • Dual Modes:
    • Autopilot: Conversational AI assistant for procedural generation.
    • Studio: Full-page, immersive workspace with an icon-sidebar and interactive tool-card grid.
  • Teal Design System: Professional, high-end visual aesthetics (#0d9488 focus) with interactive 3D hero sections and animated SVGs.
  • Supabase Auth: Secure authentication with Google and GitHub OAuth.

πŸ”Œ Blender MCP Bridge

  • Socket Bridge: Executes generated Python directly in Blender via TCP
  • Bidirectional: Commands sent, results returned as JSON
  • Viewport Capture: Base64-encoded screenshots for visual feedback loops

🎨 Neural 3D Pipeline

ViperMesh incorporates a powerful 3-tier hybrid generation architecture for neural assets:

  1. Hosted APIs: Integration with Fal.ai (Hunyuan3D 2.1, TRELLIS 2) and proprietary YVO3D for premium texturing.
  2. Serverless GPUs: Custom model deployment via RunPod for high-demand tasks.
  3. Scale-to-Zero: Optimized routing for cost-effective handling of self-hosted volumetric models.

πŸ› οΈ Agent Tools

The ViperMesh agent has 22 native tools that it can call directly β€” no Python code required:

Category Tools
Scene Analysis get_scene_info, get_object_info, get_all_object_info, get_viewport_screenshot
Code Execution execute_code, list_materials
Object Management delete_object, rename_object, duplicate_object, join_objects
Transforms set_object_transform, apply_transforms
Modifiers add_modifier, apply_modifier, shade_smooth
Hierarchy parent_set, parent_clear
Organization set_origin, move_to_collection, set_visibility
Export export_object (GLB, GLTF, FBX, OBJ, STL)
Detection list_installed_addons

Plus integration tools when enabled: PolyHaven, Sketchfab, Hyper3D Rodin.


🧩 Dynamic Addon Detection

ViperMesh is the first AI agent that auto-adapts to your installed Blender addons.

Currently recognized addons:

Addon Category What the Agent Gains
Node Wrangler Shading PBR texture auto-connect
Rigify Rigging Meta-rig to full rig generation
LoopTools Mesh Relax, circle, bridge operations
Bool Tool Object Quick boolean unions/differences
Images as Planes Import Import reference images
Extra Mesh Objects Add Mesh Procedural gears, gems, stars
Extra Curve Objects Add Curve Spirals, torus knots
F2 Mesh Extended face-filling
3D-Print Toolbox Mesh Print quality checks
Animation Nodes Animation Procedural node trees
BlenderKit Import Asset library downloads

πŸ—οΈ Technology Stack

Frontend


Next.js 16 β€’ React 19 β€’ TypeScript 5.6 β€’ Tailwind CSS

Backend


Node.js 24+ β€’ Supabase (Auth + Postgres) β€’ Stripe

AI & Desktop


ViperAgent 2.0 β€’ LangChain v1 β€’ LangGraph β€’ Electron β€’ Blender Python API

πŸ“‹ Quick Start

Prerequisites

  • Node.js 18+ (24+ recommended)
  • Supabase project (or local instance)
  • Blender 4.0+ (5.0 compatible)
  • Python 3.10+

Installation

  1. Clone the repository

    git clone https://github.com/Ker102/ModelForge.git
    cd ModelForge
  2. Install dependencies

    npm install
  3. Set up environment variables

    cp .env.example .env

    Configure .env with your Supabase URL/keys, and Gemini API key (used for ViperAgent 2.0 and RAG).

  4. Start development server

    npm run dev

    Open http://localhost:3000 in your browser.

  5. Connect Blender

    • Install the ViperMesh addon in Blender (public/downloads/vipermesh-addon.py)
    • Click "Start Server" in Blender's sidebar panel
    • The agent connects automatically via TCP socket

πŸ”„ Roadmap

  • LangChain v1 agent with ReAct loop
  • 22 native Blender tools
  • Dynamic addon detection + registry
  • Hybrid RAG Pipeline
  • Supabase Auth (Google + GitHub OAuth)
  • Stripe subscription integration
  • Viewport screenshot analysis
  • Electron desktop shell
  • Premium Redesign (ViperMesh Branding & Teal Interface)
  • Interactive Studio Workspaces
  • Manual verification of all tool categories
  • Production desktop packaging
  • Dynamic addon operator discovery
  • Community addon marketplace page

🀝 Contributing

We welcome contributions! Please read our Contributing Guide to get started.

πŸ“„ License

This project is licensed under the LICENSE file.


Built with ❀️ by the ViperMesh team

Website β€’ Documentation β€’ Addons

About

Using a custom addon for the agent to interact ith the Blender python API. Agent can interact with other addons, including community addons though the Modelforge addon, Modelforge acts as a unifyed workspace for all things 3D, use our models or bring your own. In development

Topics

Resources

License

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors