Home

mate — Documentation

mate — a multi-agent test environment for AI agents.
Current version: v0.9.0

Step-by-step guides for testers and team members using mate to evaluate AI agents.

Page	Description
Getting Started	First login, deployment modes, quick setup
Agents	Create and manage agent connections
Test Suites & Test Cases	Build test suites, add cases, run evaluations
Documents	Upload and manage knowledge-base documents
Rubrics	Define evaluation rubric sets and criteria
Dashboard	Read KPIs, pass-rate trends, run history
Settings	AI judge config, modules, tenant, appearance
API Keys	Generate and manage API keys for automation
Audit Log	Review the system audit trail
Authentication — Entra ID	Configure Microsoft Entra ID SSO, app roles, and HTTPS setup

Architecture, setup, and contribution guides for engineers building on or extending mate.

Page	Description
Architecture	System design, solution structure, design principles
Getting Started (Dev)	Local dev setup, Docker, environment variables
Azure Quickstart (Dev)	Azure deployment workflow, scripts, troubleshooting, and cost guidance
Module Development	Writing new connector, judge, and red-team modules
API Reference	REST API overview, authentication, endpoint index
Contributing	Branching, versioning, changelog, backlog discipline
Changelog	Full release history
Backlog	Epics, planned work, and status tracking