Skip to content

History / Developer Module Development

Revisions

  • Enhance documentation: add details on rubric criteria, refine rubric feature, and update judge settings information

    @holgerimbery holgerimbery committed Mar 4, 2026
  • Update documentation for v0.4.0 release: revise version numbers, enhance module descriptions, and adjust links for clarity

    @holgerimbery holgerimbery committed Mar 2, 2026
  • Add Module Tier Labels feature with enum and interface updates; enhance documentation for clarity

    @holgerimbery holgerimbery committed Mar 2, 2026
  • Update documentation to include Red Teaming module details and version bump to v0.3.0

    @holgerimbery holgerimbery committed Mar 1, 2026
  • Add comprehensive documentation for developers and users - Created Developer-Contributing.md to outline contribution guidelines, branching strategy, versioning, changelog discipline, and code conventions. - Added Developer-Getting-Started.md to guide new developers in setting up the local development environment. - Introduced Developer-Module-Development.md detailing how to create agent connector and judge modules. - Established User-API-Keys.md for managing API keys for programmatic access to the REST API. - Added User-Agents.md to explain agent management and configuration. - Created User-Audit-Log.md to provide an overview of logged actions and how to read the audit log. - Introduced User-Dashboard.md for aggregate quality metrics and run history. - Added User-Documents.md for managing knowledge-base documents for AI-generated test questions. - Created User-Getting-Started.md to provide an overview of mate and its deployment modes. - Added User-Rubrics.md to define custom evaluation criteria for AI agent responses. - Established User-Settings.md for configuring AI judge, question generation, and module settings. - Created User-Test-Suites.md to manage test suites and cases within the evaluation workflow.

    @holgerimbery holgerimbery committed Mar 1, 2026