Skip to content

streamline backend help#413

Merged
willccbb merged 2 commits intomainfrom
feat/streamline-backend-help
Mar 5, 2026
Merged

streamline backend help#413
willccbb merged 2 commits intomainfrom
feat/streamline-backend-help

Conversation

@willccbb
Copy link
Member

@willccbb willccbb commented Mar 5, 2026

prime eval run --help/-h now does a direct printout of the backend help without needing an extra hop

~/dev/prime-cli (feat/streamline-backend-help) uv run prime eval run --help
Usage: prime eval run [-h] [--env-args ENV_ARGS] [--env-dir-path ENV_DIR_PATH]
               [--endpoints-path ENDPOINTS_PATH] [--model MODEL]
               [--api-key-var API_KEY_VAR] [--api-base-url API_BASE_URL]
               [--header HEADER] [--num-examples NUM_EXAMPLES]
               [--rollouts-per-example ROLLOUTS_PER_EXAMPLE]
               [--max-concurrent MAX_CONCURRENT] [--max-tokens MAX_TOKENS]
               [--temperature TEMPERATURE] [--sampling-args SAMPLING_ARGS]
               [--verbose] [--no-interleave-scoring]
               [--state-columns STATE_COLUMNS] [--save-results]
               [--resume [PATH]] [--independent-scoring] [--save-to-hf-hub]
               [--hf-hub-dataset-name HF_HUB_DATASET_NAME]
               [--extra-env-kwargs EXTRA_ENV_KWARGS] [--tui] [--debug]
               [--max-retries MAX_RETRIES]
               environment

Note

Low Risk
Primarily affects CLI help/argument parsing and help-text rewriting, with minimal impact on core execution paths; risk is limited to potential regressions in command invocation edge cases.

Overview
Streamlines prime CLI passthrough commands so -h/--help prints the backend verifiers help directly (without a dedicated --backend-help flag) for eval run, gepa run, env init, env build, and lab setup.

This disables Typer’s default help option for these passthrough commands (help_option_names: []), makes the primary argument optional so help flags can be parsed, and adds explicit “missing argument” errors when no target is provided. Help output sanitization is improved in verifiers_bridge (more robust Usage: rewriting, eval/gepa arg rename, and idempotent injection of Prime-only eval flags), with new tests covering the help behavior and sanitization.

Written by Cursor Bugbot for commit 72d7d47. This will update automatically on new commits. Configure here.

@willccbb willccbb requested a review from d42me March 5, 2026 05:55
Copy link
Contributor

@d42me d42me left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@willccbb willccbb merged commit f357fe6 into main Mar 5, 2026
12 checks passed
@willccbb willccbb deleted the feat/streamline-backend-help branch March 5, 2026 18:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants