com.rubrkit/rubrkit

Measured conclusion: Alive, not deep-tested. L2 outcome: not_attempted.

MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.

Add to your agent

Copy this into your MCP client config:

{
  "mcpServers": {
    "rubrkit": {
      "url": "https://www.rubrkit.com/api/v1/mcp",
      "transport": "streamable-http"
    }
  }
}

Measured tools (41)

• rubrkit_search_api_docs

  Search the canonical docs/api Markdown guides and OpenAPI operation summaries.

  Parameters:

  • query (required) — string
  • limit — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_read_api_doc

  Read a docs/api Markdown guide or OpenAPI source by slug, file name, or docs/api path.

  Parameters:

  • slugOrPath (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_read_openapi_contract

  Read the canonical docs/api/openapi.yaml contract.

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_create_artifact_bundle

  Create an artifact bundle through /api/v1/artifact-bundles. Requires artifact_bundles:write for API keys.

  Parameters:

  • name (required) — string
  • settings — object
  • description — ['string', 'null']
  • customRubric — object

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_list_artifact_bundles

  List artifact bundles through /api/v1/artifact-bundles. Requires artifact_bundles:read for API keys.

  Parameters:

  • limit — integer
  • status — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_read_artifact_bundle

  Read artifact bundle details, files, and file tree. Requires artifact_bundles:read for API keys.

  Parameters:

  • artifactBundleId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_delete_artifact_bundle

  Archive an artifact bundle (soft delete) through DELETE /api/v1/artifact-bundles/{artifactBundleId}. The bundle moves to the archived state and can be restored or permanently deleted later. Requires artifact_bundles:write for API keys.

  Parameters:

  • artifactBundleId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_hard_delete_artifact_bundle

  Permanently delete an archived artifact bundle and all of its files, versions, and run history through DELETE /api/v1/artifact-bundles/{artifactBundleId}/permanent. This is irreversible and only works on bundles that are already archived. Requires artifact_bundles:write for API keys.

  Parameters:

  • artifactBundleId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_upload_artifact_files

  Upload one or more text files into an artifact bundle. Requires files:write for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • files (required) — array

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_list_artifact_files

  List files in an artifact bundle. Requires files:read for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • limit — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_read_artifact_file

  Read the latest file metadata and content. Requires files:read for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • fileId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_update_artifact_file

  Write a new editable version for a file. Requires files:write for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • fileId (required) — string
  • content (required) — string
  • message — string
  • mediaType — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_compact_artifact_file

  Shorten a markdown or text prompt without losing instructions. mode standard (default) is a free deterministic pass that saves a new version unless dryRun is true; requires files:write for API keys. mode deep starts an AI compaction job that uses credits, verifies every instruction was kept, and never saves on its own: poll the returned job, then call rubrkit_apply_deep_compaction; requires compactions:run for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • fileId (required) — string
  • mode — string
  • dryRun — boolean

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_estimate_deep_compaction

  Estimate the credit cost of a deep compaction of one file before starting it. Requires compactions:run for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • fileId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_apply_deep_compaction

  Save a succeeded deep compaction job's verified result as a new version of the file. Refused if the file changed since the job started. Requires files:write for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • fileId (required) — string
  • jobId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_start_audit

  Start an async audit job. Audit results are cached per account by a content hash of their inputs; pass force: true to bypass the cache and run a fresh audit (the same as the CLI's --no-cache flag). Requires audits:run for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • force — boolean
  • modelTier — string
  • rubricKey — string
  • artifactType — string
  • targetFileId — string
  • reasoningEffort — string
  • customRequirements — array
  • targetVersionNumber — integer
  • artifactBundleVersionNumber — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_list_audits

  List persisted audit history. Requires artifact_bundles:read for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • limit — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_read_audit

  Read a single audit run. Requires artifact_bundles:read for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • auditRunId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_apply_audit_rewrite

  Apply a completed audit's AI rewrite to the bundle files (a new version per changed file). Requires audits:run for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • auditRunId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_poll_job

  Read async job progress. Requires jobs:read for API keys.

  Parameters:

  • jobId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_list_job_events

  Read append-only job progress events. Requires jobs:read for API keys.

  Parameters:

  • jobId (required) — string
  • limit — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_list_artifact_bundle_versions

  List bundle-level version events. Requires artifact_bundles:read for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • limit — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_restore_artifact_bundle_version

  Restore files from a prior artifact-bundle version by creating new file versions. Requires artifact_bundles:write and files:write for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • versionNumber (required) — integer
  • message — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_list_file_versions

  List immutable versions for a file. Requires files:read for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • fileId (required) — string
  • limit — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_restore_file_version

  Restore a prior file version by creating a new version. Requires files:write for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • fileId (required) — string
  • versionNumber (required) — integer
  • message — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_run_evals

  Start an async eval run. Requires evals:run for API keys. Set mode: "advanced" with baselineVersionId and candidateVersionId to run a statistically-backed A/B (repeats defaults to 3, max 5).

  Parameters:

  • artifactBundleId (required) — string
  • mode — string
  • repeats — integer
  • maxCases — integer
  • testCases — array
  • auditRunId — string
  • sourceFileId — string
  • rubricVersion — string
  • candidateFileId — string
  • baselineVersionId — string
  • candidateVersionId — string
  • sourceFileVersionId — string
  • sourceVersionNumber — integer
  • candidateFileVersionId — string
  • candidateVersionNumber — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_list_evals

  List eval history. Requires artifact_bundles:read for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • limit — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_read_eval

  Read one eval run, including the `stats` statistical verdict on advanced-mode runs (empty for standard runs). Requires artifact_bundles:read for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • evalRunId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_export_proof_report

  Start an async proof report job with export storage enabled by default. Requires evals:run for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • evalRunId — string
  • auditRunId — string
  • sourceFileId — string
  • includeExport — boolean
  • rubricVersion — string
  • candidateFileId — string
  • sourceFileVersionId — string
  • sourceVersionNumber — integer
  • candidateFileVersionId — string
  • candidateVersionNumber — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_read_proof_report

  Read one proof report. Requires artifact_bundles:read for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • proofReportId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_list_golden_cases

  List the golden cases for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:read (or artifacts:pull) for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • status — ['string', 'null']

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_add_golden_case

  Add a golden case (a real edge-case input with a confirmed-correct output) to an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:write for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • input (required) — object
  • tags — array
  • origin — string
  • weight — integer
  • criteria — object
  • originRef — object
  • expectedOutput — object

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_retire_golden_case

  Retire a golden case via DELETE /api/v1/golden-cases/{goldenCaseId}. Requires artifact_bundles:write for API keys.

  Parameters:

  • goldenCaseId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_create_drift_monitor

  Create a drift monitor pinned to a file version via POST /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:write for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • pinnedVersionId (required) — string
  • cadence — string
  • repeats — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_list_drift_monitors

  List the drift monitors for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:read (or artifacts:pull) for API keys.

  Parameters:

  • artifactBundleId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_read_drift_observations

  List the recorded observations for a drift monitor via /api/v1/drift-monitors/{driftMonitorId}/observations. Requires artifact_bundles:read (or artifacts:pull) for API keys.

  Parameters:

  • driftMonitorId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_run_drift_check

  Queue a drift check immediately instead of waiting for the monitor's schedule, via POST /api/v1/drift-monitors/{driftMonitorId}/check. The first check on a new monitor calibrates its baseline. Costs one audit per repeat. Requires artifact_bundles:write for API keys.

  Parameters:

  • driftMonitorId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_set_drift_monitor_status

  Pause or resume a drift monitor via PATCH /api/v1/drift-monitors/{driftMonitorId}. Requires artifact_bundles:write for API keys.

  Parameters:

  • driftMonitorId (required) — string
  • status (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_record_outcome

  Record a production outcome event (input feature, metric, and/or label) for an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/outcomes. Requires artifact_bundles:write for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • inputHash — string
  • occurredAt — string
  • inputFeature — number
  • outcomeLabel — string
  • outcomeMetric — number
  • artifactVersionId — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_read_input_drift

  Compare recent production inputs against a prior reference window (population stability index) for an artifact bundle via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/input. Requires artifact_bundles:read (or artifacts:pull) for API keys.

  Parameters:

  • artifactBundleId (required) — string
  • binCount — integer
  • windowDays — integer

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

• rubrkit_read_validity_drift

  Correlate rubric scores against recorded outcome metrics for an artifact bundle to check whether the rubric is still predictive via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/validity. Requires artifact_bundles:read (or artifacts:pull) for API keys.

  Parameters:

  • artifactBundleId (required) — string

  Hints: read-only not declared · destructive not declared · idempotent not declared · open-world not declared

Publisher website Repository

Measured by MCPYP probing. Untested fields are omitted, never estimated. Listing is always free; MCPYP never proxies calls or stores user tokens.