AimRank

Measured conclusion: Deep-tested. L2 outcome: tools_ok.

Read public pairwise-preference rankings and their statistical quality evidence. No API key.

Add to your agent

Copy this into your MCP client config:

{
  "mcpServers": {
    "AimRank": {
      "url": "https://app.aimrank.io/mcp/public",
      "transport": "streamable-http"
    }
  }
}

Measured tools (21)

• aimrank_get_daily_pair read-only

  Fetch today's Daily Pair — the trending matchup chosen at 00:00 UTC. Pairs with the `vote_of_the_day` agent template. Returns the challenge + a fresh matchup. If the cron hasn't run yet, falls back via ok=False so the agent can use `aimrank_get_matchup` instead. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_get_ranking read-only

  Fetch a ranking's metadata + top 25 entities sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_get_leaderboard read-only

  Get the top N entities of a ranking sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • limit — integer
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_get_matchup read-only

  Get the next pair of entities to evaluate. Strategies: adaptive (default), swiss, balanced, random, uncertainty, explore, information_gain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • api_key
  • strategy — string

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_search_entities read-only

  Find entities by name substring within a ranking. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • query (required) — string
  • limit — integer
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_create_share_card read-only

  Return share-ready URLs + embed snippets for a ranking. Formats: "all" (default — everything), "twitter", "linkedin", "embed_leaderboard", "embed_vote", "badge_markdown", "qr_code", "data_card". Pass these to a human to paste into a tweet, blog, Notion page, or Slack message. The OG image renders automatically when the public_url is unfurled by Twitter / LinkedIn / Slack. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • format — string
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_predict_matchup_winner read-only

  Predict the winner of a matchup BEFORE a vote is cast. Uses Glicko-2 win probability under the same formula matchmaking uses internally. Pairs with aimrank_submit_vote for the "Claude predicts, you vote, we compare" demo. Does not record a vote — read-only. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • entity_a_id (required) — string
  • entity_b_id (required) — string
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_discover_public_rankings read-only

  Browse public rankings — agent equivalent of surfing aimrank.io. Filters: category, media_type ("text" | "image" | "audio" | "video"), sort ("trending" | "recent" | "most_votes" | "random"), limit 1-50. Each result embeds share assets so the agent can hand any ranking back to the user as a clickable link without a follow-up call. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • sort — string
  • limit — integer
  • api_key
  • category
  • media_type

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_list_domain_entities read-only

  List all entities in a domain's pool sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • domain_id (required) — string
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_get_domain read-only

  Get domain details including entity pool and competition list. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • domain_id (required) — string
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_list_competitions read-only

  List all competitions (open voting + brackets) in a domain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • domain_id (required) — string
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_get_data_card read-only

  Auto data card — Layer 7. Provenance + IAA + coverage + per-annotator quality + transitivity + qualification stats in one synthesized markdown audit artefact. Format: 'markdown' (default) or 'json' for structured summary. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • format — string
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_get_agreement read-only

  Inter-annotator agreement — Layer 5. Returns Cohen's κ (n=2 raters), Fleiss' κ, Krippendorff's α, Scott's π + Landis-Koch interpretation, plus the multi-rater coverage report. `min_raters` overrides the ranking's configured min_raters_per_pair. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • api_key
  • min_raters

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_get_ceiling read-only

  Pairwise-κ ceiling from qualification attempts. The upper bound any judge / RM can credibly hit on this domain — used to pin the L3 pilot refund clause (refund if κ < ceiling - 5pp). api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • api_key
  • min_overlapping_items — integer

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_get_plackett_luce read-only

  Plackett-Luce listwise ranking aggregation — OFFLINE AUDIT ONLY. Reported post-hoc; it NEVER writes ratings, and setting it as a ranking's algorithm returns 400. AimRank has 6 rating engines plus 2 offline aggregators (this and CrowdBT) — never describe it as an 8th rating algorithm. Generalises Bradley-Terry to ranked lists. On pairwise data, collapses to BT MLE — useful as a second-opinion aggregator. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • api_key
  • max_iterations — integer
  • min_appearances_per_entity — integer

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_get_crowd_bt read-only

  CrowdBT — joint fit of entity scores + per-annotator reliability η. Surfaces noisy / anti-correlated raters explicitly. Methodology audit, not a live engine. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • api_key
  • max_iterations — integer
  • min_votes_per_entity — integer
  • min_votes_per_annotator — integer

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_list_public_judges read-only

  Browse public judge-prompt artifacts shared by other users. Filter by ``category`` (free-text), ``domain_id``, or both. Sort options: ``fork_count`` (default — most-forked first), ``recent``, ``faithfulness``. Returns artifact summaries WITHOUT the full prompt text — call `aimrank_fork_judge_prompt` or the REST GET to retrieve the full prompt before using it. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • sort — string
  • limit — integer
  • api_key
  • category
  • domain_id

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_find_similar_domains read-only

  Find public domains most similar to a query or a known domain. Use ``query`` for free-text search ("pharma evaluation") OR ``domain_id`` to find domains similar to one you already know. Exactly one must be provided. TF-IDF + cosine similarity over name + description + category + declared constitution + objectives text. Cheap (no embedding API calls), 5-minute in-process cache. Only public domains are searched / returned. Score in [0, 1] — typical "useful match" threshold is ≥0.15; "near duplicate" is ≥0.5. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • limit — integer
  • query
  • api_key
  • domain_id
  • min_score — number

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_predict read-only

  iCOMPLY contract: pairwise prediction with provenance fields. Returns the engine's predicted winner + probability shaped so iCOMPLY's Annex IV section-4 generator can ingest the response directly. See [iCOMPLY_INTEGRATION_STRATEGY.md] for the contract. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • entity_a_id (required) — string
  • entity_b_id (required) — string
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_explain read-only

  iCOMPLY contract: explain a prediction in features + narrative. Returns the Glicko-2 μ/φ inputs for both entities + a deterministic narrative. No LLM-synthesised rationale — these are the actual numbers the math uses, which is exactly what an Annex IV auditor needs to trace. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

  Parameters:

  • ranking_id (required) — string
  • entity_a_id (required) — string
  • entity_b_id (required) — string
  • api_key

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

• aimrank_healthcheck read-only

  iCOMPLY contract: liveness + DB-connectivity probe.

  Hints: read-only yes · destructive not declared · idempotent yes · open-world yes

Publisher website

Measured by MCPYP probing. Untested fields are omitted, never estimated. Listing is always free; MCPYP never proxies calls or stores user tokens.