Skip to content
verify mcp Beta VerifyMCP is currently in beta. If you notice any issues, get in touch and we’ll put it right.

Agent Reliability

REMOTE · AGENTRELIABILITY.DEV · SCANNED SEP 20

Testing, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence

+3 this week 89 Trust /100
Trust breakdown (7 categories)

How this component scores in each security and reliability category. Every signal is checked automatically against the live server, and we only credit what we can confirm. How we score → Why this is hard to score →

Endpoint Security80
Transport & Reachability100
Schema Quality & AI Usability91
  • 100% of prompts and resources have a non-trivial description (not blank, and not just the item's name).Pass
  • AI-judged instruction clarity (excellent).Pass
  • Tool/resource definitions use about 4561 tokens (~89/item across 51 items; 9 tools + 42 resources), lean.Pass
  • Usage-examples check failed: none of the tools include examples. See how to fix → Fail
Stability & Change Management93
  • Stability observed for 28 of 30 days with no destabilising changes; credit accrues until the full window elapses.Partial
Tool Coverage100
  • 100% of tools have a non-trivial description (not blank, and not just the tool's name).Pass
  • 100% of tool parameters carry a description.Pass
  • Structured output schemas are declared (100% of tools); any adoption earns full credit.Pass
Tool Safety100
  • No prompt-injection markers were found in the server instructions, tool names or descriptions we captured.Pass
  • We read all 9 captured tool definition(s), and no name or description among them implies an irreversible operation.Pass
  • An AI judge read all 10 captured unit(s) of tool text and found none that tries to manipulate the model reading it.Pass
Capabilities100
  • Implements a current MCP spec version (2026-07-28).Pass
Install

How do I install the Agent Reliability MCP server?

Agent Reliability is a hosted endpoint at https://agentreliability.dev/mcp?via=manifest, so there is nothing to install locally. Ready-made configuration for Claude, Cursor, VS Code, Codex and 5 more is on this page, copied from each client's own documentation.

remote · agentreliability.dev

# add to Claude Code
claude mcp add --transport http dev-agentreliability-agent-reliability 'https://agentreliability.dev/mcp?via=manifest'
// .cursor/mcp.json
{
  "mcpServers": {
    "dev-agentreliability-agent-reliability": {
      "url": "https://agentreliability.dev/mcp?via=manifest"
    }
  }
}
// .vscode/mcp.json
{
  "servers": {
    "dev-agentreliability-agent-reliability": {
      "type": "http",
      "url": "https://agentreliability.dev/mcp?via=manifest"
    }
  }
}
# ~/.codex/config.toml
[mcp_servers.dev-agentreliability-agent-reliability]
url = "https://agentreliability.dev/mcp?via=manifest"
// opencode.json
{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "dev-agentreliability-agent-reliability": {
      "type": "remote",
      "url": "https://agentreliability.dev/mcp?via=manifest",
      "enabled": true
    }
  }
}
# add to OpenClaw
openclaw mcp add dev-agentreliability-agent-reliability --url 'https://agentreliability.dev/mcp?via=manifest' --transport streamable-http
# ~/.hermes/config.yaml
mcp_servers:
  dev-agentreliability-agent-reliability:
    url: "https://agentreliability.dev/mcp?via=manifest"
// ~/.netclaw/config/netclaw.json
{
  "McpServers": {
    "dev-agentreliability-agent-reliability": {
      "Transport": "http",
      "Url": "https://agentreliability.dev/mcp?via=manifest"
    }
  }
}
# add to Vellum
assistant mcp add dev-agentreliability-agent-reliability -t streamable-http -u 'https://agentreliability.dev/mcp?via=manifest'
// mcp.json
{
  "mcpServers": {
    "dev-agentreliability-agent-reliability": {
      "type": "http",
      "url": "https://agentreliability.dev/mcp?via=manifest"
    }
  }
}

The mcpServers block is a cross-client convention. Remote transports vary, so check your client's docs.

Changelog

Every change we have recorded for this component, newest first. Security-relevant changes are always shown. ▲ marks a change for the better, ▼ a change for the worse; unmarked changes are neutral.

  • 18 Sept 26 +1

    No change was recorded against any check on this day. Stability & Change Management went from 83 to 87. That category is still filling its 30-day observation window: 25 days of observed history at the previous scan, 26 at this one. The score rises as the window fills, whether or not the server changes.

  • 16 Sept 26 +1

    No change was recorded against any check on this day. Stability & Change Management went from 77 to 80. That category is still filling its 30-day observation window: 23 days of observed history at the previous scan, 24 at this one. The score rises as the window fills, whether or not the server changes.

  • 15 Sept 26 0
    • Server version: 0.9.0 → 0.9.2 functional
  • 14 Sept 26 +1

    No change was recorded against any check on this day. Stability & Change Management went from 70 to 73. That category is still filling its 30-day observation window: 21 days of observed history at the previous scan, 22 at this one. The score rises as the window fills, whether or not the server changes.

  • 12 Sept 26 +1

    No change was recorded against any check on this day. Stability & Change Management went from 63 to 67. That category is still filling its 30-day observation window: 19 days of observed history at the previous scan, 20 at this one. The score rises as the window fills, whether or not the server changes.

  • 10 Sept 26 +1

    No change was recorded against any check on this day. Stability & Change Management went from 57 to 60. That category is still filling its 30-day observation window: 17 days of observed history at the previous scan, 18 at this one. The score rises as the window fills, whether or not the server changes.

  • 9 Sept 26 +59
    • Authorization: unverified → partial security
    • Injection markers: unverified → pass security
    • Transport: fail → pass security
    • Tool “get_related” rewrote its description, which is the text the model reads security
    • Endpoint reachability: not serving MCP → reachable functional
    • Tool coverage: unverified → 100 functional
    • Schema quality: unverified → 100 functional
    • Stability: unverified → 0.57 functional
    • MCP protocol: unverified → pass functional
    • Server version: 0.8.0 → 0.9.0 functional
    • “get_related” added an optional parameter “cursor” cosmetic
    • “get_related” added an optional parameter “limit” cosmetic
  • 8 Sept 26 −58
    • Endpoint reachability: reachable → not serving MCP security
    • Tool safety: pass → unverified security
    • Authorization: partial → unverified security
    • Stability: 0.50 → unverified security
    • Transport: pass → fail security
    • Schema quality: 100 → unverified functional
    • Capabilities: pass → unverified functional
    • Tool coverage: 100 → unverified functional
Diagnostics

Diagnostic detail from the automated scan of this channel: what the scanner observed at each step, so you can see exactly where a check passed or failed. It is informational only and never changes the trust score.

Captured 20 Sept 2026 · Probed https://agentreliability.dev/mcp?via=manifest

TLS valid

Negotiated TLS 1.3 with TLS_AES_128_GCM_SHA256 .

Subject Issuer Valid from Valid until Key Signature Serial
CN=agentreliability.dev CN=YR2,O=Let's Encrypt,C=US 9 Aug 2026 7 Nov 2026 RSA 2048 SHA256-RSA 611f8f3f24dada5e0dcbfbbd6345d4ef5a1
SANs: agentreliability.dev
CN=YR2,O=Let's Encrypt,C=US (CA) CN=Root YR,O=ISRG,C=US 3 Sept 2025 2 Sept 2028 RSA 2048 SHA256-RSA 4ebd24947e24d394802d84a52fd5b319
CN=Root YR,O=ISRG,C=US (CA) CN=ISRG Root X1,O=Internet Security Research Group,C=US 13 May 2026 2 Sept 2032 RSA 4096 SHA256-RSA f24b6d17f9d9ad7cb1c9fea78782699f

Background: What to check on a remote MCP endpoint →

DNSSEC insecure

Validation of agentreliability.dev. Not signed

Zone DS Keys Algorithms Outcome
. trust_anchor 20326, 38696 8, 8 Verified
dev. present 60074 8 Verified
agentreliability.dev. absent Unsigned (proven) parent-signed NSEC/NSEC3 proves an unsigned delegation
Authentication No authorisation required

The endpoint answered without asking for a token. Anyone who knows the URL can reach it.

Result No authorisation required
HTTP status 200
Header Value
strict-transport-security max-age=63072000

Background: How OAuth 2.1 works in the 2026 MCP spec →

Transports 2 probes
Transport URL Outcome Status Location
streamable-http https://agentreliability.dev/mcp?via=manifest Verified 200
http (plaintext) http://agentreliability.dev/mcp?via=manifest HTTPS enforced 308 https://agentreliability.dev/mcp?via=manifest
MCP tools · 9 exposed · ~1,450 tokens

The tools this component advertises to a client, with an estimated token cost for each. Expand a tool to see its parameters and schema. The per-tool counts are indicative and are not scored directly; the schema's total context footprint is one signal in Schema Quality & AI Usability. A tool's description is untrusted text the model reads on every call, which is what makes this list a security surface and not just an inventory: how tool poisoning works →

Tool Tokens
answer ~113

Answer a question from the corpus, or refuse. Returns only the claims that bear on the question, each with the sources it cites and its editorial confidence. When the corpus cannot answer, answered is false and abstention_reason plus missing_topics say what was not covered — a refusal is a real result here, not an error. Use this when the user asked a question in words; use search when you want to see the candidates yourself.

NameTypeReqDescription
questionstringyesThe question to answer, in the words the user asked it.
NameTypeReqDescription
abstention_reasonstringWhy the corpus declined: empty_query, no_candidates, below_coverage, ambiguous_candidates or no_intent_match.
answeredbooleanyes
candidatesarrayyesNear misses, so a refusal is still a lead. Present whether or not the question was answered.
claimsarray
coveragenumberShare of the question's information the winning object accounts for, weighted by term rarity.
entityobject
marginnumberRelative gap between the best candidate and the runner-up. A small margin means the corpus cannot tell them apart.
match_confidencenumberHow well the answer fits the QUESTION — retrieval confidence, not editorial. Never confuse it with a claim's own confidence, which is how much the corpus stands behind the statement.
match_scorenumber
match_thresholdnumberyesThe coverage this corpus requires before it will answer at all.
matched_fieldsarray
matched_questionstringThe stored question this was matched to, when the answer came from one.
missing_topicsarrayyesMeaningful words in the question that appear nowhere in the winning object — the gap, named.

No examples provided.

compare ~168

Two to six knowledge objects side by side: their cards, every indexed attribute as a matrix (the same fields api/index.json publishes, null where an object does not say), the tags they share, the relations that run between them, the neighbours they have in common, and each one's claims with sources and confidence. Use this when the question is 'X vs Y', 'is X the same as Y' or 'how does X differ from Y' — search or get_topic first if you only have names, then pass the ids. An unknown id lands in `missing` with a near-miss suggestion and the rest are still compared.

NameTypeReqDescription
idsarrayyesTwo to six knowledge object ids, as returned by search, get_topic or get_related, in the order you want the columns.
NameTypeReqDescription
claimsobjectyesEvery compared object's claims, keyed by object id.
facetsarrayyes
foundbooleanyesTrue only when every id resolved.
missingarrayyesThe ids that resolved to nothing, in the order asked.
objectsarrayyes
recoveryobject
relations_betweenarrayyes
shared_neighboursarrayyes
shared_tagsarrayyes

No examples provided.

get_entity ~93

Fetch one knowledge object by id, with its claims and the sources each claim cites. Use this once search, answer or get_topic has given you an id. An unknown id is not a dead end: the answer names near-miss ids you can retry with.

NameTypeReqDescription
idstringyesThe knowledge object's id, as returned by search, answer, get_topic or get_related — the last segment of its canonical URL.
NameTypeReqDescription
entityobject
foundbooleanyes
recoveryobject

No examples provided.

get_latest ~84

Most recently verified knowledge objects (freshness signal). Use this to judge how current the corpus is, or to see what changed since you last read it. It ranks by verification date and ignores your topic entirely — use search or get_topic when you want objects that are relevant rather than recent.

NameTypeReqDescription
limitintegerHow many recently verified objects to return, newest verification first.
NameTypeReqDescription
resultsarrayyes
totalintegeryes

No examples provided.

get_overview ~46

Corpus overview: what this instance knows, counts by type, published tags, freshness. Use this first when you land here and do not yet know whether this corpus can answer your question.

Input schema present but exposes no named parameters.

NameTypeReqDescription
by_typeobjectyes
descriptionstringyes
instancestringyes
newest_verificationstringyes
oldest_verificationstringyes
tagsarrayyes
total_mediaintegeryes
total_objectsintegeryes

No examples provided.

get_related ~185

Graph neighbours of an object: outgoing and incoming relations, each with its relation type. PAGED: 25 relations by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. One cursor walks both directions, outgoing first; its absence means you have the last page. Use this after get_entity to widen an answer with adjacent objects. It walks one hop from an id you already have — use search when you have a question and no starting object.

NameTypeReqDescription
cursorstringContinue from a previous call: pass the next_cursor it returned. Opaque; do not construct one.
idstringyesThe knowledge object to walk out from, by id.
limitintegerHow many relations to return, across both directions. Defaults to 25.
NameTypeReqDescription
foundbooleanyes
incomingarray
next_cursorstringPass to the next call to continue. ABSENT means this was the last page.
outgoingarray
recoveryobject
returnedinteger
totalintegerHow many relations this object has in both directions, before paging.

No examples provided.

get_sources ~290

The instance's source registry — each entry with its evidence tier, reliability and access date. PAGED: 25 entries by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. Read next_cursor and call again to continue; its absence means you have the last page. Filter by object_id, tier, host or accessed_since to avoid paging through a registry you do not need. Use this when you need the registry entry behind a citation, or a sample of the whole registry to judge the corpus before trusting it; get_entity already tells you which sources a claim cites.

NameTypeReqDescription
accessed_sincestringOnly sources accessed on or after this ISO date (YYYY-MM-DD).
cursorstringContinue from a previous call: pass the next_cursor it returned. Opaque; do not construct one.
hoststringOnly sources whose URL is served by this host, compared without a leading www. A source with no URL never matches.
limitintegerHow many entries to return. Defaults to 25.
object_idstringRestrict the answer to the sources cited by this knowledge object. Omit it to page the whole registry.
tierstringOnly sources of this evidence tier, spelled exactly as get_sources reports it.
NameTypeReqDescription
foundbooleanyes
next_cursorstringPass to the next call to continue. ABSENT means this was the last page.
recoveryobject
returnedintegeryes
sourcesarrayyes
totalintegeryesHow many sources matched the filters, before paging.

No examples provided.

get_topic ~215

List the knowledge objects carrying a tag (topics are content-backed tags). PAGED: 25 objects by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. Read next_cursor and call again to continue, and its absence means you have the last page. Use this to browse a known topic; use search when you have a question rather than a tag, and get_overview to see which tags exist. An unknown tag comes back with the topics that do exist, so a miss still moves you forward.

NameTypeReqDescription
cursorstringContinue from a previous call: pass the next_cursor it returned. Opaque; do not construct one.
limitintegerHow many objects to return. Defaults to 25.
tagstringyesThe topic to list, spelled exactly as get_overview publishes it. Every published topic has objects under it, so an empty answer means the topic does not exist.
NameTypeReqDescription
next_cursorstringPass to the next call to continue. ABSENT means this was the last page.
recoveryobject
resultsarrayyes
returnedintegeryes
tagstringyes
totalintegeryesHow many objects carry this tag, before paging.

No examples provided.

search ~256

Full-text search over the knowledge graph. Matching ignores accents and apostrophes, so query in the user's own words; every hit carries the fields it matched and a score. BM25 relevance: each query term is weighted by how RARE it is in this corpus and by where it hits (name 3, tags 2, questions 2, body 1). A hit must also cover a minimum share of the question's information, measured in the same rarity weights — matching only common words does not qualify. Centrality (how many objects point at this one) breaks TIES ONLY and is never part of the score, so it cannot make an irrelevant object rank. Two hits with the same matched_fields can still differ: the score is rarity-weighted, so matching a rare term is worth more than matching a common one. Use this whenever you have a question rather than an id, then follow up with get_entity.

NameTypeReqDescription
limitintegerHow many ranked hits to return, best first.
querystringyesWhat to look for, in the user's own words. Matched against titles, questions, claim text and tags; accents and apostrophes are ignored, so 'jose' finds 'José'.
NameTypeReqDescription
resultsarrayyes
totalintegeryes

No examples provided.

Common questions

What is the Agent Reliability MCP server?

Agent Reliability is an MCP server listed in the public MCP registry as dev.agentreliability/agent-reliability. Testing, benchmarking and auditing autonomous AI agents, methods, harnesses, evidence. This page covers its hosted endpoint (https://agentreliability.dev/mcp?via=manifest).

Is the Agent Reliability MCP server safe to use?

Agent Reliability scores 89 out of 100 on VerifyMCP. That is a record of what we were able to check automatically, not an endorsement. The category breakdown on this page shows every signal behind the number, including the ones we could not confirm.

What tools does the Agent Reliability MCP server expose?

Agent Reliability exposes 9 tools: search, get_entity, get_topic, answer, get_sources, and 4 more. Their descriptions and schemas cost roughly 1,450 tokens of context every time the server is loaded.

Does the Agent Reliability MCP server require authentication?

No. We connected to Agent Reliability without credentials and it answered, so anything it exposes is reachable by anyone who knows the address.

Is the Agent Reliability MCP server still maintained?

Agent Reliability is still listed as active in the MCP registry. We last reached this channel on 20 September 2026. Those dates come from our own scans of the registry and the channel itself, not from anything the publisher announced.