io.github.77777R7/octocrawl
REMOTE · MCP.OCTOCRAWL.DEV · 3 COMPONENTS
Web scraper for agents: blocked, empty and wrong pages reported as such, with an Evidence Record.
Available components
Last scanned (2 hours ago)
Scores higher than 60% of remote servers
Reachable. Last reached 17 Oct 2026.
Category Web Scraping
How this component scores in each security and reliability category. Every signal is checked automatically against the live server, and we only credit what we can confirm. How we score → Why this is hard to score →
Endpoint Security74
- The endpoint's TLS certificate is valid, in date, and uses a strong key. View diagnostics → Pass
- No authorisation is required to call this server. Every tool declares its destructiveHint and none is destructive, so open access doesn't expose one. See how to fix → View diagnostics → Partial
- HTTPS is enforced; there's no plaintext access path. View diagnostics → Pass
- HSTS check failed: the Strict-Transport-Security header is absent. See how to fix → View diagnostics → Fail
- DNSSEC check failed: this domain isn't protected by DNSSEC. See how to fix → View diagnostics → Fail
Transport & Reachability100
- Verified streamable-http transport via a live MCP handshake. View diagnostics → Pass
Schema Quality & AI Usability52
- AI-judged instruction clarity (excellent).Pass
- Context-footprint check failed: tool/resource definitions use about 3754 tokens (~1877/item across 2 items; 2 tools + 0 resources), over budget; trim descriptions and params. See how to fix → Fail
- Usage-examples check failed: none of the tools include examples. See how to fix → Fail
Stability & Change Management20
- Stability observed for 6 of 30 days with no destabilising changes; credit accrues until the full window elapses.Partial
Tool Coverage99
- 100% of tools have a non-trivial description (not blank, and not just the tool's name).Pass
- 98% of tool parameters carry a description.Partial
- Structured output schemas are declared (50% of tools); any adoption earns full credit.Pass
Tool Safety100
- No prompt-injection markers were found in the server instructions, tool names or descriptions we captured.Pass
- We read all 2 captured tool definition(s), and no name or description among them implies an irreversible operation.Pass
- An AI judge read all 2 captured unit(s) of tool text and found none that tries to manipulate the model reading it.Pass
Capabilities100
- Implements a supported MCP spec version (2025-11-25); the latest is 2026-07-28.Pass
Every change we have recorded for this component, newest first. Security-relevant changes are always shown. ▲ marks a change for the better, ▼ a change for the worse; unmarked changes are neutral.
- 17 Oct 26 +1
No change was recorded against any check on this day. Stability & Change Management went from 17 to 20. That category is still filling its 30-day observation window: 5 days of observed history at the previous scan, 6 at this one. The score rises as the window fills, whether or not the server changes.
- 16 Oct 26 0
- Tool “scrape” rewrote its description, which is the text the model reads security
- Server version: 0.4.1 → 0.4.2 functional
- “scrape” reworded the description of “verify” cosmetic
- 15 Oct 26 +1
No change was recorded against any check on this day. Stability & Change Management went from 10 to 13. That category is still filling its 30-day observation window: 3 days of observed history at the previous scan, 4 at this one. The score rises as the window fills, whether or not the server changes.
- 13 Oct 26 +1
No change was recorded against any check on this day. Stability & Change Management went from 3 to 7. That category is still filling its 30-day observation window: 1 days of observed history at the previous scan, 2 at this one. The score rises as the window fills, whether or not the server changes.
- 12 Oct 26 0
- Stability: unverified → 0.03 ▲ functional
- “scrape” reworded the description of “robotsOverride” cosmetic
- 11 Oct 26 67
First indexed and scored.
Diagnostic detail from the automated scan of this channel: what the scanner observed at each step, so you can see exactly where a check passed or failed. It is informational only and never changes the trust score.
Captured 17 Oct 2026 · Probed https://mcp.octocrawl.dev/mcp
TLS valid
Negotiated TLS 1.3 with TLS_AES_128_GCM_SHA256 .
| Subject | Issuer | Valid from | Valid until | Key | Signature | Serial |
|---|---|---|---|---|---|---|
| CN=octocrawl.dev | CN=WE1,O=Google Trust Services,C=US | 6 Oct 2026 | 4 Jan 2027 | ECDSA 256 | ECDSA-SHA256 | 2a089d1047166c100e743e1c5a5fa318 |
| SANs: octocrawl.dev, mcp.octocrawl.dev, *.mcp.octocrawl.dev | ||||||
| CN=WE1,O=Google Trust Services,C=US (CA) | CN=GTS Root R4,O=Google Trust Services LLC,C=US | 13 Dec 2023 | 20 Feb 2029 | ECDSA 256 | ECDSA-SHA384 | 7ff31977972c224a76155d13b6d685e3 |
| CN=GTS Root R4,O=Google Trust Services LLC,C=US (CA) | CN=GlobalSign Root CA,OU=Root CA,O=GlobalSign nv-sa,C=BE | 15 Nov 2023 | 28 Jan 2028 | ECDSA 384 | SHA256-RSA | 7fe530bf331343bedd821610493d8a1b |
Background: What to check on a remote MCP endpoint →
DNSSEC insecure
Validation of mcp.octocrawl.dev. — Not signed
| Zone | DS | Keys | Algorithms | Outcome |
|---|---|---|---|---|
| . | trust_anchor | 20326, 38696 | 8, 8 | Verified |
| dev. | present | 60074 | 8 | Verified |
| octocrawl.dev. | absent | Unsigned (proven) parent-signed NSEC/NSEC3 proves an unsigned delegation |
Authentication No authorisation required
The endpoint answered without asking for a token. Anyone who knows the URL can reach it.
| Result | No authorisation required |
|---|---|
| HTTP status | 200 |
Background: How OAuth 2.1 works in the 2026 MCP spec →
Transports 2 probes
| Transport | URL | Outcome | Status | Location |
|---|---|---|---|---|
| streamable-http | https://mcp.octocrawl.dev/mcp | Verified | 200 | |
| http (plaintext) | http://mcp.octocrawl.dev/mcp | HTTPS enforced | 301 | https://mcp.octocrawl.dev/mcp |
The tools this component advertises to a client, with an estimated token cost for each. Expand a tool to see its parameters and schema. The per-tool counts are indicative and are not scored directly; the schema's total context footprint is one signal in Schema Quality & AI Usability. A tool's description is untrusted text the model reads on every call, which is what makes this list a security surface and not just an inventory: how tool poisoning works →
map ~871
List a site's URLs without fetching each page: the start URL, the links on its page (read on the http lane alone; no browser) and the entries of the sitemaps the site declares (robots.txt Sitemap: lines, else /sitemap.xml), inside one deadline. Every URL is in the crawl's scope (the start host and its www twin, the start URL's path subtree, assets left out, similar URLs folded) and allowed by its host's robots.txt unless ignoreRobotsTxt is set; what was left out is counted. A title is never fetched: the start page's own, an anchor's text or a sitemap's news title. At the deadline the answer is what was found, status partial (failed when nothing), stoppedBy timeout. Compact by default ({ id, status, stoppedBy, links: [{ url, title?, description?, robots? }], warning?, agentHints?, counts }; robots only on a link robots.txt keeps out, under ignoreRobotsTxt); debug=true returns the full map with each link's evidence (via, sitemapFile, lastmod, robots), the sources read and the refusals. One page body is read at most: a site without a sitemap maps only its start page's links; crawl reads further pages.
| Name | Type | Req | Description |
|---|---|---|---|
| crawlEntireDomain | boolean | – | Admit URLs anywhere on the start host, not only in the start URL's path subtree. Default false. |
| debug | boolean | – | Return the full map response instead of the compact one. |
| deduplicateSimilarURLs | boolean | – | Fold /a and /a/, / and /index.html, www and apex, http and https into one URL. Default true. |
| excludePaths | array | – | Pathname regexes that leave a URL out; they win over includePaths. |
| ignoreQueryParameters | boolean | – | Fold URLs that differ only in their query string into the first one seen, returned without its query; each merge is counted (refused.collapsed, with samples under debug). Default false. |
| ignoreRobotsTxt | boolean | – | Also return the URLs robots.txt disallows or whose robots.txt could not be read, each with that verdict (robots disallowed or unreachable), and read the start page and sitemaps past it. robots.txt is… |
| includePaths | array | – | Pathname regexes a URL must match (as on crawl). |
| includeSubdomains | boolean | – | Admit every host under the start URL's apex (the host with one leading www. removed; no public-suffix list). Default false. Each new host's robots.txt is read, for at most 20 hosts. |
| integration | string | – | Your own label for the integration or workflow this request belongs to (1 to 100 printable characters, no spaces). Stored in Octocrawl's records (the scrape record, the task status), never sent to th… |
| limit | integer | – | Links returned at most. Default 5000; a hosted server takes up to 5000. Reaching it is status completed with stoppedBy limit. |
| mode | string | – | The declared identity robots.txt, the page and the sitemaps are read under. authed is not offered: a map reads public sitemaps and one public page. |
| regexOnFullURL | boolean | – | Match includePaths and excludePaths against the canonical URL instead of its pathname. Default false. |
| search | string | – | Keep only the URLs in which every word (at most 10) appears, case-insensitively, in the decoded URL or its title. A filter, not a ranking: the order stays the discovery order, and limit counts the ma… |
| sitemap | string | – | include (default): the start page's links and the sitemaps. skip: no sitemap is read. only: no page is read; the links are the sitemap entries in their listed order (the start URL only when a sitemap… |
| timeout | integer | – | Milliseconds for the whole map. Default 60000; a hosted server takes up to 60000. |
| url | string | yes | http(s) URL of the start page |
| Name | Type | Req | Description |
|---|---|---|---|
| agentHints | array | – | – |
| counts | object | – | – |
| id | string | yes | The map's record id (GET /v1/maps/:id on the REST API). |
| links | array | yes | – |
| status | string | yes | – |
| stoppedBy | – | yes | – |
| warning | string | – | The warnings' messages, joined. |
No examples provided.
scrape ~2,883
Fetch one URL through the Octocrawl coverage ladder. Compact by default; set debug=true for the full audit. The result's warnings name what its content cannot vouch for: robots_overridden (robots.txt disallows the URL; a local server fetched it because you named it), or client_rendered_suspected when the HTTP page looks like a shell its scripts fill in and the browser rung found nothing better. Its agentHints, when present, say what to change next time (a login wall, a robots.txt rule, a gate, a wait).
| Name | Type | Req | Description |
|---|---|---|---|
| access | string | – | How the pages are reached, as three plain choices; ask the person which they want when it matters. standard: Octocrawl's own fetching and its local browser, nothing that costs a third party. enhanced… |
| actions | array | – | Steps the local browser runs on the page after it loads and before it is read, in order (Firecrawl's actions): wait {milliseconds | selector}, click {selector, all?}, write {text} (into the focused e… |
| allowlistedDomains | array | – | – |
| blockAds | boolean | – | Abort requests to a bundled list of ad-serving hosts on the browser lane and remove ad and cookie-banner elements before extraction. Default true; false keeps them. |
| debug | boolean | – | Include trace, ladderTrace, and full attempt audit. |
| excludeTags | array | – | CSS selectors removed, with everything inside them, from the main content, the whole page (onlyMainContent false) and an includeTags selection. The same selectors and limit as includeTags. |
| fastMode | boolean | – | http lane only, no browser escalation: a page that needs script execution returns the http lane's verdict (a shell is failed/empty_unverified, never rendered). Default false. |
| formats | array | – | What to return. html is the cleaned HTML the Markdown is written from (the main content, the whole page when onlyMainContent is false, or the includeTags selection). rawHtml is the page as received:… |
| handoff | – | – | On a server running on the person's machine: when Octocrawl is stopped at a captcha, a challenge or a login wall, open the page in the person's own Chrome (remote debugging on, they click Allow), wai… |
| headers | object | – | Extra request headers sent to the requested origin (the page, its same-origin hops and the files it loads from that origin) after Octocrawl's declared identity, and recorded in the trace: accept, acc… |
| includeLinks | boolean | – | Include outbound links. Defaults to false. |
| includeTags | array | – | CSS selectors naming the only elements to keep: the content is those elements in document order (a named navigation included), whatever onlyMainContent says. Nothing matching is an empty answer. Tag,… |
| integration | string | – | Your own label for the integration or workflow this request belongs to (1 to 100 printable characters, no spaces). Stored in Octocrawl's records (the scrape record, the task status), never sent to th… |
| lane | string | – | On a server running on the person's machine: read the page in the person's own Chrome instead of fetching it (lane my_browser, never cached). Chrome needs remote debugging on (chrome://inspect/#remot… |
| lockdown | boolean | – | Cache only: answer from a stored result and never fetch the page; one with none is failed with cache_miss. A crawl in lockdown needs sitemap "skip". |
| maxAge | integer | – | Reuse a stored result of this page fetched at most this many milliseconds ago with the same options, instead of fetching it. Default 0: nothing is reused, the page is fetched live. A reused result sa… |
| maxFileBytes | integer | – | Largest file (PDF, CSV, XLSX, ZIP, JSON, text) to download, in bytes, below the server's own cap (W2L_MAX_FILE_BYTES, default 50 MiB). A larger file is failed with body_too_large and not saved. |
| minAge | integer | – | Reuse only a stored result at least this many milliseconds old (at most maxAge; without maxAge, any age from this one on). |
| mobile | boolean | – | Fetch as a declared mobile Chrome identity (Android UA, mobile client hints, 412x915 viewport). Default false. |
| mode | string | – | authed reads the page with the login the person saved for its site (import_login), signed in as them: ask the person first, naming the site. Not with executeJavascript or a webhook: a script could re… |
| onlyMainContent | boolean | – | false returns the whole page (header, navigation and footer kept) instead of the main content. Default true. |
| removeBase64Images | boolean | – | Leave an image whose src is a data: URI out of the Markdown, keeping its alt text (default true, Firecrawl's default). false keeps it as , which contentTokens then counts. html and rawH… |
| robotsOverride | object | – | Your own reason for fetching this URL although its host robots.txt disallows it or could not be read. A local server fetches a URL you name anyway, recorded as user_named_url; with this field the rec… |
| skipTlsVerification | boolean | – | Local only: load a site with an invalid or self-signed certificate; recorded in the trace and a tls_unverified warning; refused in hosted mode. |
| storeInCache | boolean | – | Store this page's result for later reuse when it succeeds. Default true, except for a request with custom headers, which stores only with true (the stored trace keeps their values); mode authed never… |
| timeout | integer | – | Deadline in milliseconds for the whole scrape (per page for crawl and batch). When it fires the result is partial with the content so far, or failed/timeout. Default 300000. |
| url | string | yes | http(s) URL |
| verify | object | – | A task contract: the configured checks, judged after the fetch into the answer's verification (passed, failed with the checks that failed and why, or not_requested); status stays the fetch's. markdow… |
| waitFor | integer | – | Milliseconds the browser waits after load before capture. Starts at the browser rung and counts toward timeout. Default 0. |
No output schema declared.
No examples provided.
How do I install the io.github.77777R7/octocrawl MCP server?
io.github.77777R7/octocrawl is a hosted endpoint at https://mcp.octocrawl.dev/mcp, so there is nothing to install locally. Ready-made configuration for Claude, Cursor, VS Code, Codex and 5 more is on this page, copied from each client's own documentation.
remote · mcp.octocrawl.dev
claude mcp add --transport http 77777r7-octocrawl 'https://mcp.octocrawl.dev/mcp'
What is the io.github.77777R7/octocrawl MCP server?
io.github.77777R7/octocrawl is an MCP server listed in the public MCP registry as io.github.77777R7/octocrawl. Web scraper for agents: blocked, empty and wrong pages reported as such, with an Evidence Record. This page covers its hosted endpoint (https://mcp.octocrawl.dev/mcp).
Is the io.github.77777R7/octocrawl MCP server safe to use?
io.github.77777R7/octocrawl scores 70 out of 100 on VerifyMCP. That is a record of what we were able to check automatically, not an endorsement. The category breakdown on this page shows every signal behind the number, including the ones we could not confirm.
What tools does the io.github.77777R7/octocrawl MCP server expose?
io.github.77777R7/octocrawl exposes 2 tools: scrape, map. Their descriptions and schemas cost roughly 3,754 tokens of context every time the server is loaded.
Does the io.github.77777R7/octocrawl MCP server require authentication?
No. We connected to io.github.77777R7/octocrawl without credentials and it answered, so anything it exposes is reachable by anyone who knows the address.
Is the io.github.77777R7/octocrawl MCP server still maintained?
io.github.77777R7/octocrawl is still listed as active in the MCP registry. We last reached this channel on 17 October 2026. Those dates come from our own scans of the registry and the channel itself, not from anything the publisher announced.