Scrape-LE
NPM · SCRAPE-LE-MCP
Analyse robots.txt content and report whether a path may be crawled.
Available components
Last scanned (22 hours ago)
Scores higher than 96% of npm servers
Category Web Scraping
How this component scores in each security and reliability category. Every signal is checked automatically from public evidence about the published package, including repeated runs of it in an isolated sandbox, and we only credit what we can confirm. How we score → Why this is hard to score →
Supply Chain Security100
- No malware found by supply-chain analysis.Pass
- No known CVEs affecting this package version or its production dependencies.Pass
- No install/post-install scripts declared.Pass
- No production dependencies, so there is no dependency health to assess. View diagnostics → Pass
Provenance & Transparency97
- Source repository is publicly reachable at the declared URL. View diagnostics → Pass
- Cryptographically verified build provenance (signed, bound to nolindnaidoo/scrape-le). View diagnostics → Pass
- Clear OSI-approved license (MIT).Pass
- Actively maintained (last published 24 days ago).Pass
- Disclosure check failed: no security disclosure policy was found in the source repository. See how to fix → Fail
Schema Quality & AI Usability77
- AI-judged instruction clarity (excellent).Pass
- Context-footprint check failed: tool/resource definitions use about 221 tokens (~221/item across 1 items; 1 tools + 0 resources), over budget; trim descriptions and params. See how to fix → Fail
- Usage-examples check failed: none of the tools include examples. See how to fix → Fail
Stability & Change Management100
- No destabilizing schema changes in the last 30 days.Pass
Tool Coverage100
- 100% of tools have a non-trivial description (not blank, and not just the tool's name).Pass
- 100% of tool parameters carry a description.Pass
Tool Safety100
- No prompt-injection markers were found in the server instructions, tool names or descriptions we captured.Pass
- We read all 1 captured tool definition(s), and no name or description among them implies an irreversible operation.Pass
- An AI judge read all 1 captured unit(s) of tool text and found none that tries to manipulate the model reading it.Pass
Capabilities60
- Spec-recency check failed: implements MCP spec 2025-06-18; the latest is 2026-07-28. See how to fix → Fail
Checks we ran (16)
- Malware scan
- Known CVEs
- Install scripts
- Dependency health
- Source repository
- Provenance
- License
- Maintenance
- Security disclosure
- Schema quality
- Stability
- Tool coverage
- Injection markers
- Destructive annotations
- Judged manipulation
- MCP protocol
Does not apply to this package (2)
- Endpoint SecurityScored on hosted endpoints only. A package has no live endpoint of its own for us to probe.
- Transport & ReachabilityScored on hosted endpoints only. A package has no live endpoint of its own for us to probe.
The score does not measure everything. What the score does not measure →
Every change we have recorded for this component, newest first. Security-relevant changes are always shown. ▲ marks a change for the better, ▼ a change for the worse; unmarked changes are neutral.
- 20 Nov 26 +1
- Stability: 0.97 → pass security
- 19 Nov 26 −1
- Stability: pass → 0.97 functional
- 13 Nov 26 +1
- Stability: 0.97 → pass security
- 11 Nov 26 +1
- Package version: 2.4.0 → 2.6.0 functional
- 9 Nov 26 +1
No change was recorded against any check on this day. Stability & Change Management went from 83 to 87. That category is still filling its 30-day observation window: 25 days of observed history at the previous scan, 26 at this one. The score rises as the window fills, whether or not the server changes.
- 8 Nov 26 −3
- Stability: pass → 0.83 functional
- 30 Oct 26 +1
- Stability: 0.97 → pass security
- 29 Oct 26 −1
- Stability: pass → 0.97 functional
Diagnostic detail from the automated scan of this channel: what the scanner observed at each step, so you can see exactly where a check passed or failed. It is informational only and never changes the trust score.
Captured 21 Nov 2026 · Analysed npm/scrape-le-mcp@2.6.0
Provenance Verified
A signed build attestation was found and verified, binding this exact artifact to the source repository it claims to come from.
| Result | Verified |
|---|---|
| Ecosystem | npm |
| Reason | Verified |
| Discovered via | Registry attestation endpoint |
| Source repo | nolindnaidoo/scrape-le |
| Certificate issuer | https://token.actions.githubusercontent.com |
| Certificate SAN | https://github.com/nolindnaidoo/scrape-le/.github/workflows/release.yml@refs/tags/v2.6.0 |
| Rekor log index | 3521778531 |
| Predicate type | SLSA build provenance https://slsa.dev/provenance/v1 |
| Subject digest | sha512:2f212ca1f5f5f1d8dd672215826a6d00f42f713640a69b1fb223da5628614c2ec567bd8e3512dc6b0c7ffa4a2a3ab0862ab5107a2007dfcc564b34b2a |
Background: How many MCP packages publish verified provenance →
Dependencies 0 packages
| Packages resolved | 0 |
|---|---|
| Tree resolution | Complete |
Background: SBOMs and build attestations, explained →
The tools this component advertises to a client, with an estimated token cost for each. Expand a tool to see its parameters and schema. The per-tool counts are indicative and are not scored directly; the schema's total context footprint is one signal in Schema Quality & AI Usability. A tool's description is untrusted text the model reads on every call, which is what makes this list a security surface and not just an inventory: how tool poisoning works →
analyze_robots_txt ~221
Given the contents of a robots.txt file and a path, report whether the rules permit crawling it — the group naming `agent` when one does, otherwise the generic (User-agent: *) rules, and `agent` in the answer says which — along with the crawl delay, the disallowed patterns and any sitemaps. Takes the file contents directly and makes no network request of its own — fetch robots.txt with your own HTTP tool and pass what it returned.
| Name | Type | Req | Description |
|---|---|---|---|
| agent | string | – | The crawler to evaluate as, e.g. "Googlebot" or "MyBot/1.0"; matched on its product token, case-insensitively. Omitted, the generic rules answer. |
| content | string | yes | The contents of the robots.txt file. |
| maxResults | integer | – | Cap on returned disallowed paths (default 500). meta.truncated reports whether any were dropped. |
| path | string | yes | The path to check, e.g. "/admin". A full URL is accepted and reduced to its path. |
No output schema declared.
No examples provided.
How do I install the Scrape-LE MCP server?
Scrape-LE runs locally as an npm package, launched with npx -y scrape-le-mcp. Ready-made configuration for Claude, Cursor, VS Code, Codex and 5 more is on this page, copied from each client's own documentation.
npm · scrape-le-mcp
claude mcp add nolindnaidoo-scrape-le -- npx -y scrape-le-mcp
What is the Scrape-LE MCP server?
Scrape-LE is an MCP server listed in the public MCP registry as io.github.nolindnaidoo/scrape-le. Analyse robots.txt content and report whether a path may be crawled. This page covers its npm package (scrape-le-mcp).
Is the Scrape-LE MCP server safe to use?
Scrape-LE scores 94 out of 100 on VerifyMCP. We found no known CVEs affecting it as of 21 November 2026. It declares no install or post-install scripts. Its build provenance is signed and verified. That is a record of what we were able to check automatically, not an endorsement. The category breakdown on this page shows every signal behind the number, including the ones we could not confirm.
What tools does the Scrape-LE MCP server expose?
Scrape-LE exposes 1 tool: analyze_robots_txt. Their descriptions and schemas cost roughly 221 tokens of context every time the server is loaded.
Is the Scrape-LE MCP server still maintained?
Scrape-LE is still listed as active in the MCP registry. We last reached this channel on 21 November 2026. Those dates come from our own scans of the registry and the channel itself, not from anything the publisher announced.
What licence is the Scrape-LE MCP server under?
Scrape-LE declares the MIT licence, which is OSI-approved. That covers the source only, and says nothing about the cost of any service it calls.
What did VerifyMCP test on the Scrape-LE MCP server?
VerifyMCP ran 16 checks on Scrape-LE, covering Malware scan, Known CVEs, Install scripts, Dependency health and 12 more. Endpoint Security and Transport & Reachability do not apply to an npm package, so they were not tested. The score does not measure everything, and the scoring documentation lists what it leaves out.