# Scrape-LE (npm · scrape-le-mcp)

Analyse robots.txt content and report whether a path may be crawled.

- Trust score: 84/100 (high trust)
- Change this week: 0
- Registry status: active
- Liveness: live
- Owner verified: no
- Last scored: 2026-09-22

## Components

- npm · `scrape-le-mcp`: 84/100 (this document), [markdown](https://verifymcp.io/servers/nolindnaidoo-scrape-le/scrape-le-mcp.md), [page](https://verifymcp.io/servers/nolindnaidoo-scrape-le/scrape-le-mcp)

## Channel facts

- Registry: `npm`
- Package: `scrape-le-mcp`
- Version: `2.2.5`
- Transport: `stdio`

## Trust breakdown

How this component scores in each security and reliability category. Every signal is checked automatically from public evidence about the published package, including repeated runs of it in an isolated sandbox, and we only credit what we can confirm. Scores are 0–100 per category. Scoring method: https://verifymcp.io/docs/scoring (what has changed: https://verifymcp.io/docs/scoring/changelog)

Scored 2026-09-22.

- **Supply Chain Security**: 100/100
  - No malware found by supply-chain analysis.
  - No known CVEs affecting this package version or its production dependencies.
  - No install/post-install scripts declared.
  - No production dependencies, so there is no dependency health to assess.
- **Provenance & Transparency**: 45/100
  - Source repository is publicly reachable at the declared URL.
  - Provenance check failed: no build-provenance attestation is published.
  - Clear OSI-approved license (MIT).
  - Actively maintained (last published 38 days ago).
  - Disclosure check failed: no security disclosure policy was found in the source repository.
- **Schema Quality & AI Usability**: 86/100
  - AI-judged instruction clarity (excellent).
  - Tool/resource definitions use about 149 tokens (~149/item across 1 items; 1 tools + 0 resources), lean.
  - Usage-examples check failed: none of the tools include examples.
- **Stability & Change Management**: 83/100
  - Stability observed for 25 of 30 days with no destabilising changes; credit accrues until the full window elapses.
- **Tool Coverage**: 100/100
  - 100% of tools have a non-trivial description (not blank, and not just the tool's name).
  - 100% of tool parameters carry a description.
- **Tool Safety**: 100/100
  - No prompt-injection markers were found in the server instructions, tool names or descriptions we captured.
  - We read all 1 captured tool definition(s), and no name or description among them implies an irreversible operation.
  - An AI judge read all 1 captured unit(s) of tool text and found none that tries to manipulate the model reading it.
- **Capabilities**: 100/100
  - Implements a supported MCP spec version (2025-11-25); the latest is 2026-07-28.

## Install

### How do I install the Scrape-LE MCP server?

Scrape-LE runs locally as an npm package, launched with npx -y scrape-le-mcp. Ready-made configuration for Claude, Cursor, VS Code, Codex and 5 more is on this page, copied from each client's own documentation.

### Claude

```bash
claude mcp add nolindnaidoo-scrape-le -- npx -y scrape-le-mcp
```

### Cursor

```json
{
  "mcpServers": {
    "nolindnaidoo-scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}
```

### VS Code

```json
{
  "servers": {
    "nolindnaidoo-scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}
```

### Codex

```bash
codex mcp add nolindnaidoo-scrape-le -- npx -y scrape-le-mcp
```

### opencode

```json
{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "nolindnaidoo-scrape-le": {
      "type": "local",
      "command": [
        "npx",
        "-y",
        "scrape-le-mcp"
      ],
      "enabled": true
    }
  }
}
```

### OpenClaw

```bash
openclaw mcp add nolindnaidoo-scrape-le --command npx --arg -y --arg scrape-le-mcp
```

### Hermes

```yaml
mcp_servers:
  nolindnaidoo-scrape-le:
    command: "npx"
    args: ["-y", "scrape-le-mcp"]
```

### Netclaw

```json
{
  "McpServers": {
    "nolindnaidoo-scrape-le": {
      "Transport": "stdio",
      "Command": "npx",
      "Arguments": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}
```

### Vellum

```bash
assistant mcp add nolindnaidoo-scrape-le -t stdio -c npx -a -y scrape-le-mcp
```

### Other

```json
{
  "mcpServers": {
    "nolindnaidoo-scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}
```

## Changelog

Every change recorded for this component, newest first. Days that predate change tracking, or that we cannot explain, say so: "we were watching and nothing happened" and "we were not watching" are different claims.

### 2026-09-21 (score 84, −2)

- [functional] Stability: pass → 0.80
- [functional] Package version: 2.2.4 → 2.2.5

### 2026-09-20 (score 86, 0)

- [security] Stability: 0.97 → pass

### 2026-09-18 (score 86, +1)

No change was recorded against any check on this day. Stability & Change Management went from 90 to 93. That category is still filling its 30-day observation window: 27 days of observed history at the previous scan, 28 at this one. The score rises as the window fills, whether or not the server changes.

### 2026-09-16 (score 85, +1)

No change was recorded against any check on this day. Stability & Change Management went from 83 to 87. That category is still filling its 30-day observation window: 25 days of observed history at the previous scan, 26 at this one. The score rises as the window fills, whether or not the server changes.

### 2026-09-14 (score 84, −2)

- [functional] Stability: pass → 0.80

### 2026-09-13 (score 86, 0)

- [security] Stability: 0.97 → pass

### 2026-09-11 (score 86, +1)

No change was recorded against any check on this day. Stability & Change Management went from 90 to 93. That category is still filling its 30-day observation window: 27 days of observed history at the previous scan, 28 at this one. The score rises as the window fills, whether or not the server changes.

### 2026-09-09 (score 85, +1)

No change was recorded against any check on this day. Stability & Change Management went from 83 to 87. That category is still filling its 30-day observation window: 25 days of observed history at the previous scan, 26 at this one. The score rises as the window fills, whether or not the server changes.

## MCP tools (1)

### `analyze_robots_txt` (~149 tokens)

Given the contents of a robots.txt file and a path, report whether the generic (User-agent: *) rules permit crawling it, along with the crawl delay, the disallowed patterns and any sitemaps. Takes the file contents directly and makes no network request of its own — fetch robots.txt with your own HTTP tool and pass what it returned.

Input parameters:

- `content` (string, required): The contents of the robots.txt file.
- `maxResults` (integer): Cap on returned disallowed paths (default 500). meta.truncated reports whether any were dropped.
- `path` (string, required): The path to check, e.g. "/admin". A full URL is accepted and reduced to its path.

## Diagnostics

Captured diagnostic sections: Provenance, Dependencies. The full working is on the page: https://verifymcp.io/servers/nolindnaidoo-scrape-le/scrape-le-mcp#diagnostics

## Score history

- 2026-09-22: 84
- 2026-09-21: 84
- 2026-09-20: 86
- 2026-09-19: 86
- 2026-09-18: 86
- 2026-09-17: 85
- 2026-09-16: 85
- 2026-09-15: 84
- 2026-09-14: 84
- 2026-09-13: 86
- 2026-09-12: 86
- 2026-09-11: 86
- 2026-09-10: 85
- 2026-09-09: 85
- 2026-09-08: 84
- 2026-09-07: 86
- 2026-09-06: 86
- 2026-09-05: 86
- 2026-09-04: 86
- 2026-09-03: 86
- 2026-09-02: 85
- 2026-09-01: 85
- 2026-08-31: 84
- 2026-08-30: 84
- 2026-08-29: 83
- 2026-08-28: 83
- 2026-08-27: 82
- 2026-08-26: 82
- 2026-08-25: 81
- 2026-08-24: 80

## Common questions

### What is the Scrape-LE MCP server?

Scrape-LE is an MCP server listed in the public MCP registry as io.github.nolindnaidoo/scrape-le. Analyse robots.txt content and report whether a path may be crawled. This page covers its npm package (scrape-le-mcp).

### Is the Scrape-LE MCP server safe to use?

Scrape-LE scores 84 out of 100 on VerifyMCP. We found no known CVEs affecting it as of 22 September 2026. It declares no install or post-install scripts. That is a record of what we were able to check automatically, not an endorsement. The category breakdown on this page shows every signal behind the number, including the ones we could not confirm.

### What tools does the Scrape-LE MCP server expose?

Scrape-LE exposes 1 tool: analyze_robots_txt. Their descriptions and schemas cost roughly 149 tokens of context every time the server is loaded.

### Is the Scrape-LE MCP server still maintained?

Scrape-LE is still listed as active in the MCP registry. We last reached this channel on 22 September 2026. Those dates come from our own scans of the registry and the channel itself, not from anything the publisher announced.

### What licence is the Scrape-LE MCP server under?

Scrape-LE declares the MIT licence, which is OSI-approved. That covers the source only, and says nothing about the cost of any service it calls.

## Links

- npm package: https://www.npmjs.com/package/scrape-le-mcp
- Socket report: https://socket.dev/npm/package/scrape-le-mcp
- Repository: https://github.com/nolindnaidoo/scrape-le
- Website: https://letools.dev/tools/scrape-le
- Changelog RSS feed: https://verifymcp.io/servers/nolindnaidoo-scrape-le/scrape-le-mcp.xml
- Changelog JSON feed: https://verifymcp.io/servers/nolindnaidoo-scrape-le/scrape-le-mcp.json
- HTML version of this page: https://verifymcp.io/servers/nolindnaidoo-scrape-le/scrape-le-mcp