Web Scraping MCP servers

Top 100 by trust score Trust score 0–100

• Agent Ready

  Scan any URL for AI agent readability — Vercel Spec, llmstxt.org, and agent-protocol manifests.

  remote · npm 95

• FetchV2

  Fetch and extract web pages, discover links, and read llms.txt documentation indexes.

  pypi 95

• Hydrafetch

  Turn any URL into clean Markdown and structured data. Scrape, crawl, search and extract.

  remote 94

• io.github.Octen-Team/octen-mcp

  URL to LLM-ready markdown — plus per-page category, page_structure, and query-driven highlights.

  npm 94

• ai.foura/mcp

  Reliable web access for AI agents: smart HTTP, rotating proxies, and full-browser rendering.

  remote · npm 93

• io.tooltrace/mcp-server

  Web tools for AI agents: scrape pages to Markdown, audit SEO, detect tech stacks, check sitemaps

  remote · npm 91

• io.github.15998194110/delta-witness

  Paid Capture and Guard tools for public-source observations before autonomous actions.

  npm 90

• AnyAPI

  Hundreds of scraping & data APIs through one key. USD pay-per-request, normalized schemas, failover.

  remote · npm · oci 90

• io.github.MarvinRey7879/framefetch

  Any social-video URL → transcript, metadata, frames, OCR, summary, search, Q&A. MCP server + x402.

  remote 90

• io.github.bamchi/scrapi

  Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.

  remote · npm 89

• Contrie

  Extract structured data from a web page, read it as markdown, verify values against the source.

  remote · npm 89

• io.github.crawlbrulee/mcp

  EU-native web scraping for AI agents. scrape pages, map sites, run background jobs, check usage.

  npm 89

• Crawler Log Triage

  {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key

  remote 89

• dompruner-mcp

  Strips layout noise via DOM AST; with a query, BM25 filters to relevant sections. No model or API.

  remote · npm 89

• AgentMart Procurement

  Procure, compare, quote, budget, and execute web extraction or scraping across providers for agents

  remote 89

• 1cent Web Intelligence for AI Agents

  SSRF-safe web intelligence: 4 outcomes, 43 paid x402 tools, 3 free tools and a URL preview.

  remote 89

• Machine Presence Inspector

  Read-only public website inspection: evidence-backed Machine Presence observations with uncertainty.

  remote 88

• URLpipe

  Read any page with its JavaScript run: Markdown, screenshots, metadata, console errors, Lighthouse.

  remote 88

• io.github.JessieJanie/skim402

  Clean markdown and structured web data. Free card API key; wallet/x402 pay-per-call optional.

  remote · npm 88

• One-Page Readiness Check — 10 Signals, Arabic or English

  Ten machine-readable signals on one public page: the top miss if any, and a receipt we re-verify.

  remote 87

• io.github.agentwares/agent-access-index

  Whether an AI agent may fetch a URL, on what terms, and at what price. Free, no key, no signup.

  remote 86

• HasData

  All HasData scraping tools in one MCP server: Google, TikTok, Instagram, maps, e-commerce and more.

  remote 86

• ReplyNodes

  Web MCP: scrape/crawl sites, web search, brand assets, app stores, YouTube, Reddit, Hacker News.

  remote 86

• com.santosautomation/site-audit

  Website intelligence audits for AI agents: free preview plus x402-paid Agent Readiness scoring

  remote 86

• Region Fetch

  Fetch any public URL as a visitor in a chosen country, with a signed receipt of its origin.

  npm 86

• Evercraft Web

  Read public web content with Evercraft; search and browser automation stay behind safety gates.

  remote 86

• Oxylabs

  Oxylabs MCP — Oxylabs Web Scraper API (oxylabs.io)

  remote 86

• io.github.FieldmodeLLC/scrapecheck

  Verify before your agent acts on data it paid for. Signed verdicts, checkable offline, via x402.

  remote 85

• Scrape-LE

  Analyse robots.txt content and report whether a path may be crawled.

  npm 85

• io.github.sharozdawa/robotstxt-ai

  Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

  npm 85

• HasData Web Scraping

  Fetch any public web page through managed proxies, with optional JS rendering and extraction rules.

  remote · npm · pypi 84

• Web Intel

  8 pay-per-call web intel tools over MCP. Free discovery, calls settle in USDC on Base (x402).

  remote 84

• Site MCP

  Turn any public website into an MCP server for agents to search, read and navigate.

  remote 84

• io.github.Furhworld/proxyclaw

  Residential proxy MCP server. 175M+ IPs in 195+ countries with anti-bot bypass.

  npm 84

• Stophy

  Web scraping API for AI agents.

  remote · npm 84

• RSS Keyword Monitor

  Search bounded RSS, Atom, and RDF feed matches by keyword or regex.

  remote 84

• com.mambabuilt/mcp-company-contact-details-extractor

  Find a company contact page and extract role emails, a phone number and a postal address.

  npm 83

• com.mcparmory/apify

  Build, deploy, and run web scraping and automation actors in the cloud

  oci · pypi 83

• io.github.mlawsonking/web-tools-mcp

  10 no-LLM web tools: URL to Markdown, metadata, JSON-LD, MX, scrape, RSS, DNS, RDAP, SSL, HTTP.

  npm 83

• io.github.mrslbt/rippr-mcp

  Rip YouTube transcripts to disk for AI agents, RAG pipelines, and LLM workflows.

  npm 83

• io.github.quantumproxies/quanticdata-mcp

  Live web access for agents: scrape, SERP search, crawl/map, 100+ collectors, datasets, proxies.

  remote · mcpb · npm 83

• io.github.Sanoy24/safe-fetch

  MCP server for fetching URLs, safe against SSRF, DNS rebinding, and redirect-to-internal attacks.

  npm 83

• io.github.ScrapeGraphAI/scrapegraph-mcp

  AI-powered web scraping and data extraction capabilities through ScrapeGraph API

  pypi 83

• io.github.yokingma/one-search-mcp

  Web search, URL discovery, scraping & extraction with agent-browser and search providers

  npm 83

• AgenticTotem Web Extractor

  AI web extraction: send URLs + a JSON Schema, get clean structured data. Pay-per-use via x402.

  remote 82

• GMaps Lead Finder

  Scrape Google Maps business leads, reviews, and photos via hosted Remote MCP.

  remote 82

• com.lyrenth/lyrenth-mcp

  Read any public web page as a clean AIDocument (Markdown + structure) through Lyrenth.

  npm 82

• com.mambabuilt/mcp-page-finder-extractor

  Find a named page type on a company's own website from its domain, in 11 languages.

  npm 82

• com.mambabuilt/mcp-team-page-people-extractor

  Extract the people a company publishes on its own team, leadership or about page.

  npm 82

• SnoopScan

  Web scraping for agents: scrape, crawl, map, search and extract pages as clean markdown or JSON.

  remote 82

• io.github.Darkchild88/x402-money-farm

  Pay-per-call web extraction: clean text, metadata, links, JSON-LD, change detection. USDC on Base.

  npm 82

• io.gmapsscraper/mcp

  Scrape Google Maps business data from any MCP client — names, phones, emails, websites, ratings.

  npm 82

• io.github.ofershap/scraper

  Web scraping MCP — extract clean markdown, links, and metadata from any URL.

  npm 82

• io.github.Rererr/amenbo

  Japanese-web-native MCP server for low-impact, token-efficient web collection

  npm 82

• PyreCrawl

  Web scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.

  pypi 82

• io.github.agenson-horrowitz/web-content-extractor

  Extract and process web content into clean, structured formats optimized for LLMs.

  npm 81

• com.mcparmory/agentql

  Query webpages and extract structured data using natural language

  oci · pypi 81

• Firecrawl MCP Server

  MCP server for Firecrawl — web search, scraping, and biomedical/arXiv paper search.

  remote · npm 81

• io.github.huangyunbin/soclip

  Turn TikTok, Instagram, X and Facebook URLs into video download links and metadata.

  npm 81

• io.oxylabs/oxylabs-mcp

  Fetch and process content from specified URLs & sources using the Oxylabs Web Scraper API.

  remote · pypi 81

• ScrapingBot

  Public web data for AI agents: scrape any page, plus Google, TikTok, Instagram and Amazon as JSON.

  remote 81

• io.github.rog0x/web

  Web scraping, search, monitoring, and HTML-to-markdown for AI agents

  npm 81

• io.github.ryudi84/web-scraper

  MCP server for web scraping: URLs, links, metadata, CSS extraction.

  npm 81

• veddata

  MCP server for AI agents: discover a web page's data sources and drive the page to reach them.

  pypi 81

• Fetch MCP Server

  HTTP fetch MCP server: SSRF protection, HTML-to-markdown, reader mode, metadata extraction

  npm 81

• Agent API Gateway

  Extract structured web data (product, article, company) for AI agents via Agent API Gateway

  npm 81

• io.github.Bristlecone2026/bristlecone-logic

  Micro-settled web content extraction and JSON schema validation utilities for AI agents via XRPL.

  pypi 80

• Caelario

  MCP server for Instagram, TikTok, YouTube, X and Facebook data extraction and automation.

  npm 80

• Parser Club

  Telegram/VK audience scraping, marketplaces, Russian government registers. Free open dataset.

  remote 80

• com.mcparmory/firecrawl

  Scrape, crawl, and extract structured data from websites at scale

  oci · pypi 80

• com.pulsemcp/pulse-fetch

  MCP server for fetching web resources with content extraction and anti-bot bypass.

  npm 80

• X1-BaaS Scraping API

  Stealth scraping API for AI agents. Clean Markdown from any URL. x402 crypto payments.

  remote 80

• io.github.damonwill78-a11y/clean-markdown

  Any URL to clean, LLM-ready Markdown for RAG. Strips ads, nav, and boilerplate.

  npm 80

• Scrapingdog

  Scrapingdog web-scraping & SERP APIs: web scrape, Google, Amazon, LinkedIn, YouTube, and more.

  npm 80

• Hubertino: Google Maps leads

  Scrape Google Maps business leads (phones, websites, emails, socials) with Hubertino.

  npm 80

• io.github.Jannis-E/x402-mcp-server

  Pay-per-call x402 tools on Base: web extract/render, burn-once secret vault, chart, GeoTIFF

  npm 80

• rasterly

  Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.

  npm 80

• WebhookTest.net

  Anonymous webhook capture, inspection, waiting, and response configuration for AI agents.

  remote 80

• io.github.Perufitlife/multi-scraper-mcp

  14 web scrapers as MCP tools: Reddit, Amazon, Google Maps, Yelp, YouTube, Indeed & more.

  npm 80

• AgentRead — bounded web context

  Free HTML parsing; static web context at 0.01 USDC via x402. Paid reads need a wallet adapter.

  remote 80

• com.scrapeunblocker/scrapeunblocker-mcp

  Fetch any web page's HTML or AI-parsed JSON, or run 100+ site plugins, via ScrapeUnblocker.

  npm 79

• agproxy

  Residential proxy traffic and raw fetch for agents, 190+ countries, sticky sessions. Pay per call.

  remote 79

• mdapi — HTML to Markdown for AI agents

  Web page or HTML to clean LLM-ready Markdown or JSON. x402 pay-per-call, $0.005, no API key.

  remote 79

• pro.adorellc/markfetch

  Any web page as clean Markdown for agents. Hosted, no install. Free tier; Pro adds JS rendering.

  remote 79

• rasterly

  Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.

  npm 79

• RoamProxy

  Fetch pages and get proxies via residential, datacenter and mobile IPs in 190+ countries.

  npm 79

• Zactonz

  Screenshots, page to Markdown, link previews, DNS, SSL, WHOIS, QR codes and more for AI agents.

  npm 79

• io.github.ZenRows/zenrows-mcp

  Zenrows MCP server — Fetch, Extract, Batch, and Browser Sessions for AI coding assistants

  remote · npm 79

• Data Quality Gate - deterministic post-scrape cleaner + verdict

  Post-scrape data cleaner, no LLM: repairs mojibake, HTML, invisible chars. Plus a verdict.

  remote 78

• ProxyCove

  Buy and manage residential, mobile and datacenter proxies in 170+ countries, prepaid per GB

  remote 78

• searxNcrawl

  Web search via SearXNG and/or You.com, plus clean Markdown crawling via Crawl4AI. Self-hosted.

  pypi 78

• read_url

  One public web page as clean markdown, with title, language and a SHA-256. Obeys robots.txt.

  remote 78

• Refinery MCP

  Clean raw HTML into LLM-ready text before agents spend tokens.

  npm 78

• Agentwatch

  Check if ChatGPT, Claude and Perplexity can reach, read and quote a website.

  remote 78

• io.github.meltingpixelsai/zero-core-tools

  Web scraping, code review, content gen, sentiment. Zero Core Tools.

  remote · npm 78

• io.github.mizukaizen/x402-tools-mcp

  melis x402 Tools — 22 pay-per-call APIs for AI agents. No accounts, no API keys. USDC on Base.

  npm 78

• io.github.MukundaKatta/html-to-markdown-mcp

  Convert HTML to Markdown or strip to plain text. For web-scraping agents.

  npm 78

• io.github.NovadaLabs/novada-mcp

  Search, extract, crawl, map, research, scrape 16 platforms, browser automation, proxy — one API key.

  remote · npm 78

• SocialCrawl

  One API for 65 platforms and 572 endpoints: social, commerce, retail, jobs, finance, web scraping.

  remote · npm 78

• io.github.vojtisprime11/web-fetcher

  Turns any web page into clean Markdown, page metadata and classified links for LLMs.

  npm 78