Webcrawl Anything

io.github.brainfish-ai/webcrawl

Scrape, map, crawl, search and monitor the web. Runs locally with no API key, cites every source.

View repository →Homepage →

Connect this server

Add this to your MCP client config — claude_desktop_config.json (Claude Desktop) or .cursor/mcp.json (Cursor).Suits: Claude Desktop · Cursor.

{
  "mcpServers": {
    "webcrawl": {
      "command": "npx",
      "args": [
        "-y",
        "@webcrawl/mcp@1.4.4"
      ],
      "env": {
        "WEBCRAWL_API_KEY": "<your WEBCRAWL_API_KEY>"
      }
    }
  }
}
Environment variables
  • WEBCRAWL_API_KEYsecretOptional. Leave unset to run fully local. Set a webcrawl.app key to use the hosted cloud.

A starting point — check the repository for exact arguments and setup. Restart your client after editing the config.

Category
Search & Web
Version
1.4.4
Registry
active
Published
11/7/2026

Remotes

  • streamable-httphttps://webcrawl.app/mcp

More Search & Web servers

Browse all Search & Web →

io.github.carrasquelalex1/webscrape-mcp

carrasquelalex1

Fetch any URL and get clean Markdown. Web scraping for AI agents.

Search & WebAdded 5 months ago

Ransack

chancewalker165-dot

Web search & fetch MCP for AI agents: 12 engines, one key, flat $15/mo at ransack.tools.

Search & WebAdded 1 month ago

io.github.CloudCorpRecords/crawlport

CloudCorpRecords

Firecrawl web data: scrape, map, search, crawl, extract, research, and llms.txt.

Search & WebAdded 1 week ago

io.github.CloudCorpRecords/knowdrift

CloudCorpRecords

Search Driflyte's topic-indexed crawled web knowledge: list topics and retrieve documents.

Search & WebAdded 6 days ago

io.github.CloudCorpRecords/privatesearch

CloudCorpRecords

Web search through DuckDuckGo and readable page fetching, no API key needed.

Search & WebAdded 1 week ago

io.github.CloudCorpRecords/researchsearch

CloudCorpRecords

Web search, page extraction, crawling, and site mapping powered by the Tavily API.

Search & WebAdded 1 week ago

Add the badge to your site

Show visitors that Webcrawl Anything is listed here — it’s also the link we check for a free listing.

Webcrawl Anything — listed on Serverdex

HTML — for your website

<a href="https://serverdex.io/server/io-github-brainfish-ai-webcrawl?utm_source=badge"><img src="https://serverdex.io/brand/badge.svg" alt="Webcrawl Anything — listed on Serverdex" width="123" height="40" loading="lazy"></a>

Recommended. A dofollow link from your own domain is the one that counts for search engines, and it's the link we check for a free listing.

Markdown — for your README

[![Webcrawl Anything — listed on Serverdex](https://serverdex.io/brand/badge.svg)](https://serverdex.io/server/io-github-brainfish-ai-webcrawl?utm_source=badge)

Nice for visibility, but GitHub marks README links nofollow, so it doesn't pass authority. Use the HTML badge on your site as well.