Crawlerpeek

io.github.crawlerpeek/crawlerpeek

Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.

View repository →Homepage →

Connect this server

Add this to your MCP client config — claude_desktop_config.json (Claude Desktop) or .cursor/mcp.json (Cursor).Suits: Claude Desktop · Cursor.

{
  "mcpServers": {
    "crawlerpeek": {
      "command": "npx",
      "args": [
        "-y",
        "crawlerpeek@0.3.1"
      ]
    }
  }
}

A starting point — check the repository for exact arguments and setup. Restart your client after editing the config.

Category
Developer Tools
Version
0.3.1
Registry
active
Published
10/29/2026

More Developer Tools servers

Browse all Developer Tools →

HN Who is hiring

Crayz129

Search, read and compare Hacker News "Who is hiring?" job posts as typed data. Read-only.

Developer ToolsAdded 3 weeks ago

io.github.CrazymakER23/convergealpha

CrazymakER23

AI stock signal convergence � 13 sources, Bayesian scoring, verified outcomes.

Developer ToolsAdded 7 months ago

Createya — AI Image & Video Generation

Createya-ai

100+ AI models: FLUX, Sora, Veo, Kling, Runway, Suno. OAuth or Bearer. No VPN. RU billing.

Developer ToolsAdded 6 months ago

io.github.Creativestefan/mailbridge

Creativestefan

Connect your AI assistant to email — read, search, send, and organise via IMAP/SMTP.

Developer ToolsAdded 4 months ago

Scenet

creatoan

Write, check and render comic panels as SVG: a deterministic compiler, no image model.

Developer ToolsAdded 1 week ago

io.github.Creator-API/creator-api-mcp

Creator-API

Native OnlyFans and Fansly access as MCP tools. One CreatorAPI key.

Developer ToolsAdded 4 months ago

Add the badge to your site

Show visitors that Crawlerpeek is listed here — it’s also the link we check for a free listing.

Crawlerpeek — listed on Serverdex

HTML — for your website

<a href="https://serverdex.io/server/io-github-crawlerpeek-crawlerpeek?utm_source=badge"><img src="https://serverdex.io/brand/badge.svg" alt="Crawlerpeek — listed on Serverdex" width="123" height="40" loading="lazy"></a>

Recommended. A dofollow link from your own domain is the one that counts for search engines, and it's the link we check for a free listing.

Markdown — for your README

[![Crawlerpeek — listed on Serverdex](https://serverdex.io/brand/badge.svg)](https://serverdex.io/server/io-github-crawlerpeek-crawlerpeek?utm_source=badge)

Nice for visibility, but GitHub marks README links nofollow, so it doesn't pass authority. Use the HTML badge on your site as well.