io.github.jmshinhwa/robots-txt-ai-crawler-audit

io.github.jmshinhwa/robots-txt-ai-crawler-audit

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

View repository →

Connect this server

Add this to your MCP client config — claude_desktop_config.json (Claude Desktop) or .cursor/mcp.json (Cursor).Suits: Claude Desktop · Cursor.

{
  "mcpServers": {
    "robots-txt-ai-crawler-audit": {
      "command": "npx",
      "args": [
        "-y",
        "@readystack/robots-txt-ai-crawler-audit@0.1.3"
      ]
    }
  }
}

A starting point — check the repository for exact arguments and setup. Restart your client after editing the config.

Category
Developer Tools
Version
0.1.3
Registry
active
Published
9/19/2026

More Developer Tools servers

Browse all Developer Tools →

io.github.jmshinhwa/romu-hozon-kikan-lint-jp

jmshinhwa

法定帳簿の保存期間を文書保存期間表で検査 — 労基法109条・安衛則51条・石綿則41条・雇用保険法施行規則143条・健保則34条（20 rules）

Developer ToolsAdded 1 month ago

io.github.jmshinhwa/runtime-eol-deploy-block-audit

jmshinhwa

Finds the end-of-life runtimes an AI assistant still writes for you — node:20, python3.9, ubuntu-22

Developer ToolsAdded 1 month ago

io.github.jmshinhwa/saft-pt-atcud-lint

jmshinhwa

14 verificações ao XML SAF-T (PT) antes da entrega à AT: versão 1.04_01, ATCUD, dados do QR code, ha

Developer ToolsAdded 1 month ago

io.github.jmshinhwa/security-headers-csp-lint

jmshinhwa

Reads security headers and CSP line by line in your config file and names the lines that silently do

Developer ToolsAdded 1 month ago

io.github.jmshinhwa/security-txt-cra-lint

jmshinhwa

13 rules that decide whether a vulnerability report ever reaches you

Developer ToolsAdded 1 month ago

io.github.jmshinhwa/sepa-pain001-reject-lint

jmshinhwa

Find the lines your bank will refuse before you send the batch

Developer ToolsAdded 1 month ago

Add the badge to your site

Show visitors that io.github.jmshinhwa/robots-txt-ai-crawler-audit is listed here — it’s also the link we check for a free listing.

io.github.jmshinhwa/robots-txt-ai-crawler-audit — listed on Serverdex

HTML — for your website

<a href="https://serverdex.io/server/io-github-jmshinhwa-robots-txt-ai-crawler-audit?utm_source=badge"><img src="https://serverdex.io/brand/badge.svg" alt="io.github.jmshinhwa/robots-txt-ai-crawler-audit — listed on Serverdex" width="123" height="40" loading="lazy"></a>

Recommended. A dofollow link from your own domain is the one that counts for search engines, and it's the link we check for a free listing.

Markdown — for your README

[![io.github.jmshinhwa/robots-txt-ai-crawler-audit — listed on Serverdex](https://serverdex.io/brand/badge.svg)](https://serverdex.io/server/io-github-jmshinhwa-robots-txt-ai-crawler-audit?utm_source=badge)

Nice for visibility, but GitHub marks README links nofollow, so it doesn't pass authority. Use the HTML badge on your site as well.