io.github.cyanheads/evals-mcp-server

io.github.cyanheads/evals-mcp-server

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

View repository →

Connect this server

Add this to your MCP client config — claude_desktop_config.json (Claude Desktop) or .cursor/mcp.json (Cursor).Suits: Claude Desktop · Cursor.

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server@0.1.6"
      ],
      "env": {
        "EVALS_DATA_DIR": "./evals-data",
        "EVALS_REQUIRE_CONFIRMATION": "false",
        "MCP_LOG_LEVEL": "info"
      }
    }
  }
}
Environment variables
  • EVALS_DATA_DIRRoot folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it.
  • EVALS_REQUIRE_CONFIRMATIONWhen 'true', evals_submit_draft requests human confirmation before finalizing.
  • MCP_LOG_LEVELSets the minimum log level for output (e.g., 'debug', 'info', 'warn').

A starting point — check the repository for exact arguments and setup. Restart your client after editing the config.

Category
Developer Tools
Version
0.1.6
Registry
active
Published
10/13/2026

More Developer Tools servers

Browse all Developer Tools →

io.github.cyanheads/exchange-rates-mcp-server

cyanheads

Convert currencies, get FX rates, and query historical Frankfurter v1 exchange rate data.

Developer ToolsAdded 1 week ago

io.github.cyanheads/faa-aircraft-registry-mcp-server

cyanheads

Offline, keyless lookup of the US civil aircraft registry — decode N-numbers, search records.

Developer ToolsAdded 3 weeks ago

io.github.cyanheads/faa-airmen-registry-mcp-server

cyanheads

Search FAA airmen certificates, ratings, and informational medical records.

Developer ToolsAdded 1 week ago

faa-traffic-delays-mcp-server

cyanheads

Track FAA ground stops, delay programs, airport delays, the operations plan, and ATCSCC advisories.

Developer ToolsAdded 6 days ago

io.github.cyanheads/faostat-mcp-server

cyanheads

UN FAOSTAT global food & agriculture statistics over a local SQLite mirror, via MCP.

Developer ToolsAdded 1 week ago

io.github.cyanheads/fbi-crime-mcp-server

cyanheads

FBI Crime Data Explorer — offense rates, hate crime, arrests, NIBRS, LEOKA stats, agency search.

Developer ToolsAdded 1 week ago

Add the badge to your site

Show visitors that io.github.cyanheads/evals-mcp-server is listed here — it’s also the link we check for a free listing.

io.github.cyanheads/evals-mcp-server — listed on Serverdex

HTML — for your website

<a href="https://serverdex.io/server/io-github-cyanheads-evals-mcp-server?utm_source=badge"><img src="https://serverdex.io/brand/badge.svg" alt="io.github.cyanheads/evals-mcp-server — listed on Serverdex" width="123" height="40" loading="lazy"></a>

Recommended. A dofollow link from your own domain is the one that counts for search engines, and it's the link we check for a free listing.

Markdown — for your README

[![io.github.cyanheads/evals-mcp-server — listed on Serverdex](https://serverdex.io/brand/badge.svg)](https://serverdex.io/server/io-github-cyanheads-evals-mcp-server?utm_source=badge)

Nice for visibility, but GitHub marks README links nofollow, so it doesn't pass authority. Use the HTML badge on your site as well.