retriEVAL

io.github.hcarrillo001/retrieval-mcp

LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.

View repository →Homepage →

Connect this server

Add this to your MCP client config — claude_desktop_config.json (Claude Desktop) or .cursor/mcp.json (Cursor).Suits: Claude Desktop · Cursor.

{
  "mcpServers": {
    "retrieval-mcp": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "ghcr.io/hcarrillo001/retrieval-mcp:1.0.0"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<your ANTHROPIC_API_KEY>",
        "RETRIEVAL_JUDGE_BACKEND": "anthropic"
      }
    }
  }
}
Environment variables
  • ANTHROPIC_API_KEYsecretJudge model API key. Not needed if you set RETRIEVAL_JUDGE_BACKEND=ollama to run the judge locally.
  • RETRIEVAL_JUDGE_BACKENDWhich judge to score with: anthropic (default), openai, or ollama for a fully local judge.

A starting point — check the repository for exact arguments and setup. Restart your client after editing the config.

Category
Developer Tools
Version
1.0.0
Registry
active
Published
8/24/2026

More Developer Tools servers

Browse all Developer Tools →

Computer-Use Agents API

hcompai

Run and manage H Company's Computer-Use Agents from any MCP client.

Developer ToolsAdded 4 months ago

io.github.hcpapi/housecall-pro-mcp

hcpapi

Independent MCP server for the Housecall Pro API: jobs, estimates, invoices, price book, schedule.

Developer ToolsAdded 3 weeks ago

Omnis Venture Intelligence MCP

HCS412

Venture intelligence for autonomous agents with discovery, scoring, and workspace automation.

Developer ToolsAdded 8 months ago

io.github.headlessherm-creator/helpdesk-mender-mcp

headlessherm-creator

Local MCP server: Zendesk + Freshdesk + Help Scout write tools, one vocabulary.

Developer ToolsAdded 2 weeks ago

io.github.headlessherm-creator/hiring-mender-mcp

headlessherm-creator

Local MCP server: BambooHR + Greenhouse ATS write tools, one vocabulary.

Developer ToolsAdded 2 weeks ago

io.github.headlessherm-creator/json-mender-mcp

headlessherm-creator

Local MCP server: JSON repair, regex testing, JSON-Schema validation for AI agents.

Developer ToolsAdded 2 weeks ago

Add the badge to your site

Show visitors that retriEVAL is listed here — it’s also the link we check for a free listing.

retriEVAL — listed on Serverdex

HTML — for your website

<a href="https://serverdex.io/server/io-github-hcarrillo001-retrieval-mcp?utm_source=badge"><img src="https://serverdex.io/brand/badge.svg" alt="retriEVAL — listed on Serverdex" width="123" height="40" loading="lazy"></a>

Recommended. A dofollow link from your own domain is the one that counts for search engines, and it's the link we check for a free listing.

Markdown — for your README

[![retriEVAL — listed on Serverdex](https://serverdex.io/brand/badge.svg)](https://serverdex.io/server/io-github-hcarrillo001-retrieval-mcp?utm_source=badge)

Nice for visibility, but GitHub marks README links nofollow, so it doesn't pass authority. Use the HTML badge on your site as well.