EvalForge Lite

io.github.thejaredchapman/evalforge-lite

Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.

View repository →Homepage →

Connect this server

Add this to your MCP client config — claude_desktop_config.json (Claude Desktop) or .cursor/mcp.json (Cursor).Suits: Claude Desktop · Cursor.

{
  "mcpServers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite"
      ],
      "env": {
        "OPENROUTER_API_KEY": "<your OPENROUTER_API_KEY>"
      }
    }
  }
}
Environment variables
  • OPENROUTER_API_KEYsecretOptional. OpenRouter API key held by the server so tool calls need no credentials for OpenRouter. If unset, pass creds in each tool call.

A starting point — check the repository for exact arguments and setup. Restart your client after editing the config.

Category
Developer Tools
Version
1.0.1
Registry
active
Published
10/1/2026

More Developer Tools servers

Browse all Developer Tools →

ops-brain

TheK3nsai

Self-hosted team bus for AI agents: cross-machine handoffs, check-in, and shared gotchas.

Developer ToolsAdded 2 weeks ago

io.github.thelabvenice/memdata

thelabvenice

Persistent memory for AI agents. Store context, retrieve it semantically.

Developer ToolsAdded 9 months ago

Options Data MCP

thelogicaldude

Options market structure data: gamma exposure, VRP, IV term structure, regime, and strikes

Developer ToolsAdded 1 month ago

A/B Test Sample Size Calculator MCP

theluckystrike

Exact A/B test sample size, duration, z-test, chi-square, Fisher-Freeman-Halton and peeking risk.

Developer ToolsAdded 1 week ago

ACA Premium Tax Credit Calculator

theluckystrike

2026 ACA premium tax credit: expired enhanced subsidy, 400% FPL cliff, FPL, APTC repayment rules.

Developer ToolsAdded 1 week ago

Address to Census Tract MCP

theluckystrike

US address to census tract, block group, county FIPS and districts, from the Census Geocoder.

Developer ToolsAdded 5 days ago

Add the badge to your site

Show visitors that EvalForge Lite is listed here — it’s also the link we check for a free listing.

EvalForge Lite — listed on Serverdex

HTML — for your website

<a href="https://serverdex.io/server/io-github-thejaredchapman-evalforge-lite?utm_source=badge"><img src="https://serverdex.io/brand/badge.svg" alt="EvalForge Lite — listed on Serverdex" width="123" height="40" loading="lazy"></a>

Recommended. A dofollow link from your own domain is the one that counts for search engines, and it's the link we check for a free listing.

Markdown — for your README

[![EvalForge Lite — listed on Serverdex](https://serverdex.io/brand/badge.svg)](https://serverdex.io/server/io-github-thejaredchapman-evalforge-lite?utm_source=badge)

Nice for visibility, but GitHub marks README links nofollow, so it doesn't pass authority. Use the HTML badge on your site as well.