Local AI MCP

io.github.TMHSDigital/local-ai-mcp

Run, fit, and route work to local LLMs (Ollama, LM Studio, llama.cpp, MLX, vLLM, and more).

Connect this server

Add this to your MCP client config — claude_desktop_config.json (Claude Desktop) or .cursor/mcp.json (Cursor).Suits: Claude Desktop · Cursor.

{
  "mcpServers": {
    "local-ai-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@tmhs/local-ai-mcp@0.6.1"
      ],
      "env": {
        "OLLAMA_HOST": "http://localhost:11434",
        "LMSTUDIO_HOST": "http://localhost:1234",
        "LLAMACPP_HOST": "http://localhost:8080",
        "DOCKER_MODEL_RUNNER_HOST": "http://localhost:12434",
        "VLLM_API_KEY": "<your VLLM_API_KEY>",
        "OPENAI_COMPAT_API_KEY": "<your OPENAI_COMPAT_API_KEY>",
        "MOONSHOT_API_KEY": "<your MOONSHOT_API_KEY>",
        "MOONSHOT_HOST": "https://api.moonshot.ai/v1"
      }
    }
  }
}
Environment variables
  • OLLAMA_HOSTOllama base URL
  • LMSTUDIO_HOSTLM Studio server base URL
  • LLAMACPP_HOSTllama.cpp server (llama-server) base URL
  • DOCKER_MODEL_RUNNER_HOSTDocker Model Runner host TCP endpoint
  • VLLM_API_KEYsecretBearer token for VLLM_HOST (when vLLM runs with --api-key)
  • OPENAI_COMPAT_API_KEYsecretBearer token for OPENAI_COMPAT_HOST
  • MOONSHOT_API_KEYsecretMoonshot AI (Kimi) key. Hosted: only used when named explicitly.
  • MOONSHOT_HOSTMoonshot API base URL

A starting point — check the repository for exact arguments and setup. Restart your client after editing the config.

Category
AI & ML
Version
0.6.1
Registry
active
Published
11/3/2026
Browse all AI & ML →

Add the badge to your site

Show visitors that Local AI MCP is listed here — it’s also the link we check for a free listing.

Local AI MCP — listed on Serverdex

HTML — for your website

<a href="https://serverdex.io/server/io-github-tmhsdigital-local-ai-mcp?utm_source=badge"><img src="https://serverdex.io/brand/badge.svg" alt="Local AI MCP — listed on Serverdex" width="123" height="40" loading="lazy"></a>

Recommended. A dofollow link from your own domain is the one that counts for search engines, and it's the link we check for a free listing.

Markdown — for your README

[![Local AI MCP — listed on Serverdex](https://serverdex.io/brand/badge.svg)](https://serverdex.io/server/io-github-tmhsdigital-local-ai-mcp?utm_source=badge)

Nice for visibility, but GitHub marks README links nofollow, so it doesn't pass authority. Use the HTML badge on your site as well.