# Ai Model Experiments (npm · @pipeworx/mcp-ai-model-experiments)

AI Model Experiments MCP ('Model Lab') — run the same prompts across many AI models simultaneously…

- Trust score: 84/100 (high trust)
- Change this week: +3
- Registry status: active
- Liveness: live
- Owner verified: no
- Last scored: 2026-11-05

## Components

- remote · `gateway.pipeworx.io`: 79/100, [markdown](https://verifymcp.io/servers/pipeworx-io-ai-model-experiments/ai-model-experiments-mcp.md), [page](https://verifymcp.io/servers/pipeworx-io-ai-model-experiments/ai-model-experiments-mcp)
- npm · `@pipeworx/mcp-ai-model-experiments`: 84/100 (this document), [markdown](https://verifymcp.io/servers/pipeworx-io-ai-model-experiments/pipeworx-mcp-ai-model-experiments.md), [page](https://verifymcp.io/servers/pipeworx-io-ai-model-experiments/pipeworx-mcp-ai-model-experiments)

## Channel facts

- Registry: `npm`
- Package: `@pipeworx/mcp-ai-model-experiments`
- Version: `0.2.1`
- Transport: `stdio`

## Trust breakdown

How this component scores in each security and reliability category. Every signal is checked automatically from public evidence about the published package, including repeated runs of it in an isolated sandbox, and we only credit what we can confirm. Scores are 0–100 per category. Scoring method: https://verifymcp.io/docs/scoring (what has changed: https://verifymcp.io/docs/scoring/changelog)

Scored 2026-11-05.

- **Supply Chain Security**: 100/100
  - No malware found by supply-chain analysis.
  - No known CVEs affecting this package version or its production dependencies.
  - No install/post-install scripts declared.
  - No production dependencies, so there is no dependency health to assess.
- **Provenance & Transparency**: 97/100
  - Source repository is publicly reachable at the declared URL.
  - Cryptographically verified build provenance (signed, bound to pipeworx-io/mcp-ai-model-experiments).
  - Clear OSI-approved license (MIT).
  - Actively maintained (last published 5 days ago).
  - Disclosure check failed: no security disclosure policy was found in the source repository.
- **Schema Quality & AI Usability**: 74/100
  - AI-judged instruction clarity (excellent).
  - Context-footprint check failed: tool/resource definitions use about 1146 tokens (~143/item across 8 items; 8 tools + 0 resources), over budget; trim descriptions and params.
  - Usage-examples check failed: none of the tools include examples.
- **Stability & Change Management**: 23/100
  - Stability observed for 7 of 30 days with no destabilising changes; credit accrues until the full window elapses.
- **Tool Coverage**: 100/100
  - 100% of tools have a non-trivial description (not blank, and not just the tool's name).
  - 100% of tool parameters carry a description.
- **Tool Safety**: 100/100
  - No prompt-injection markers were found in the server instructions, tool names or descriptions we captured.
  - We read all 8 captured tool definition(s), and no name or description among them implies an irreversible operation.
  - An AI judge read all 9 captured unit(s) of tool text and found none that tries to manipulate the model reading it.
- **Capabilities**: 100/100
  - Implements a supported MCP spec version (2025-11-25); the latest is 2026-07-28.

## Install

### How do I install the Ai Model Experiments MCP server?

Ai Model Experiments runs locally as an npm package, launched with npx -y @pipeworx/mcp-ai-model-experiments. Ready-made configuration for Claude, Cursor, VS Code, Codex and 5 more is on this page, copied from each client's own documentation.

### Claude

```bash
claude mcp add pipeworx-io-ai-model-experiments -- npx -y @pipeworx/mcp-ai-model-experiments
```

### Cursor

```json
{
  "mcpServers": {
    "pipeworx-io-ai-model-experiments": {
      "command": "npx",
      "args": [
        "-y",
        "@pipeworx/mcp-ai-model-experiments"
      ]
    }
  }
}
```

### VS Code

```json
{
  "servers": {
    "pipeworx-io-ai-model-experiments": {
      "command": "npx",
      "args": [
        "-y",
        "@pipeworx/mcp-ai-model-experiments"
      ]
    }
  }
}
```

### Codex

```bash
codex mcp add pipeworx-io-ai-model-experiments -- npx -y @pipeworx/mcp-ai-model-experiments
```

### opencode

```json
{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "pipeworx-io-ai-model-experiments": {
      "type": "local",
      "command": [
        "npx",
        "-y",
        "@pipeworx/mcp-ai-model-experiments"
      ],
      "enabled": true
    }
  }
}
```

### OpenClaw

```bash
openclaw mcp add pipeworx-io-ai-model-experiments --command npx --arg -y --arg @pipeworx/mcp-ai-model-experiments
```

### Hermes

```yaml
mcp_servers:
  pipeworx-io-ai-model-experiments:
    command: "npx"
    args: ["-y", "@pipeworx/mcp-ai-model-experiments"]
```

### Netclaw

```json
{
  "McpServers": {
    "pipeworx-io-ai-model-experiments": {
      "Transport": "stdio",
      "Command": "npx",
      "Arguments": [
        "-y",
        "@pipeworx/mcp-ai-model-experiments"
      ]
    }
  }
}
```

### Vellum

```bash
assistant mcp add pipeworx-io-ai-model-experiments -t stdio -c npx -a -y @pipeworx/mcp-ai-model-experiments
```

### Other

```json
{
  "mcpServers": {
    "pipeworx-io-ai-model-experiments": {
      "command": "npx",
      "args": [
        "-y",
        "@pipeworx/mcp-ai-model-experiments"
      ]
    }
  }
}
```

## Changelog

Every change recorded for this component, newest first. Days that predate change tracking, or that we cannot explain, say so: "we were watching and nothing happened" and "we were not watching" are different claims.

### 2026-11-04 (score 84, +1)

No change was recorded against any check on this day. Stability & Change Management went from 17 to 20. That category is still filling its 30-day observation window: 5 days of observed history at the previous scan, 6 at this one. The score rises as the window fills, whether or not the server changes.

### 2026-11-02 (score 83, +1)

No change was recorded against any check on this day. Stability & Change Management went from 10 to 13. That category is still filling its 30-day observation window: 3 days of observed history at the previous scan, 4 at this one. The score rises as the window fills, whether or not the server changes.

### 2026-10-31 (score 82, +1)

No change was recorded against any check on this day. Stability & Change Management went from 3 to 7. That category is still filling its 30-day observation window: 1 days of observed history at the previous scan, 2 at this one. The score rises as the window fills, whether or not the server changes.

### 2026-10-30 (score 81, 0)

- [functional regression] Security disclosure: unverified → fail
- [functional] Package version: 0.2.0 → 0.2.1

### 2026-10-29 (score 81)

First indexed and scored.

## MCP tools (8)

### `experiment_models` (~181 tokens)

List AI models available for experiments (about 300 across Anthropic, OpenAI, Google, Meta, Mistral, DeepSeek, Qwen and more), with context window and OUR per-token prices (provider cost × 1.5 — what experiments actually bill). Filter by name/vendor search, minimum context, or max price. Use the returned model ids in experiment_create. Example: experiment_models({ search: "claude", min_context: 100000 })

Input parameters:

- `limit` (number): Max models to return (default 30)
- `max_price_per_mtok` (number): Max billed OUTPUT price in USD per million tokens
- `min_context` (number): Minimum context window in tokens
- `search` (string): Substring match on model id or name, e.g. "claude", "gpt", "llama"

### `experiment_estimate` (~194 tokens)

Dry-run cost estimate for an experiment BEFORE creating it — cell count and estimated billed cost range (at our 1.5× pricing) for prompts × models × reps. Free to call, no side effects, does not need credit balance. Same spec shape as experiment_create. Example: experiment_estimate({ prompts: ["Summarize: ..."], models: ["anthropic/claude-sonnet-4.5", "openai/gpt-5"], reps: 2 })

Input parameters:

- `models` (array, required): Model ids from experiment_models (max 12)
- `params` (object): Optional {system, temperature, max_tokens}
- `prompts` (array, required): Prompts to test (max 20)
- `reps` (number): Repetitions per prompt×model, 1-5 (default 1)
- `summary` (boolean): Include the AI-written comparison summary stage (default true)

### `experiment_create` (~343 tokens)

Model Lab: run one prompt across many AI models at once and compare their outputs, cost, and latency side by side. Create and start an experiment: run each prompt against each model (× reps), collecting output, tokens, latency, and billed cost per cell. PREPAID: requires Pipeworx credit balance ≥ max_spend_usd (top up via experiment_topup); bills actual provider cost × 1.5 with a $0.10 minimum per experiment. ASYNC: returns experiment_id immediately — execution starts within ~1 minute; poll experiment_status until complete, then call experiment_results. Do NOT wait synchronously. Set summary:false to skip the AI-written model-comparison summary. Example: experiment_create({ name: "tone test", prompts: ["Rewrite formally: ..."], models: ["anthropic/claude-haiku-4.5", "openai/gpt-5-mini"], reps: 2, max_spend_usd: 2 })

Input parameters:

- `max_spend_usd` (number, required): REQUIRED hard spend cap in USD for this experiment (max 100). Execution stops when reached.
- `models` (array, required): Model ids from experiment_models (max 12)
- `name` (string): Short experiment name
- `params` (object): Optional {system, temperature, max_tokens (default 512)}
- `prompts` (array, required): Prompts to test (max 20)
- `reps` (number): Repetitions per prompt×model for variance, 1-5 (default 1)
- `summary` (boolean): AI-written comparison of the models' outputs when the run completes (default true)

### `experiment_status` (~71 tokens)

Progress of an experiment: cell counts by state (pending/running/ok/error/skipped), spend so far vs cap, and whether it is complete. Poll this after experiment_create (every few seconds). Example: experiment_status({ experiment_id: "..." })

Input parameters:

- `experiment_id` (string, required): From experiment_create

### `experiment_results` (~94 tokens)

Results of an experiment: per-model aggregates (mean latency, tokens, total billed cost, error rate), per-cell outputs, and the AI-written summary comparing how the models differed (if enabled). Use include_outputs:false for aggregates only. Example: experiment_results({ experiment_id: "..." })

Input parameters:

- `experiment_id` (string, required): From experiment_create
- `include_outputs` (boolean): Include full model outputs per cell (default true)

### `experiment_list` (~43 tokens)

List your experiments, newest first, with status and spend. Example: experiment_list({ limit: 10 })

Input parameters:

- `limit` (number): Max experiments (default 20)

### `experiment_cancel` (~50 tokens)

Cancel a running experiment: pending cells are skipped (not billed); in-flight cells finish and bill. Example: experiment_cancel({ experiment_id: "..." })

Input parameters:

- `experiment_id` (string, required): From experiment_create

### `experiment_topup` (~112 tokens)

How to add prepaid credits for experiments (and your current balance). Payment is x402 — USDC on Base, paid in-band by any wallet-equipped agent: POST https://gateway.pipeworx.io/credits/topup?amount_usd=10 responds HTTP 402 with payment requirements; retry with PAYMENT-SIGNATURE to settle and the credits land instantly. Example: experiment_topup({})

Input parameters:

- `amount_usd` (number): Intended top-up amount in USD (1-500) — echoed into the instructions

## Diagnostics

Captured diagnostic sections: Provenance, Dependencies. The full working is on the page: https://verifymcp.io/servers/pipeworx-io-ai-model-experiments/pipeworx-mcp-ai-model-experiments#diagnostics

## Score history

- 2026-11-05: 84
- 2026-11-04: 84
- 2026-11-03: 83
- 2026-11-02: 83
- 2026-11-01: 82
- 2026-10-31: 82
- 2026-10-30: 81
- 2026-10-29: 81

## Common questions

### What is the Ai Model Experiments MCP server?

Ai Model Experiments is an MCP server listed in the public MCP registry as io.github.pipeworx-io/ai-model-experiments. AI Model Experiments MCP ('Model Lab'), run the same prompts across many AI models simultaneously… This page covers its npm package (@pipeworx/mcp-ai-model-experiments).

### Is the Ai Model Experiments MCP server safe to use?

Ai Model Experiments scores 84 out of 100 on VerifyMCP. We found no known CVEs affecting it as of 5 November 2026. It declares no install or post-install scripts. Its build provenance is signed and verified. That is a record of what we were able to check automatically, not an endorsement. The category breakdown on this page shows every signal behind the number, including the ones we could not confirm.

### What tools does the Ai Model Experiments MCP server expose?

Ai Model Experiments exposes 8 tools: experiment_models, experiment_estimate, experiment_create, experiment_status, experiment_results, and 3 more. Their descriptions and schemas cost roughly 1,088 tokens of context every time the server is loaded.

### Is the Ai Model Experiments MCP server still maintained?

Ai Model Experiments is still listed as active in the MCP registry. We last reached this channel on 5 November 2026. Those dates come from our own scans of the registry and the channel itself, not from anything the publisher announced.

### What licence is the Ai Model Experiments MCP server under?

Ai Model Experiments declares the MIT licence, which is OSI-approved. That covers the source only, and says nothing about the cost of any service it calls.

## Links

- npm package: https://www.npmjs.com/package/@pipeworx/mcp-ai-model-experiments
- Socket report: https://socket.dev/npm/package/@pipeworx/mcp-ai-model-experiments
- Repository: https://github.com/pipeworx-io/mcp-ai-model-experiments
- Website: https://pipeworx.io/packs/ai-model-experiments
- Changelog RSS feed: https://verifymcp.io/servers/pipeworx-io-ai-model-experiments/pipeworx-mcp-ai-model-experiments.xml
- Changelog JSON feed: https://verifymcp.io/servers/pipeworx-io-ai-model-experiments/pipeworx-mcp-ai-model-experiments.json
- HTML version of this page: https://verifymcp.io/servers/pipeworx-io-ai-model-experiments/pipeworx-mcp-ai-model-experiments