io.github.nipunkhanderia/golden-dataset-mcp
PYPI · GOLDEN-DATASET-MCP · SCANNED SEP 21
Version-controlled golden datasets and RAG evaluation, no API key needed.
Available components
How this component scores in each security and reliability category. Every signal is checked automatically from public evidence about the published package, including repeated runs of it in an isolated sandbox, and we only credit what we can confirm. How we score → Why this is hard to score →
Supply Chain Security100
- No malware found by supply-chain analysis.Pass
- No known CVEs affecting this package version or its production dependencies.Pass
- Runs hatchling.build at install time, a recognised native-build step with no shell scripting around it. View diagnostics → Pass
- 1 of 24 dependencies flagged as unhealthy. View diagnostics → Partial
Provenance & Transparency32
- Source repository is publicly reachable at the declared URL. View diagnostics → Pass
- Provenance check failed: no build-provenance attestation is published. See how to fix → View diagnostics → Fail
- License check failed: the license (MIT License) isn't a recognized OSI-approved license. See how to fix → Fail
- Actively maintained (last published 92 days ago).Pass
- Disclosure check failed: no security disclosure policy was found in the source repository. See how to fix → Fail
Schema Quality & AI Usability70
- AI-judged instruction clarity (good).Pass
- Tool/resource definitions use about 552 tokens (~61/item across 9 items; 9 tools + 0 resources), lean.Pass
- Usage-examples check failed: none of the tools include examples. See how to fix → Fail
Stability & Change Management87
- Stability observed for 26 of 30 days with no destabilising changes; credit accrues until the full window elapses.Partial
Tool Coverage71
- 100% of tools have a non-trivial description (not blank, and not just the tool's name).Pass
- 0% of tool parameters carry a description.Fail
- Structured output schemas are declared (100% of tools); any adoption earns full credit.Pass
Tool Safety75
- No prompt-injection markers were found in the server instructions, tool names or descriptions we captured.Pass
- 0 of 1 tool(s) whose name or description implies an irreversible operation declare an MCP destructiveHint annotation; "delete_entry" implies "delete" and declares no destructiveHint at all, which the MCP spec reads as destructive by default. See how to fix → Fail
- An AI judge read all 10 captured unit(s) of tool text and found none that tries to manipulate the model reading it.Pass
Capabilities100
- Implements a current MCP spec version (2026-07-28).Pass
How do I install the io.github.nipunkhanderia/golden-dataset-mcp server?
io.github.nipunkhanderia/golden-dataset-mcp runs locally as a PyPI package, launched with uvx golden-dataset-mcp. Ready-made configuration for Claude, Cursor, VS Code, Codex and 5 more is on this page, copied from each client's own documentation.
pypi · golden-dataset-mcp
claude mcp add nipunkhanderia-golden-dataset-mcp -- uvx golden-dataset-mcp
{
"mcpServers": {
"nipunkhanderia-golden-dataset-mcp": {
"command": "uvx",
"args": [
"golden-dataset-mcp"
]
}
}
} {
"servers": {
"nipunkhanderia-golden-dataset-mcp": {
"command": "uvx",
"args": [
"golden-dataset-mcp"
]
}
}
} codex mcp add nipunkhanderia-golden-dataset-mcp -- uvx golden-dataset-mcp
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"nipunkhanderia-golden-dataset-mcp": {
"type": "local",
"command": [
"uvx",
"golden-dataset-mcp"
],
"enabled": true
}
}
} openclaw mcp add nipunkhanderia-golden-dataset-mcp --command uvx --arg golden-dataset-mcp
mcp_servers:
nipunkhanderia-golden-dataset-mcp:
command: "uvx"
args: ["golden-dataset-mcp"] {
"McpServers": {
"nipunkhanderia-golden-dataset-mcp": {
"Transport": "stdio",
"Command": "uvx",
"Arguments": [
"golden-dataset-mcp"
]
}
}
} assistant mcp add nipunkhanderia-golden-dataset-mcp -t stdio -c uvx -a golden-dataset-mcp
{
"mcpServers": {
"nipunkhanderia-golden-dataset-mcp": {
"command": "uvx",
"args": [
"golden-dataset-mcp"
]
}
}
} Every change we have recorded for this component, newest first. Security-relevant changes are always shown. ▲ marks a change for the better, ▼ a change for the worse; unmarked changes are neutral.
- 20 Sept 26 +1
No change was recorded against any check on this day. Stability & Change Management went from 80 to 83. That category is still filling its 30-day observation window: 24 days of observed history at the previous scan, 25 at this one. The score rises as the window fills, whether or not the server changes.
- 19 Sept 26 −3
- Stability: pass → 0.80 functional
- 18 Sept 26 0
- Stability: 0.97 → pass security
- 17 Sept 26 +1
No change was recorded against any check on this day. Stability & Change Management went from 93 to 97. That category is still filling its 30-day observation window: 28 days of observed history at the previous scan, 29 at this one. The score rises as the window fills, whether or not the server changes.
- 15 Sept 26 +1
No change was recorded against any check on this day. Stability & Change Management went from 87 to 90. That category is still filling its 30-day observation window: 26 days of observed history at the previous scan, 27 at this one. The score rises as the window fills, whether or not the server changes.
- 13 Sept 26 +1
No change was recorded against any check on this day. Stability & Change Management went from 80 to 83. That category is still filling its 30-day observation window: 24 days of observed history at the previous scan, 25 at this one. The score rises as the window fills, whether or not the server changes.
- 12 Sept 26 −3
- Stability: pass → 0.80 functional
- 11 Sept 26 0
- Stability: 0.97 → pass security
Diagnostic detail from the automated scan of this channel: what the scanner observed at each step, so you can see exactly where a check passed or failed. It is informational only and never changes the trust score.
Captured 21 Sept 2026 · Analysed pypi/golden-dataset-mcp@0.1.2
Provenance No attestation
The registry publishes no build provenance for this version, so there is nothing to verify.
| Result | No attestation |
|---|---|
| Ecosystem | pypi |
Background: How many MCP packages publish verified provenance →
Install scripts 1 script
| Hook | Tier | Command |
|---|---|---|
| build_backend | allowlisted | hatchling.build |
Background: Why install scripts are a supply-chain risk →
Dependencies 24 packages
| Packages resolved | 24 |
|---|---|
| Stale | 1 |
| Tree resolution | Complete |
Background: SBOMs and build attestations, explained →
The tools this component advertises to a client, with an estimated token cost for each. Expand a tool to see its parameters and schema. The per-tool counts are indicative and are not scored directly; the schema's total context footprint is one signal in Schema Quality & AI Usability. A tool's description is untrusted text the model reads on every call, which is what makes this list a security surface and not just an inventory: how tool poisoning works →
add_entry Add Entry ~54
Add a question-answer pair to the working tree of a golden dataset. Entries added here are NOT yet versioned — call commit_version to snapshot them. dataset_path must already be initialised.
| Name | Type | Req | Description |
|---|---|---|---|
| input | object | yes | – |
| Name | Type | Req | Description |
|---|---|---|---|
| id | string | yes | – |
| status | string | yes | – |
No examples provided.
commit_version Commit Version ~56
Snapshot the current working tree as a new immutable dataset version. Versions auto-increment (1.0 -> 1.1 -> 1.2...). Fails if the working tree is empty.
| Name | Type | Req | Description |
|---|---|---|---|
| input | object | yes | – |
| Name | Type | Req | Description |
|---|---|---|---|
| entry_count | integer | yes | – |
| parent_version | – | yes | – |
| sha256 | string | yes | – |
| version | string | yes | – |
No examples provided.
dataset_status Dataset Status ~34
Show the current state of a golden dataset: name, current version, and working tree size.
| Name | Type | Req | Description |
|---|---|---|---|
| input | object | yes | – |
| Name | Type | Req | Description |
|---|---|---|---|
| current_version | – | yes | – |
| description | string | yes | – |
| name | string | yes | – |
| versions | array | yes | – |
| working_tree_entry_count | integer | yes | – |
No examples provided.
delete_entry Delete Entry ~35
Remove an entry from the working tree by its id. Does not affect already-committed versions.
| Name | Type | Req | Description |
|---|---|---|---|
| input | object | yes | – |
| Name | Type | Req | Description |
|---|---|---|---|
| id | string | yes | – |
| status | string | yes | – |
No examples provided.
diff_versions Diff Versions ~28
Show entries added, removed, or changed between two committed versions.
| Name | Type | Req | Description |
|---|---|---|---|
| input | object | yes | – |
| Name | Type | Req | Description |
|---|---|---|---|
| added | array | yes | – |
| changed | array | yes | – |
| removed | array | yes | – |
No examples provided.
evaluate_answers Evaluate Answers ~78
Score actual LLM/RAG-generated answers against the golden dataset using TF-IDF cosine similarity (no LLM call, no API key needed). actual_answers must be supplied in the same order as the entries in the target version. Omit `version` to evaluate against the current committed version.
| Name | Type | Req | Description |
|---|---|---|---|
| input | object | yes | – |
| Name | Type | Req | Description |
|---|---|---|---|
| avg_semantic_similarity | – | yes | – |
| dataset_name | string | yes | – |
| passed | boolean | yes | – |
| results | array | yes | – |
| total_entries | integer | yes | – |
| version | string | yes | – |
No examples provided.
init_dataset Init Dataset ~58
Initialise a new version-controlled golden dataset at dataset_path. Creates a .golden_dataset/ directory there. Fails if one already exists at that path — delete .golden_dataset/ manually to start fresh.
| Name | Type | Req | Description |
|---|---|---|---|
| input | object | yes | – |
| Name | Type | Req | Description |
|---|---|---|---|
| created_at | string | yes | – |
| description | string | yes | – |
| name | string | yes | – |
No examples provided.
list_entries List Entries ~52
List entries in a dataset. Omit version to see the uncommitted working tree; pass a version (e.g. '1.0') to see a committed snapshot.
| Name | Type | Req | Description |
|---|---|---|---|
| input | object | yes | – |
| Name | Type | Req | Description |
|---|---|---|---|
| count | integer | yes | – |
| entries | array | yes | – |
No examples provided.
update_entry Update Entry ~55
Update fields of an existing working-tree entry by its id. Only fields you provide are changed; omitted fields are left as-is. Raises an error if entry_id is not found in the working tree.
| Name | Type | Req | Description |
|---|---|---|---|
| input | object | yes | – |
| Name | Type | Req | Description |
|---|---|---|---|
| answer | string | yes | – |
| contexts | array | yes | – |
| id | string | yes | – |
| metadata | object | yes | – |
| question | string | yes | – |
| tags | array | yes | – |
| updated_at | string | yes | – |
No examples provided.
What is the io.github.nipunkhanderia/golden-dataset-mcp server?
io.github.nipunkhanderia/golden-dataset-mcp is listed in the public MCP registry as io.github.nipunkhanderia/golden-dataset-mcp. Version-controlled golden datasets and RAG evaluation, no API key needed. This page covers its PyPI package (golden-dataset-mcp).
Is the io.github.nipunkhanderia/golden-dataset-mcp server safe to use?
io.github.nipunkhanderia/golden-dataset-mcp scores 75 out of 100 on VerifyMCP. We found no known CVEs affecting it as of 21 September 2026. That is a record of what we were able to check automatically, not an endorsement. The category breakdown on this page shows every signal behind the number, including the ones we could not confirm.
What tools does the io.github.nipunkhanderia/golden-dataset-mcp server expose?
io.github.nipunkhanderia/golden-dataset-mcp exposes 9 tools: init_dataset, add_entry, update_entry, delete_entry, list_entries, and 4 more. Their descriptions and schemas cost roughly 450 tokens of context every time the server is loaded.
Is the io.github.nipunkhanderia/golden-dataset-mcp server still maintained?
io.github.nipunkhanderia/golden-dataset-mcp is still listed as active in the MCP registry. We last reached this channel on 21 September 2026. Those dates come from our own scans of the registry and the channel itself, not from anything the publisher announced.