# judge-audit-mcp

> judge-audit-mcp — asif786ka-judge-audit-mcp. Use this tool when you need to evaluate and audit the performance of large language models (LLMs) used as judges, detecting drift and bias in their evaluations. It solves problems of inconsistent or unfair judgments by measuring agreement with human raters and identifying areas of bias through controlled probes. The tool takes LLM evaluations as input and outputs audit reports highlighting judge drift, bias, and agreement with human raters.

Canonical page: https://skillsregistry.net/skills/asif786ka-judge-audit-mcp  
JSON: https://api.skillsregistry.net/v1/skills/asif786ka-judge-audit-mcp

## Description

An MCP server that audits LLM-as-judge evaluations, detecting judge drift across runs, measuring bias through controlled probes, and comparing judge agreement with human raters.

## Trust

- **Trust score (0–1):** 0.69
- **Verification tier:** scanned
- **Last scanned:** 2026-09-03

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** ai-ml
- **Updated:** 2026-09-03

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/ux7qde1e21)
- **Repository:** <https://github.com/asif786ka/judge-audit-mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "asif786ka-judge-audit-mcp"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/asif786ka-judge-audit-mcp` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/asif786ka-judge-audit-mcp/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt