# common-crawl-mcp

> common-crawl-mcp — nikolaymokh-dev-common-crawl-mcp. Use this tool when you need to analyze web page data and dynamics, or compare domain presence in web crawls. It enables users to query Common Crawl data via AWS Athena, checking domain presence, analyzing trends, and inspecting page text. Ideal for use cases requiring web data analysis, domain comparison, and crawl data inspection.

Canonical page: https://skillsregistry.net/skills/nikolaymokh-dev-common-crawl-mcp  
JSON: https://api.skillsregistry.net/v1/skills/nikolaymokh-dev-common-crawl-mcp

## Description

MCP server and CLI for querying Common Crawl via AWS Athena, enabling users to check a domain's presence in crawls, analyze dynamics, compare domains, and inspect page text.

## Trust

- **Trust score (0–1):** 0.69
- **Verification tier:** scanned
- **Last scanned:** 2026-08-29

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** cloud-infra
- **Updated:** 2026-08-29

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/lmv0cmjdhl)
- **Repository:** <https://github.com/nikolaymokh-dev/common-crawl-mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "nikolaymokh-dev-common-crawl-mcp"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/nikolaymokh-dev-common-crawl-mcp` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/nikolaymokh-dev-common-crawl-mcp/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt