# mcp-commoncrawl

> mcp-commoncrawl — pipeworx-io-mcp-commoncrawl. Use this tool when you need to access historical web page data or track changes to a website over time. It solves problems related to web archiving, data mining, and digital preservation by providing access to crawled URL data since 2008. The tool takes a URL as input and outputs the captured page bytes, allowing for analysis of web page evolution and content changes.

Canonical page: https://skillsregistry.net/skills/pipeworx-io-mcp-commoncrawl  
JSON: https://api.skillsregistry.net/v1/skills/pipeworx-io-mcp-commoncrawl

## Description

Common Crawl's public web archive — find every time a URL was crawled since 2008 and read the exact page bytes that were captured.

## Trust

- **Trust score (0–1):** 0.99
- **Verification tier:** verified
- **Last scanned:** 2026-09-28

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** container
- **Runtime environment:** vm
- **License:** MIT
- **Updated:** 2026-09-28

## Source

- **Source listing:** [GitHub](https://github.com/pipeworx-io/mcp-commoncrawl)

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "pipeworx-io-mcp-commoncrawl"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/pipeworx-io-mcp-commoncrawl` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/pipeworx-io-mcp-commoncrawl/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt