# crawlforge

> crawlforge — mario-hernandez-crawlforge. Use this tool when you need to crawl and analyze websites for SEO audits, as it provides a comprehensive alternative to traditional SEO spider tools. Crawlforge solves problems related to website optimization, technical audits, and data analysis, offering 269 rules and efficient storage solutions. It accepts website URLs as input and outputs detailed reports and data for further analysis, making it ideal for use cases involving large-scale website crawling and optimization.

Canonical page: https://skillsregistry.net/skills/mario-hernandez-crawlforge  
JSON: https://api.skillsregistry.net/v1/skills/mario-hernandez-crawlforge

## Description

Open source alternative to Screaming Frog SEO Spider — LLM-native, MCP server included, 269 rules, DuckDB+Parquet storage, MIT licensed.

## Trust

- **Trust score (0–1):** 0.62
- **Verification tier:** scanned
- **Last scanned:** 2026-09-19

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** container
- **Runtime environment:** vm
- **Category:** browser-automation
- **Updated:** 2026-09-21

## Source

- **Source listing:** [GitHub](https://github.com/mario-hernandez/crawlforge)

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "mario-hernandez-crawlforge"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/mario-hernandez-crawlforge` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/mario-hernandez-crawlforge/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt