# Rock (Website Crawler)

> Use this tool when you need to index and search website documentation efficiently, as it crawls websites and indexes their content into a local database with full-text search capabilities. It solves problems such as information discovery and retrieval, providing tools for web search, async URL crawling, and topic expansion. With configurable crawl settings and outputs including searchable databases and retrieved web pages, use Rock to streamline documentation search and management.

Canonical page: https://skillsregistry.net/skills/sethwebster-rock  
JSON: https://api.skillsregistry.net/v1/skills/sethwebster-rock

## Description

Crawls documentation websites and indexes their content into a local SQLite database with full-text search capabilities. Provides nine tools for web search via DuckDuckGo, async URL crawling, full-text doc search, page retrieval with section jumping, topic expansion, source management, and recrawling. Configurable crawl depth (2 hops default), max pages (50 per source), and concurrent request limits with redirect deduplication and HTML-only indexing.

## Trust

- **Trust score (0–1):** 0.89
- **Verification tier:** verified
- **Last scanned:** 2026-09-28

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** database
- **Updated:** 2026-09-28

## Source

- **Source listing:** [PulseMCP](https://www.pulsemcp.com/servers/sethwebster-rock)
- **Repository:** <https://github.com/sethwebster/rock-mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "sethwebster-rock"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/sethwebster-rock` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/sethwebster-rock/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt