# Crawl4AI RAG MCP Server

> Use this tool when you need to extract and retrieve web content with semantic search capabilities, enabling AI assistants to efficiently crawl websites and provide relevant information through natural language queries. It solves problems related to web data extraction, information retrieval, and content filtering, ideal for applications requiring intelligent content cleaning and tag-based filtering. The tool accepts website URLs and natural language queries as inputs and outputs relevant, cleaned web content with vector embeddings.

Canonical page: https://skillsregistry.net/skills/rob-p-smith-mcpragcrawl4ai  
JSON: https://api.skillsregistry.net/v1/skills/rob-p-smith-mcpragcrawl4ai

## Description

Enables AI assistants to crawl websites, extract and store web content with semantic search capabilities using vector embeddings, and retrieve information through natural language queries with tag-based filtering and intelligent content cleaning.

## Trust

- **Trust score (0–1):** 0.52
- **Verification tier:** scanned
- **Last scanned:** 2026-09-28

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** browser-automation
- **Updated:** 2026-09-28

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/mmj3nw5l8e)
- **Repository:** <https://github.com/Rob-P-Smith/mcpragcrawl4ai>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "rob-p-smith-mcpragcrawl4ai"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/rob-p-smith-mcpragcrawl4ai` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/rob-p-smith-mcpragcrawl4ai/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt