# Vercel MCP Web Crawler

> Vercel MCP Web Crawler — aieterprise-mcp-web-crawler. Use this tool when you need to extract data from websites or fetch web pages as Markdown, and you want to recursively crawl domains, extract metadata, or perform search-and-crawl operations with a lightweight web crawling and scraping capability. It solves problems such as data extraction, web scraping, and content fetching, and accepts inputs like domain URLs and search queries, producing outputs like clean Markdown pages and extracted metadata. Ideal for use cases where efficient web data extraction is required, such as data mining, research, or content aggregation.

Canonical page: https://skillsregistry.net/skills/aieterprise-mcp-web-crawler  
JSON: https://api.skillsregistry.net/v1/skills/aieterprise-mcp-web-crawler

## Description

Provides lightweight web crawling and scraping capabilities, enabling users to fetch pages as clean Markdown, recursively crawl domains, extract metadata, and perform search-and-crawl operations.

## Trust

- **Trust score (0–1):** 0.68
- **Verification tier:** scanned
- **Last scanned:** 2026-08-28

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** browser-automation
- **Updated:** 2026-08-28

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/y50q3uofqd)
- **Repository:** <https://github.com/AIEterprise/mcp-web-crawler>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "aieterprise-mcp-web-crawler"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/aieterprise-mcp-web-crawler` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/aieterprise-mcp-web-crawler/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt