# Web Scraper — Clean Markdown from Any URL

> Use this tool when you need to extract clean and structured Markdown content from any URL, stripping navigation, ads, and scripts. It solves problems in content analysis, data extraction, and research by providing a simple API for web scraping, returning markdown, title, word count, and links. Ideal for RAG pipelines, AI research, and competitive intelligence, it accepts single or batch URLs as input and returns the extracted content without requiring an API key.

Canonical page: https://skillsregistry.net/skills/axel-belfort-web-scraper  
JSON: https://api.skillsregistry.net/v1/skills/axel-belfort-web-scraper

## Description

Web content extraction API for AI agents. Scrape any URL and get clean, structured Markdown content with navigation, ads, and scripts stripped. Full JavaScript rendering via headless Chromium. Single and batch (10 URLs) modes. Built for RAG pipelines and AI research.

Tools: web_scrape_to_markdown (single), web_scrape_batch (up to 10 URLs).

Use this for RAG ingestion, research, content analysis, data extraction, or competitive intelligence. IMPORTANT: For screenshots/PDFs of pages, use capture_screenshot instead. For SEO analysis, use seo_audit_page.

Returns: {markdown, title, wordCount, links[]}. No API key required — x402 micropayment $0.005/call on Base L2.

## Trust

- **Trust score (0–1):** 0.73
- **Verification tier:** verified
- **Last scanned:** 2026-08-30

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** devops-ci
- **Updated:** 2026-08-30

## Source

- **Source listing:** [Smithery](https://smithery.ai/server/axel-belfort/web-scraper)
- **Repository:** <https://github.com/Br0ski777/web-scraper-x402>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "axel-belfort-web-scraper"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/axel-belfort-web-scraper` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/axel-belfort-web-scraper/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt