# Web Scraper

> Use this tool when you need to extract clean text from web pages, removing boilerplate content for retrieval-augmented generation pipelines. It takes a URL as input and returns structured Markdown output, making it ideal for large language models (LLMs) that require high-quality text data. Suitable for applications where accurate web data extraction is crucial, with pay-per-call access available via x402 USDC micropayments on Base.

Canonical page: https://skillsregistry.net/skills/br0ski777-web-scraper  
JSON: https://api.skillsregistry.net/v1/skills/br0ski777-web-scraper

## Description

Fetches any web page and returns clean, structured Markdown with boilerplate content removed. Designed for retrieval-augmented generation pipelines where LLMs need clean text from arbitrary URLs. Uses x402 USDC micropayments on Base for pay-per-call access.

## Trust

- **Trust score (0–1):** 0.85
- **Verification tier:** verified
- **Last scanned:** 2026-09-19

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** devops-ci
- **Updated:** 2026-09-19

## Source

- **Source listing:** [PulseMCP](https://www.pulsemcp.com/servers/br0ski777-web-scraper)
- **Repository:** <https://github.com/br0ski777/web-scraper-x402>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "br0ski777-web-scraper"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/br0ski777-web-scraper` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/br0ski777-web-scraper/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt