# web-scraper

> web-scraper — br0ski777-web-scraper-x402. Use this tool when you need to extract relevant content from websites, stripping unnecessary elements like navigation, ads, and scripts. It solves the problem of obtaining clean, structured markdown data from any URL, ideal for RAG pipelines and AI research agents. The web-scraper tool accepts URLs as input and outputs cleaned markdown, with a pay-per-call micropayment model via x402.

Canonical page: https://skillsregistry.net/skills/br0ski777-web-scraper-x402  
JSON: https://api.skillsregistry.net/v1/skills/br0ski777-web-scraper-x402

## Description

Enables extracting clean, structured markdown from any URL—stripping nav, ads, and scripts—for RAG pipelines and AI research agents, with pay-per-call micropayments via x402.

## Trust

- **Trust score (0–1):** 0.68
- **Verification tier:** scanned
- **Last scanned:** 2026-09-04

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** devops-ci
- **Updated:** 2026-09-04

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/fkp3hxs2e4)
- **Repository:** <https://github.com/Br0ski777/web-scraper-x402>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "br0ski777-web-scraper-x402"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/br0ski777-web-scraper-x402` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/br0ski777-web-scraper-x402/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt
