# Web Scraper

> Use this tool when you need to extract clean and readable content from web pages, as it fetches URLs and returns markdown text, links, and metadata without requiring API keys or configuration. It solves problems such as data extraction, content summarization, and metadata collection, particularly for server-rendered pages like documentation sites and articles. It takes URLs as input and outputs markdown text, links, and metadata, making it ideal for batch scraping, in-page text search, and Open Graph tag extraction.

Canonical page: https://skillsregistry.net/skills/ofershap-web-scraper  
JSON: https://api.skillsregistry.net/v1/skills/ofershap-web-scraper

## Description

Fetches web pages and extracts clean, readable content using Mozilla Readability (the engine behind Firefox Reader View). Returns markdown text, links, and metadata from any URL without requiring API keys or configuration. Supports batch scraping of multiple URLs, in-page text search, and metadata extraction including Open Graph tags. Works well with server-rendered pages such as documentation sites, blog posts, and articles.

## Trust

- **Trust score (0–1):** 0.97
- **Verification tier:** verified
- **Last scanned:** 2026-09-19

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** browser-automation
- **Updated:** 2026-09-19

## Source

- **Source listing:** [PulseMCP](https://www.pulsemcp.com/servers/ofershap-web-scraper)
- **Repository:** <https://github.com/ofershap/mcp-server-scraper>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "ofershap-web-scraper"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/ofershap-web-scraper` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/ofershap-web-scraper/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt