# Web Scraper

> Use this tool when you need to extract text content from web pages, as it solves the problem of complex HTML parsing and HTTP request management. It takes a target URL as input and returns clean text content as output, handling errors and connection issues along the way. Ideal for AI assistants, this tool streamlines web scraping tasks, providing a simple and efficient way to retrieve and analyze online data.

Canonical page: https://skillsregistry.net/skills/un4ckn0wl3z-web-scraper  
JSON: https://api.skillsregistry.net/v1/skills/un4ckn0wl3z-web-scraper

## Description

A lightweight MCP server for web scraping that provides a simple tool to extract content from web pages using BeautifulSoup and HTTPX. The implementation features a single function that handles HTTP requests with proper headers, follows redirects, and processes the response to return clean text content from the target URL. It includes error handling to gracefully manage failed requests and connection issues. This server is ideal for AI assistants that need to retrieve and analyze text content from websites without dealing with the complexities of HTML parsing or HTTP request management.

## Trust

- **Trust score (0–1):** 0.94
- **Verification tier:** verified
- **Last scanned:** 2026-09-28

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** browser-automation
- **Updated:** 2026-09-28

## Source

- **Source listing:** [PulseMCP](https://www.pulsemcp.com/servers/un4ckn0wl3z-web-scraper)
- **Repository:** <https://github.com/un4ckn0wl3z/mcp-scraper-engine>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "un4ckn0wl3z-web-scraper"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/un4ckn0wl3z-web-scraper` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/un4ckn0wl3z-web-scraper/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt