# agent-web-scraper-mcp

> Use this tool when you need to extract data from websites for AI agents, as it solves problems such as text extraction, metadata retrieval, and link discovery. It takes URLs and CSS selectors as inputs and outputs clean text, markdown, screenshots, links, and metadata, making it a versatile web scraping solution. Ideal for use cases where automated data collection from websites is necessary, with a free tier allowing up to 50 requests per IP per day.

Canonical page: https://skillsregistry.net/skills/aparajithn-agent-scraper-mcp  
JSON: https://api.skillsregistry.net/v1/skills/aparajithn-agent-scraper-mcp

## Description

Web scraping MCP server for Al agents. 6 tools: extract clean text/markdown from any URL, structured scraping with CSS selectors, full-page screenshots via Playwright, link extraction with regex filtering, metadata extraction (OG tags, Twitter cards), and Google search. Free tier: 50 requests/IP/day.

## Trust

- **Trust score (0–1):** 0.93
- **Verification tier:** verified
- **Last scanned:** 2026-09-28

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** browser-automation
- **Updated:** 2026-09-28

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/tpfdjamxq3)
- **Repository:** <https://github.com/aparajithn/agent-scraper-mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "aparajithn-agent-scraper-mcp"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/aparajithn-agent-scraper-mcp` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/aparajithn-agent-scraper-mcp/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt