# Web Scraper

> Use this tool when you need to retrieve and process web content without direct internet access, for tasks such as AI-assisted web research, content summarization, and data extraction. It connects to a locally running web scraper, providing a local API for accessing website content in markdown format. The tool accepts website URLs and optional parameters like user agent and custom headers, outputting the retrieved content for further processing.

Canonical page: https://skillsregistry.net/skills/vishwajeetdabholkar-web-scraper  
JSON: https://api.skillsregistry.net/v1/skills/vishwajeetdabholkar-web-scraper

## Description

This MCP server connects Claude for Desktop to a locally running eGet web scraper, enabling Claude to retrieve and process web content through a local API. Built with Python using FastMCP and httpx, it provides two main tools: a basic scraper for retrieving website content in markdown format, and an advanced scraper with additional options like mobile user agent simulation and custom headers. The implementation handles API communication with proper error management and offers flexible content retrieval options, making it particularly useful for AI-assisted web research, content summarization, and data extraction without requiring direct internet access from Claude.

## Trust

- **Trust score (0–1):** 0.99
- **Verification tier:** verified
- **Last scanned:** 2026-09-19

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** browser-automation
- **Updated:** 2026-09-19

## Source

- **Source listing:** [PulseMCP](https://www.pulsemcp.com/servers/vishwajeetdabholkar-web-scraper)
- **Repository:** <https://github.com/vishwajeetdabholkar/eget_mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "vishwajeetdabholkar-web-scraper"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/vishwajeetdabholkar-web-scraper` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/vishwajeetdabholkar-web-scraper/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt