# Spider MCP

> Use this tool when you need to extract data from webpages or perform web searches without relying on official APIs. It solves problems such as data collection, content extraction, and web research by providing batch webpage scraping and search functionality through Bing web and news search. The tool takes in search queries or webpage URLs as input and outputs extracted data and content through its crawler technology and Puppeteer automation interface.

Canonical page: https://skillsregistry.net/skills/yc9yc-spider-mcp  
JSON: https://api.skillsregistry.net/v1/skills/yc9yc-spider-mcp

## Description

Enables web searching and webpage scraping using pure crawler technology without requiring official APIs. Supports Bing web and news search, batch webpage scraping, and content extraction through Puppeteer automation.

## Trust

- **Trust score (0–1):** 0.82
- **Verification tier:** verified
- **Last scanned:** 2026-09-19

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** browser-automation
- **Updated:** 2026-09-19

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/k39gisxqjh)
- **Repository:** <https://github.com/yc9yc/spider-mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "yc9yc-spider-mcp"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/yc9yc-spider-mcp` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/yc9yc-spider-mcp/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt