# Scrapy MCP Server

> Use this tool when you need to extract large amounts of data from websites efficiently and reliably, handling anti-scraping measures and complex web forms. It solves problems of data extraction, monitoring, and automation, providing outputs in various formats. Ideal for commercial web scraping applications, it accepts inputs such as URLs, scraping methods, and data extraction configurations.

Canonical page: https://skillsregistry.net/skills/threefish-ai-scrapy-mcp  
JSON: https://api.skillsregistry.net/v1/skills/threefish-ai-scrapy-mcp

## Description

A powerful web scraping MCP server built on Scrapy and FastMCP that supports multiple scraping methods (HTTP, Scrapy, browser automation), anti-detection techniques, form handling, and concurrent crawling. Designed for commercial environments with enterprise-grade features like intelligent retry mechanisms, performance monitoring, and configurable data extraction.

## Trust

- **Trust score (0–1):** 0.60
- **Verification tier:** unverified

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** browser-automation
- **Updated:** 2026-06-15

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/ycr4c3nsg3)
- **Repository:** <https://github.com/ThreeFish-AI/negentropy-perceives>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "threefish-ai-scrapy-mcp"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/threefish-ai-scrapy-mcp` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/threefish-ai-scrapy-mcp/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt