# Python Crawling MCP

> Python Crawling MCP — baektothefuture98-crawl-mcp. Use this tool when you need to safely crawl and scrape public or authenticated websites, and require a secure and extensible solution for extracting web data. It solves problems related to web scraping, session validation, and site crawling, providing outputs such as scraped page data and lists of supported sites. With inputs including site URLs and authentication credentials, it is ideal for use cases involving data extraction, monitoring, and automation.

Canonical page: https://skillsregistry.net/skills/baektothefuture98-crawl-mcp  
JSON: https://api.skillsregistry.net/v1/skills/baektothefuture98-crawl-mcp

## Description

An MCP server for safe web crawling and scraping of public and authenticated sites using Playwright and Crawlee. It provides tools for scraping single pages, crawling entire sites, validating sessions, and listing supported sites, with built-in security protections and adapter-based extensibility.

## Trust

- **Trust score (0–1):** 0.51
- **Verification tier:** scanned
- **Last scanned:** 2026-09-03

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** browser-automation
- **Updated:** 2026-09-03

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/r3iuen3vp2)
- **Repository:** <https://github.com/BaektotheFuture98/Crawl_MCP>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "baektothefuture98-crawl-mcp"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/baektothefuture98-crawl-mcp` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/baektothefuture98-crawl-mcp/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt