# Crawlab

> Use this tool when you need to streamline web scraping and data extraction workflows by integrating AI applications with a distributed crawler admin platform. It solves problems related to task automation, spider management, and resource access, providing a bridge between AI and Crawlab's web-based platform. With inputs from AI applications and outputs to Crawlab's API, it enables efficient data extraction and workflow automation in various contexts.

Canonical page: https://skillsregistry.net/skills/crawlab-team-crawlab  
JSON: https://api.skillsregistry.net/v1/skills/crawlab-team-crawlab

## Description

This MCP server provides a bridge between AI applications and Crawlab, a web-based distributed crawler admin platform. Developed by the Crawlab team, it offers tools for spider and task management, file operations, and resource access. The server uses FastMCP and integrates with Crawlab's API, enabling AI-driven web scraping, task automation, and data extraction workflows.

## Trust

- **Trust score (0–1):** 0.86
- **Verification tier:** verified
- **Last scanned:** 2026-09-19

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** browser-automation
- **Updated:** 2026-09-19

## Source

- **Source listing:** [PulseMCP](https://www.pulsemcp.com/servers/crawlab-team-crawlab)
- **Repository:** <https://github.com/crawlab-team/crawlab-mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "crawlab-team-crawlab"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/crawlab-team-crawlab` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/crawlab-team-crawlab/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt