# magpie-mcp

> magpie-mcp — mbemera-magpie. Use this tool when you need to securely scrape web pages while respecting robots.txt and budgeting tokens, providing AI agents with parsed content like markdown, metadata, and structured data as output. It solves problems related to web data extraction, compliance, and content parsing, making it ideal for use cases involving large-scale web data collection. The magpie-mcp server takes URLs and token budgets as input, returning parsed and structured web content for further processing.

Canonical page: https://skillsregistry.net/skills/mbemera-magpie  
JSON: https://api.skillsregistry.net/v1/skills/mbemera-magpie

## Description

A secure web scraping MCP server for AI agents that fetches pages with token budgeting, robots.txt compliance, and injection warnings, providing parsed content like markdown, metadata, and structured data.

## Trust

- **Trust score (0–1):** 0.69
- **Verification tier:** scanned
- **Last scanned:** 2026-08-30

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** ai-ml
- **Updated:** 2026-08-30

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/gzzm25vmj2)
- **Repository:** <https://github.com/MBemera/magpie>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "mbemera-magpie"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/mbemera-magpie` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/mbemera-magpie/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt