Spider Web Scraper
Spider MCP is a web search and scraping server implementation by Bosegluon that provides pure web scraping capabilities without relying on external search APIs. It integrates Puppeteer for browser automation and Cheerio for HTML parsing to perform web searches across Bing (including news search with time filters), scrape webpage content, and convert pages to Markdown format. The server supports batch processing of multiple URLs with configurable concurrency limits and includes comprehensive error handling, making it useful for competitive research, content analysis, and building AI assistants that need programmatic access to web data without API dependencies or rate limits.
Composite of vulnerability cleanliness, spec conformance, provenance, stability, and usage signals — scanned and weighted by Cognium. Human and agent signals are tracked separately. Last scanned 2026-09-28.
Scan details: Circle-IR · 2026-09-28 · Appeal
View full trust & usage report →Metadata
- Version
- 1.0.0
- Skill type
- atomic
- Execution layer
- mcp-remote
- Category
- browser-automation
- Source
- PulseMCP
- Repository
- github.com/yc9yc/spider-mcp
- Author type
- human
- Last scanned
- 2026-09-28
- Updated
- 2026-09-28
Use via MCP
Resolve Spider Web Scraper from your agent
Streamable HTTP transport at https://api.skillsregistry.net/mcp. No auth for read tools. Discovery: .well-known/mcp.json.
One command in your shell — Claude Code wires it up and verifies the connection. Run /mcp in any session to confirm.
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp--scope user for --scope project to commit it to .mcp.json.