# PySpark

> Use this tool when you need to execute distributed data processing jobs and run SQL queries against large datasets. It solves problems related to big data processing, data transformation, and query execution, providing inputs such as PySpark SQL queries and outputs like query results and schema inspections. Ideal for use cases involving Apache Spark clusters and data pipelines, it enables efficient data processing and analysis through the MCP protocol.

Canonical page: https://skillsregistry.net/skills/annasmazhar-pyspark  
JSON: https://api.skillsregistry.net/v1/skills/annasmazhar-pyspark

## Description

This MCP server enables AI assistants to run PySpark SQL queries and data transformations against Apache Spark clusters. It provides tools for executing distributed data processing jobs, inspecting schemas, and retrieving query results, making Spark-based data pipelines accessible through the MCP protocol.

## Trust

- **Trust score (0–1):** 0.23
- **Verification tier:** scanned
- **Last scanned:** 2026-09-01

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** database
- **Updated:** 2026-09-01

## Source

- **Source listing:** [PulseMCP](https://www.pulsemcp.com/servers/annasmazhar-pyspark)
- **Repository:** <https://github.com/annasmazhar/pyspark_mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "annasmazhar-pyspark"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/annasmazhar-pyspark` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/annasmazhar-pyspark/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt