# io.github.AnnasMazhar/pyspark-mcp

> Use this tool when you need to convert SQL queries to PySpark, generate AWS Glue jobs, or optimize Spark code for improved performance. It solves problems related to big data processing, ETL workflows, and cloud-based data integration, taking SQL queries as input and producing optimized PySpark code and AWS Glue job configurations as output. Ideal for data engineers and analysts working with large-scale data sets in cloud environments.

Canonical page: https://skillsregistry.net/skills/io-github-annasmazhar-pyspark-mcp  
JSON: https://api.skillsregistry.net/v1/skills/io-github-annasmazhar-pyspark-mcp

## Description

SQL to PySpark conversion, AWS Glue job generation, and Spark code optimization.

## Trust

- **Trust score (0–1):** 0.23
- **Verification tier:** scanned
- **Last scanned:** 2026-09-28

## Facts

- **Version:** 0.0.4
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** database
- **Updated:** 2026-09-28

## Source

- **Source listing:** [MCP Registry](https://registry.modelcontextprotocol.io/v0/servers/io.github.AnnasMazhar%2Fpyspark-mcp)
- **Repository:** <https://github.com/AnnasMazhar/pyspark_mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "io-github-annasmazhar-pyspark-mcp"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/io-github-annasmazhar-pyspark-mcp` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/io-github-annasmazhar-pyspark-mcp/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt