# Spark Connect

> Use this tool when you need to query and analyze large datasets in Apache Spark and Databricks clusters. Spark Connect solves problems related to data exploration and analysis by providing a secure and controlled interface for DataFrame and SQL operations. It takes SQL queries and DataFrame inputs, returning query results while enforcing read-only operations and preventing unintended large data transfers.

Canonical page: https://skillsregistry.net/skills/icerhymers-spark-connect  
JSON: https://api.skillsregistry.net/v1/skills/icerhymers-spark-connect

## Description

Query Apache Spark and Databricks clusters through DataFrame and SQL tools. The server includes preflight size checks to prevent unintended large data operations and enforces read-only SQL by default, supporting both OSS Spark Connect and Databricks Connect backends.

## Trust

- **Trust score (0–1):** 0.65
- **Verification tier:** scanned
- **Last scanned:** 2026-09-02

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** database
- **Updated:** 2026-09-02

## Source

- **Source listing:** [PulseMCP](https://www.pulsemcp.com/servers/icerhymers-spark-connect)
- **Repository:** <https://github.com/icerhymers/spark-connect-mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "icerhymers-spark-connect"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/icerhymers-spark-connect` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/icerhymers-spark-connect/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt