# PyAutoGUI

> Use this tool when you need to automate GUI interactions or test desktop applications through a Python interface. It solves problems such as automating repetitive tasks, creating test scripts, and enabling AI systems to interact with visual interfaces by providing inputs like mouse movements and keyboard input, and outputs like screenshots and image recognition. It is particularly useful in contexts where direct interaction with desktop applications is required, such as automated testing or AI-driven workflow automation.

Canonical page: https://skillsregistry.net/skills/hetaobackend-pyautogui  
JSON: https://api.skillsregistry.net/v1/skills/hetaobackend-pyautogui

## Description

MCP-PyAutoGUI-Server provides automated GUI testing and control capabilities through a Python-based interface. Developed by He Tao, this server wraps the PyAutoGUI library to enable AI assistants to control mouse movements, simulate keyboard input, take screenshots, and find images on screen across Windows, macOS, and Linux. The implementation offers tools for precise cursor positioning, clicking, typing text, pressing hotkeys, and screen analysis through a standardized protocol. It's particularly useful for automating repetitive GUI tasks, creating test scripts, or allowing AI systems to interact directly with desktop applications through visual interfaces.

## Trust

- **Trust score (0–1):** 0.50
- **Verification tier:** unverified

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** media
- **Updated:** 2026-05-22

## Source

- **Source listing:** [PulseMCP](https://www.pulsemcp.com/servers/hetaobackend-pyautogui)
- **Repository:** <https://github.com/hetaobackend/mcp-pyautogui-server>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "hetaobackend-pyautogui"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/hetaobackend-pyautogui` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/hetaobackend-pyautogui/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt