# tokenizer-mcp

> tokenizer-mcp — the-phase-space-tokenizer-mcp. Use this tool when you need to analyze text or files and count tokens with model-specific accuracy, or when requiring detailed file metrics such as lines, characters, and size. It solves problems related to text processing, file analysis, and data preparation for machine learning models. The tokenizer-mcp server takes text or file inputs and outputs token counts and file metrics, making it ideal for use cases involving natural language processing and data preprocessing.

Canonical page: https://skillsregistry.net/skills/the-phase-space-tokenizer-mcp  
JSON: https://api.skillsregistry.net/v1/skills/the-phase-space-tokenizer-mcp

## Description

An MCP server for counting tokens in text or files using model-specific tokenizers, and reporting file metrics like lines, characters, and size.

## Trust

- **Trust score (0–1):** 0.70
- **Verification tier:** verified
- **Last scanned:** 2026-08-28

## Facts

- **Version:** 1.0.0
- **Skill type:** atomic
- **Execution layer:** mcp-remote
- **Runtime environment:** api
- **Category:** data-analytics
- **Updated:** 2026-08-28

## Source

- **Source listing:** [Glama](https://glama.ai/mcp/servers/r44ot9sueh)
- **Repository:** <https://github.com/the-phase-space/tokenizer-mcp>

## Use it

Resolve this record through the SkillsRegistry MCP server (no auth, read-only):

```
claude mcp add --transport http --scope user skillsregistry https://api.skillsregistry.net/mcp
```

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "get_skill",
    "arguments": {
      "slug": "the-phase-space-tokenizer-mcp"
    }
  }
}
```

REST: `GET https://api.skillsregistry.net/v1/skills/the-phase-space-tokenizer-mcp` · pull for local use: `GET https://api.skillsregistry.net/v1/skills/the-phase-space-tokenizer-mcp/pull`

---
SkillsRegistry indexes agent skills from public registries and GitHub. Skills we have analysed are scanned with Circle-IR and scored on six dimensions; each listing states its scan coverage. More: https://skillsregistry.net/llms.txt