Skip to content

PaddleOCR MCP Server

PaddleOCR FastMCP

This project provides a lightweight Model Context Protocol (MCP) server designed to integrate PaddleOCR capabilities into various LLM applications.

Key Features

  • Currently Supported Tools
    • OCR: Performs text detection and recognition on images and PDF files.
    • PP-StructureV3: Identifies and extracts text blocks, titles, paragraphs, images, tables, and other layout elements from images or PDF files, converting the input into Markdown documents.
    • PaddleOCR-VL: Identifies and extracts text blocks, titles, paragraphs, images, tables, and other layout elements from images or PDF files, converting the input into Markdown documents. A VLM-based approach is used.
  • Supported Working Modes
    • Local Python Library: Runs PaddleOCR pipelines directly on the local machine. This mode requires a suitable local environment and hardware, and is ideal for offline use or privacy-sensitive scenarios.
    • PaddleOCR Official Website Service: Invokes services provided by the PaddleOCR Official Website. This is suitable for quick testing, prototyping, or no-code scenarios.
    • Qianfan Platform Service: Calls the cloud services provided by Baidu AI Cloud's Qianfan large model platform.
    • Self-hosted Service: Invokes the user's self-hosted PaddleOCR services. This mode offers the advantages of serving and high flexibility. It is suitable for scenarios requiring customized service configurations, as well as those with strict data privacy requirements. Currently, only the basic serving solution is supported.

Examples:

The following showcases creative use cases built with PaddleOCR MCP server combined with other tools:

Demo 1

In Claude for Desktop, extract handwritten content from images and save to note-taking software Notion. The PaddleOCR MCP server extracts text, formulas and other information from images while preserving document structure.

note_to_notion note
  • Note: In addition to the PaddleOCR MCP server, this demo also uses the Notion MCP server.

Demo 2

In VSCode, convert handwritten ideas or pseudocode into runnable Python scripts that comply with project coding standards with one click, and upload them to GitHub repositories. The PaddleOCR MCP server extracts explicitly handwritten code from images for subsequent processing.

code_to_github

Demo 3

In Claude for Desktop, convert PDF documents or images containing complex tables, formulas, handwritten text and other content into locally editable files.

Demo 3.1

Convert complex PDF documents with tables and watermarks to editable doc/Word format:

pdf_to_file

Demo 3.2

Convert images containing formulas and tables to editable csv/Excel format:

table_to_excel1 table_to_excel2 table_to_excel3

Table of Contents

1. Installation

This section explains how to install the paddleocr-mcp library via pip.

  • For the local Python library mode, in addition to installing paddleocr-mcp, you also need to install the PaddlePaddle framework and PaddleOCR by referring to the PaddleOCR installation guide.
  • For the local Python library mode, you may also consider installing the corresponding optional dependencies:
  • paddleocr-mcp[local]: includes PaddleOCR (without the PaddlePaddle framework).
  • paddleocr-mcp[local-cpu]: based on local, additionally includes the CPU version of the PaddlePaddle framework.
  • PaddleOCR also supports running the server without installation through methods like uvx. For details, please refer to the instructions in 2. Using with Claude for Desktop.

To install paddleocr-mcp using pip:

# Install from PyPI
pip install -U paddleocr-mcp

# Install from source
git clone https://github.com/PaddlePaddle/PaddleOCR.git
pip install -e mcp_server

# Install with optional extras (choose ONE of the following if you prefer convenience installs)
# Install PaddleOCR together with the MCP server (framework not included):
pip install "paddleocr-mcp[local]"
# Install PaddleOCR and CPU PaddlePaddle framework together:
pip install "paddleocr-mcp[local-cpu]"

To verify successful installation:

paddleocr_mcp --help

If the help message is printed, the installation succeeded.

2. Using with Claude for Desktop

This section explains how to use the PaddleOCR MCP server within Claude for Desktop. The steps are also applicable to other MCP hosts with minor adjustments.

2.1 Quick Start

  1. Install paddleocr-mcp

    Refer to 1. Installation. To avoid dependency conflicts, it is strongly recommended to install in an isolated virtual environment.

  2. Install PaddleOCR

    Install the PaddlePaddle framework and PaddleOCR, as per the PaddleOCR installation documentation.

  3. Add MCP Server Configuration

    Locate the claude_desktop_config.json configuration file:

    • macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
    • Windows: %APPDATA%\Claude\claude_desktop_config.json
    • Linux: ~/.config/Claude/claude_desktop_config.json

    Edit the file as follows:

    {
      "mcpServers": {
        "paddleocr-ocr": {
          "command": "paddleocr_mcp",
          "args": [],
          "env": {
            "PADDLEOCR_MCP_PIPELINE": "OCR",
            "PADDLEOCR_MCP_PPOCR_SOURCE": "local"
          }
        }
      }
    }
    

    Notes:

    • PADDLEOCR_MCP_PIPELINE should be set to the pipeline name. See Section 4 for more details.
    • PADDLEOCR_MCP_PIPELINE_CONFIG is optional; if not set, the default pipeline configuration will be used. If you need to adjust the configuration, such as changing the model, please refer to the PaddleOCR documentation to export the pipeline configuration file, and set PADDLEOCR_MCP_PIPELINE_CONFIG to the absolute path of this configuration file.

    • Inference Performance Tips:

      If you encounter issues such as long inference time or insufficient memory during use, you may consider adjusting the pipeline configuration according to the following recommendations.

      • OCR Pipeline: It is recommended to switch to the mobile series models. For example, you can modify the pipeline configuration file to use PP-OCRv5_mobile_det for detection and PP-OCRv5_mobile_rec for recognition.

      • PP-StructureV3 Pipeline:

        • Disable unused features, e.g., set use_formula_recognition to False to disable formula recognition.
        • Use lightweight models, such as replacing the OCR model with the mobile version or switching to a lightweight formula recognition model like PP-FormulaNet-S.

        The following sample code can be used to obtain the pipeline configuration file, in which most optional features of the PP-StructureV3 pipeline are disabled, and some key models are replaced with lightweight versions.

        from paddleocr import PPStructureV3
        
        pipeline = PPStructureV3(
            use_doc_orientation_classify=False, # Disable document image orientation classification
            use_doc_unwarping=False,            # Disable text image unwarping
            use_textline_orientation=False,     # Disable text line orientation classification
            use_formula_recognition=False,      # Disable formula recognition
            use_seal_recognition=False,         # Disable seal text recognition
            use_table_recognition=False,        # Disable table recognition
            use_chart_recognition=False,        # Disable chart parsing
            # Use lightweight models
            text_detection_model_name="PP-OCRv5_mobile_det",
            text_recognition_model_name="PP-OCRv5_mobile_rec",
            layout_detection_model_name="PP-DocLayout-S",
        )
        
        # The configuration file is saved to `PP-StructureV3.yaml`
        pipeline.export_paddlex_config_to_yaml("PP-StructureV3.yaml")
        

      For PaddleOCR-VL, it is note recommended to use CPUs for inference.

    Important:

    • If paddleocr_mcp is not in your system's PATH, set command to the absolute path of the executable.
  4. Restart the MCP Host

    Restart Claude for Desktop. The paddleocr-ocr tool should now be available in the application.

2.2 MCP Host Configuration Details

In the configuration file for Claude for Desktop, you need to define how the MCP server is started. The key fields are as follows:

  • command: paddleocr_mcp (if the executable can be found in the PATH) or the absolute path.
  • args: Configurable command-line arguments, such as ["--verbose"]. See 4. Parameter Reference for details.
  • env: Configurable environment variables. See 4. Parameter Reference for details.

2.3 Working Modes Explained

You can configure the MCP server according to your requirements to run in different working modes. The operational procedures vary for different modes, which will be explained in detail below.

Mode 1: Local Python Library

See 2.1 Quick Start.

Mode 2: PaddleOCR Official Website Service

  1. Install paddleocr-mcp.
  2. Obtain the service base URL and AI Studio Community access token.

    On this page, click "API" in the upper-left corner. Copy the API_URL corresponding to "Text Recognition (PP-OCRv5)", and remove the trailing endpoint (/ocr) to get the base URL of the service (e.g., https://xxxxxx.aistudio-app.com). Also copy the TOKEN, which is your access token. You may need to register and log in to your PaddlePaddle AI Studio Community account.

  3. Refer to the configuration example below to modify the contents of the claude_desktop_config.json file.

  4. Restart the MCP host.

Configuration example:

{
  "mcpServers": {
    "paddleocr-ocr": {
      "command": "paddleocr_mcp",
      "args": [],
      "env": {
        "PADDLEOCR_MCP_PIPELINE": "OCR",
        "PADDLEOCR_MCP_PPOCR_SOURCE": "aistudio",
        "PADDLEOCR_MCP_SERVER_URL": "<your-server-url>", 
        "PADDLEOCR_MCP_AISTUDIO_ACCESS_TOKEN": "<your-access-token>"
      }
    }
  }
}

Notes:

  • PADDLEOCR_MCP_PIPELINE should be set to the pipeline name. See Section 4 for more details.
  • Replace <your-server-url> with your service base URL.
  • Replace <your-access-token> with your access token.

Important:

  • Do not expose your access token.

Mode 3: Qianfan Platform Services

  1. Install paddleocr-mcp.
  2. Obtain an API key by referring to the Qianfan Platform Official Documentation.
  3. Modify the claude_desktop_config.json file according to the configuration example below. Set PADDLEOCR_MCP_QIANFAN_API_KEY to your Qianfan platform API key.
  4. Restart the MCP host.

Configuration example:

{
  "mcpServers": {
    "paddleocr-ocr": {
      "command": "paddleocr_mcp",
      "args": [],
      "env": {
        "PADDLEOCR_MCP_PIPELINE": "PaddleOCR-VL",
        "PADDLEOCR_MCP_PPOCR_SOURCE": "qianfan",
        "PADDLEOCR_MCP_SERVER_URL": "https://qianfan.baidubce.com/v2/ocr",
        "PADDLEOCR_MCP_QIANFAN_API_KEY": "<your-api-key>"
      }
    }
  }
}

Note:

  • The Qianfan platform service currently only supports PaddleOCR-VL.

Mode 4: Self-hosted Service

  1. In the environment where you need to run the PaddleOCR inference server, run the inference server as per the PaddleOCR serving documentation.
  2. Install paddleocr-mcp where the MCP server will run.
  3. Refer to the configuration example below to modify the contents of the claude_desktop_config.json file. Set PADDLEOCR_MCP_SERVER_URL (e.g., "http://127.0.0.1:8000").
  4. Restart the MCP host.

Configuration example:

{
  "mcpServers": {
    "paddleocr-ocr": {
      "command": "paddleocr_mcp",
      "args": [],
      "env": {
        "PADDLEOCR_MCP_PIPELINE": "OCR",
        "PADDLEOCR_MCP_PPOCR_SOURCE": "self_hosted",
        "PADDLEOCR_MCP_SERVER_URL": "<your-server-url>"
      }
    }
  }
}

Note:

  • PADDLEOCR_MCP_PIPELINE should be set to the pipeline name. See Section 4 for more details.
  • Replace <your-server-url> with your service’s base URL (e.g., http://127.0.0.1:8000).

2.4 Using uvx

PaddleOCR also supports starting the MCP server via uvx. With this approach, manual installation of paddleocr-mcp is not required. The main steps are as follows:

  1. Install uv.
  2. Modify claude_desktop_config.json. Examples:

Self-hosted mode:

```json
{
  "mcpServers": {
    "paddleocr-ocr": {
      "command": "uvx",
      "args": [
        "--from",
        "paddleocr-mcp",
        "paddleocr_mcp"
      ],
      "env": {
        "PADDLEOCR_MCP_PIPELINE": "OCR",
        "PADDLEOCR_MCP_PPOCR_SOURCE": "self_hosted",
        "PADDLEOCR_MCP_SERVER_URL": "<your-server-url>"
      }
    }
  }
}
```

Local mode (inference on CPUs, using the `local-cpu` extra):

```json
{
  "mcpServers": {
    "paddleocr-ocr": {
      "command": "uvx",
      "args": [
        "--from",
        "paddleocr_mcp[local-cpu]",
        "paddleocr_mcp"
      ],
      "env": {
        "PADDLEOCR_MCP_PIPELINE": "OCR",
        "PADDLEOCR_MCP_PPOCR_SOURCE": "local"
      }
    }
  }
}
```

For information on local mode dependencies, performance tuning, and production configuration, please refer to the [3.1 Quick Start](#21-quick-start) section.

Due to the use of a different startup method, the `command` and `args` settings in the configuration file differ from the previously described approach. However, the command-line arguments and environment variables supported by the MCP service (such as `PADDLEOCR_MCP_SERVER_URL`) can still be set in the same way.

3. Running the Server

In addition to MCP hosts like Claude for Desktop, you can also run the PaddleOCR MCP server via the CLI.

To view help:

paddleocr_mcp --help

Example commands:

# OCR + PaddleOCR official website service + stdio
PADDLEOCR_MCP_AISTUDIO_ACCESS_TOKEN=xxxxxx paddleocr_mcp --pipeline OCR --ppocr_source aistudio --server_url https://xxxxxx.aistudio-hub.baidu.com

# PP-StructureV3 + local Python library + stdio
paddleocr_mcp --pipeline PP-StructureV3 --ppocr_source local

# OCR + self-hosted service + Streamable HTTP
paddleocr_mcp --pipeline OCR --ppocr_source self_hosted --server_url http://127.0.0.1:8080 --http

You can find all the supported parameters of the PaddleOCR MCP server in 4. Parameter Reference.

4. Parameter Reference

You can control the MCP server via environment variables or CLI arguments.

Environment Variable CLI Argument Type Description Options Default
PADDLEOCR_MCP_PIPELINE --pipeline str Pipeline to run. "OCR", "PP-StructureV3", "PaddleOCR-VL" "OCR"
PADDLEOCR_MCP_PPOCR_SOURCE --ppocr_source str Source of PaddleOCR capabilities. "local" (local Python library), "aistudio" (PaddleOCR official website service), "qianfan" (Qianfan platform service), "self_hosted" (self-hosted service) "local"
PADDLEOCR_MCP_SERVER_URL --server_url str Base URL for the underlying service (required for aistudio, qianfan, or self_hosted modes). - None
PADDLEOCR_MCP_AISTUDIO_ACCESS_TOKEN --aistudio_access_token str AI Studio access token (required for aistudio mode). - None
PADDLEOCR_MCP_TIMEOUT --timeout int Read timeout for the underlying requests (seconds). - 60
PADDLEOCR_MCP_DEVICE --device str Device for inference (local mode only). - None
PADDLEOCR_MCP_PIPELINE_CONFIG --pipeline_config str Path to pipeline config file (local mode only). - None
- --http bool Use Streamable HTTP instead of stdio (for remote/multi-client use). - False
- --host str Host for the Stremable HTTP mode. - "127.0.0.1"
- --port int Port for the Streamable HTTP mode. - 8000
- --verbose bool Enable verbose logging for debugging. - False

5. Known Limitations

  • In the local Python library mode, the current tools cannot process PDF document inputs that are Base64 encoded.
  • In the local Python library mode, the current tools do not infer the file type based on the model's file_type prompt, and may fail to process some complex URLs.
  • For the PP-StructureV3 and PaddleOCR-VL pipelines, if the input file contains images, the returned results may significantly increase token usage. If image content is not needed, you can explicitly exclude it through prompts to reduce resource consumption.

Comments