DeepSeek-OCR

OCR DeepSeek Verified Released Oct 20, 2025
  • In Input modalities: TextImage
  • Open weights

Prices

1 offering · prices as listed
Alibaba Cloud Model Studio (opens in a new tab) Official Available on this channel since Apr 7, 2026 China · CNY vanchin/deepseek-ocr
Conditions/ 1M tokensInputOutput
Standard ¥0.216¥0.216

Prices from 阿里云百炼:模型价格 (opens in a new tab) (checked Nov 2, 2026)

Standard: the price a request with no conditions pays (the headline price elsewhere on the site).

Details

Licence
MIT
Model ID

Not stated on DeepSeek’s pages: output modalities, file formats, output formats, max file size (mb), context, max output, structured output, languages.

Run locally

Weights: deepseek-ai/DeepSeek-OCR
  • Parameters 3.3B
  • Active 1.1B (estimated) · 64 experts, 6 per token
  • Native precision BF16
  • Layers 12
  • KV cache per token 60 KB
  • Config positions 8K (config.json max_position_embeddings)
My hardware GeForce RTX 4090 24 GB · 1008 GB/s · 64 GB DDR5 dual channel · 89.6 GB/s
On your hardware · GeForce RTX 4090
Runs well BF16 (native) (automatic) 8K context 181–271 tok/sOne GPU
WeightsKV cacheOverheadUsable
Needs
≈ 7.2 GB (weights 6.2 (maker’s file) + KV cache 0.5 + overhead 0.5)
Usable
21.6 GB (90% of its memory)
Generation speed
181–271 tok/s (reads the active 1.1B per token)
Longest context
8K (the model’s limit)
First token
about 0.04–0.06 s for a 2K prompt
PrecisionWeightsNeeds at 8KOn your hardwareLongest context
BF16 (native)maker’s file6.2 GB≈ 7.2Runs well 181–271 tok/s8K
Q8_03.3 GB≈ 4.3Runs well 294–441 tok/s8K
FP83.1 GB≈ 4.1Runs well 307–460 tok/s8K
Q6_K2.6 GB≈ 3.5Runs well 350–525 tok/s8K
Q5_K_M2.2 GB≈ 3.2Runs well 383–575 tok/s8K
Q5_02.1 GB≈ 3.1Runs well 391–587 tok/s8K
Q4_K_M1.9 GB≈ 2.9Runs well 421–632 tok/s8K
Q4_01.7 GB≈ 2.7Runs well 440–660 tok/s8K
IQ4_XS1.7 GB≈ 2.6Runs well 454–681 tok/s8K
Q3_K_Mquality drops1.5 GB≈ 2.5Runs well 475–713 tok/s8K
IQ3_XXSquality drops1.2 GB≈ 2.2Runs well 536–804 tok/s8K
Q2_Kquality drops1.2 GB≈ 2.1Runs well 541–812 tok/s8K
IQ2_XXSquality drops0.8 GB≈ 1.8Runs well 632–948 tok/s8K

Click a row to choose a precision. “Maker’s file” sizes are the maker’s own files; others are parameters × bits per weight.

Compared with other hardware

Each at the highest precision it runs. Click one for details.

Smallest that runs it (Q4_K_M, 8K): GPU GeForce RTX 3080; unified memory Apple M5 · 16 GB.

Run commands

vLLM
vllm serve deepseek-ai/DeepSeek-OCR --max-model-len 8192
Memory to fine-tune
Full≈ 51.3 GBDoesn’t fit your hardware
LoRA≈ 7.9 GBFits your hardware
QLoRA≈ 3.4 GBFits your hardware

Batch 1, 2,048-token sequences, gradient checkpointing; LoRA and QLoRA train rank-16 adapters on the attention projections.

Estimates; facts from the maker’s Hugging Face repositories, as of 2026-11-06. How it’s estimated

Cited scores

From third-party leaderboards, not measured by us

No cited leaderboard covers OCR models yet. We will cite one when its license allows.

  1. New OCR model

Sources

DeepSeek’s official policies: data use, privacy, terms →

DeepSeek · China · deepseek.com