DeepSeek-R1-Distill-Qwen-7B

Language DeepSeek Partly verified Released Feb 5, 2025
  • In Input modalities: Text Out Output modalities: Text
  • Reasoning
  • Open weights

Prices

1 offering · prices as listed
Alibaba Cloud Model Studio (opens in a new tab) Official Available on this channel since Feb 5, 2025 China · CNY Context: 32.77KReasoning: YesTool use: —Structured output: —Max output: 16.38KInput modalities: TextOutput modalities: Text deepseek-r1-distill-qwen-7b
Conditions/ 1M tokensInputOutput
Standard no longer listed since Oct 11, 2026 ¥0.50¥1.00

Prices from 阿里云百炼:模型价格 (opens in a new tab) (checked Oct 8, 2026)

Standard: the price a request with no conditions pays (the headline price elsewhere on the site).

Details

Tool use
—
Structured output
—
Licence
MIT License
Family
deepseek-r-distill-qwen
Model ID

Not stated on DeepSeek’s pages: max input, reasoning efforts, reasoning can be off, max thinking budget, built-in tools, knowledge cutoff, aliases.

  • Parameters 7.6B
  • Dense
  • Native precision BF16
  • Layers 28
  • KV cache per token 56 KB
  • Config positions 128K (config.json max_position_embeddings)
  • API context 32K (maker’s API)
My hardware GeForce RTX 4090 24 GB · 1008 GB/s · 64 GB DDR5 dual channel · 89.6 GB/s
On your hardware · GeForce RTX 4090
Runs well BF16 (native) (automatic) 8K context 32–48 tok/sOne GPU
WeightsKV cacheOverheadUsable
Needs
≈ 15.3 GB (weights 14.2 (maker’s file) + KV cache 0.4 + overhead 0.7)
Usable
21.6 GB (90% of its memory)
Generation speed
32–48 tok/s
Longest context
32K (the model’s limit)
First token
about 0.25–0.37 s for a 2K prompt
PrecisionWeightsNeeds at 8KOn your hardwareLongest context
BF16 (native)maker’s file14.2 GB≈ 15.3Runs well 32–48 tok/s32K
Q8_07.5 GB≈ 8.5Runs well 59–88 tok/s32K
FP87.1 GB≈ 8.0Runs well 62–94 tok/s32K
Q6_K5.8 GB≈ 6.8Runs well 75–112 tok/s32K
Q5_K_M5.0 GB≈ 6.0Runs well 86–128 tok/s32K
Q5_04.9 GB≈ 5.8Runs well 88–133 tok/s32K
Q4_K_M4.3 GB≈ 5.2Runs well 99–148 tok/s32K
Q4_04.0 GB≈ 4.9Runs well 106–159 tok/s32K
IQ4_XS3.8 GB≈ 4.7Runs well 112–167 tok/s32K
Q3_K_Mquality drops3.5 GB≈ 4.4Runs well 120–180 tok/s32K
IQ3_XXSquality drops2.7 GB≈ 3.7Runs well 149–223 tok/s32K
Q2_Kquality drops2.7 GB≈ 3.6Runs well 152–227 tok/s32K
IQ2_XXSquality drops1.8 GB≈ 2.8Runs well 207–311 tok/s32K

Click a row to choose a precision. “Maker’s file” sizes are the maker’s own files; others are parameters × bits per weight.

Compared with other hardware

Each at the highest precision it runs. Click one for details.

Smallest that runs it (Q4_K_M, 8K): GPU GeForce RTX 3080; unified memory Apple M5 · 16 GB.

Run commands

vLLM
vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-7B --max-model-len 8192
Memory to fine-tune
Full≈ 115.8 GBDoesn’t fit your hardware
LoRA≈ 16.6 GBFits your hardware
QLoRA≈ 6.4 GBFits your hardware

Batch 1, 2,048-token sequences, gradient checkpointing; LoRA and QLoRA train rank-16 adapters on the attention projections.

Estimates; facts from the maker’s Hugging Face repositories, as of 2026-11-06. How it’s estimated

Cited scores

From third-party leaderboards, not measured by us

This model isn’t on any leaderboard we cite yet.

  1. Now priced on Alibaba Cloud Model Studio, China Input ¥0.50 · Output ¥1.00
  2. Context window 128K → 32.77K

Sources

DeepSeek’s official policies: data use, privacy, terms →

Some values on this page are still waiting to be checked against official pages: a filled dot is verified, a hollow one is not yet (with or without a source on file). How we verify data

DeepSeek · China · deepseek.com

Snapshots, the same family and other models from this provider