DeepSeek-R1 (2025-01-20)

Language DeepSeek Partly verified Released Jan 20, 2025
  • Open weights

Prices

0 offerings · prices as listed

No priced offering is listed for this model yet.

Details

Family
deepseek-r

Run locally

Weights: deepseek-ai/DeepSeek-R1
  • Parameters 684.5B
  • Active 51B (estimated) · 256 experts, 8 per token
  • Native precision FP8
  • Layers 61
  • KV cache per token 69 KB
  • Config positions 160K (config.json max_position_embeddings)
My hardware GeForce RTX 4090 24 GB · 1008 GB/s · 64 GB DDR5 dual channel · 89.6 GB/s
On your hardware · GeForce RTX 4090
Doesn’t fit IQ4_XS (automatic) 8K context
WeightsKV cacheOverheadUsable
Needs
≈ 356.1 GB (weights 338.7 + KV cache 0.5 + overhead 16.9)
Usable
21.6 GB (90% of its memory)
Try
it’s too large for this hardware; see the smallest that runs it below
PrecisionWeightsNeeds at 8KOn your hardwareLongest context
FP8 (native)maker’s file641.3 GB≈ 673.9Doesn’t fit—
Q6_K523.5 GB≈ 550.2Doesn’t fit—
Q5_K_M453.4 GB≈ 476.6Doesn’t fit—
Q5_0438.3 GB≈ 460.7Doesn’t fit—
Q4_K_M387.3 GB≈ 407.2Doesn’t fit—
Q4_0358.6 GB≈ 377.0Doesn’t fit—
IQ4_XS338.7 GB≈ 356.1Doesn’t fit—
Q3_K_Mquality drops311.6 GB≈ 327.7Doesn’t fit—
IQ3_XXSquality drops243.8 GB≈ 256.6Doesn’t fit—
Q2_Kquality drops239.1 GB≈ 251.5Doesn’t fit—
IQ2_XXSquality drops164.2 GB≈ 172.9Doesn’t fit—

Click a row to choose a precision. “Maker’s file” sizes are the maker’s own files; others are parameters × bits per weight.

Compared with other hardware

Each at the highest precision it runs. Click one for details.

Smallest that runs it (Q4_K_M, 8K): no single listed machine; about 6 × 80 GB GPUs.

Run commands

The maker publishes no files at this precision. Choose its native precision or one of its own builds, or quantise it yourself with llama.cpp.

Memory to fine-tune
Full≈ 10203.3 GBDoesn’t fit your hardware
LoRA≈ 1279.4 GBDoesn’t fit your hardware
QLoRA≈ 363.0 GBDoesn’t fit your hardware

Batch 1, 2,048-token sequences, gradient checkpointing; LoRA and QLoRA train rank-16 adapters on the attention projections.

Estimates; facts from the maker’s Hugging Face repositories, as of 2026-11-06. How it’s estimated

Cited scores

From third-party leaderboards, not measured by us

This model isn’t on any leaderboard we cite yet.

  1. New language model

Sources

DeepSeek’s official policies: data use, privacy, terms →

Some values on this page are still waiting to be checked against official pages: a filled dot is verified, a hollow one is not yet (with or without a source on file). How we verify data

DeepSeek · China · deepseek.com

Snapshots, the same family and other models from this provider