Qwen2.5-Omni-7B

Language Alibaba Qwen Partly verified Released Mar 26, 2025
  • In Input modalities: TextImageAudioVideo Out Output modalities: TextAudio
  • Open weights

Prices

2 offerings · prices as listed
Alibaba Cloud Model Studio (opens in a new tab) Official International · USD qwen2.5-omni-7b
Conditions/ 1M tokensInputOutput
Text tokens no longer listed since Oct 11, 2026 $0.10—
Image tokens no longer listed since Oct 11, 2026 $0.28—
Audio tokens no longer listed since Oct 11, 2026 $6.76$13.51
Video tokens no longer listed since Oct 11, 2026 $0.28—

Prices from Alibaba Cloud Model Studio pricing (opens in a new tab) (checked Oct 10, 2026)

Alibaba Cloud Model Studio (opens in a new tab) Official China · CNY qwen2.5-omni-7b
Conditions/ 1M tokensInputOutput
Text tokens no longer listed since Oct 11, 2026 ¥0.60—
Image tokens no longer listed since Oct 11, 2026 ¥2.00—
Audio tokens no longer listed since Oct 11, 2026 ¥38.00¥76.00
Video tokens no longer listed since Oct 11, 2026 ¥2.00—

Prices from 阿里云百炼:模型价格 (opens in a new tab) (checked Oct 6, 2026)

Standard: the price a request with no conditions pays (the headline price elsewhere on the site).

Details

Max input
30.72K
Reasoning
—
Tool use
—
Structured output
—
Knowledge cutoff
Apr 2024
Family
qwen-omni
Model ID

Not stated on Alibaba Qwen’s pages: reasoning efforts, reasoning can be off, max thinking budget, built-in tools, licence, aliases.

Run locally

Weights: Qwen/Qwen2.5-Omni-7B
  • Parameters 10.7B
  • Dense
  • Native precision BF16
  • Layers 28
  • KV cache per token 56 KB
  • Config positions 32K (config.json max_position_embeddings)
  • API context 32K (maker’s API)
My hardware GeForce RTX 4090 24 GB · 1008 GB/s · 64 GB DDR5 dual channel · 89.6 GB/s
On your hardware · GeForce RTX 4090
Runs well Q8_0 (automatic) 8K context 42–64 tok/sOne GPU
WeightsKV cacheOverheadUsable
Needs
≈ 11.6 GB (weights 10.6 + KV cache 0.4 + overhead 0.5)
Usable
21.6 GB (90% of its memory)
Generation speed
42–64 tok/s
Longest context
32K (the model’s limit)
First token
about 0.35–0.52 s for a 2K prompt
PrecisionWeightsNeeds at 8KOn your hardwareLongest context
BF16 (native)maker’s file20.8 GB≈ 22.3Needs system memory 16–25 tok/s—
Q8_010.6 GB≈ 11.6Runs well 42–64 tok/s32K
FP810.0 GB≈ 10.9Runs well 45–67 tok/s32K
Q6_K8.2 GB≈ 9.1Runs well 54–81 tok/s32K
Q5_K_M7.1 GB≈ 8.0Runs well 62–93 tok/s32K
Q5_06.9 GB≈ 7.8Runs well 64–96 tok/s32K
Q4_K_M6.1 GB≈ 7.0Runs well 72–108 tok/s32K
Q4_05.6 GB≈ 6.6Runs well 77–116 tok/s32K
INT4 (AWQ / GPTQ)maker’s file11.8 GB≈ 12.9Runs well 38–57 tok/s32K
IQ4_XS5.3 GB≈ 6.2Runs well 82–123 tok/s32K
Q3_K_Mquality drops4.9 GB≈ 5.8Runs well 88–132 tok/s32K
IQ3_XXSquality drops3.8 GB≈ 4.8Runs well 110–165 tok/s32K
Q2_Kquality drops3.7 GB≈ 4.7Runs well 112–168 tok/s32K
IQ2_XXSquality drops2.6 GB≈ 3.5Runs well 156–234 tok/s32K

Click a row to choose a precision. “Maker’s file” sizes are the maker’s own files; others are parameters × bits per weight.

Compared with other hardware

Each at the highest precision it runs. Click one for details.

Smallest that runs it (Q4_K_M, 8K): GPU GeForce RTX 3080; unified memory Apple M5 · 16 GB.

Run commands

The maker publishes no files at this precision. Choose its native precision or one of its own builds, or quantise it yourself with llama.cpp.

Memory to fine-tune
Full≈ 162.2 GBDoesn’t fit your hardware
LoRA≈ 22.4 GBDoesn’t fit your hardware
QLoRA≈ 8.0 GBFits your hardware

Batch 1, 2,048-token sequences, gradient checkpointing; LoRA and QLoRA train rank-16 adapters on the attention projections.

Estimates; facts from the maker’s Hugging Face repositories, as of 2026-11-06. How it’s estimated

Cited scores

From third-party leaderboards, not measured by us

This model isn’t on any leaderboard we cite yet.

No changes recorded yet.

Sources

Alibaba Qwen’s official policies: data use, privacy, terms →

Some values on this page are still waiting to be checked against official pages: a filled dot is verified, a hollow one is not yet (with or without a source on file). How we verify data

Alibaba Qwen · China · qwen.ai

Snapshots, the same family and other models from this provider