Ming-3.0-audio-flash

Language Ant Group Partly verified Released Oct 19, 2026
  • In Input modalities: TextAudio
  • Open weights

Prices

0 offerings · prices as listed

No priced offering is listed for this model yet.

Details

Family
ming-audio-flash

Not stated on Ant Group’s pages: max input, output modalities, reasoning, reasoning efforts, reasoning can be off, max thinking budget, tool use, structured output, built-in tools, knowledge cutoff, licence, aliases.

  • Parameters 128.2B
  • Active 6.5B · 512 experts, 8 per token
  • Native precision BF16
  • Layers 42
  • KV cache per token 47 KB
  • Config positions 128K (config.json max_position_embeddings)
My hardware GeForce RTX 4090 24 GB · 1008 GB/s · 64 GB DDR5 dual channel · 89.6 GB/s
On your hardware · GeForce RTX 4090
Needs system memory Q4_K_M (automatic) 8K context 14–22 tok/s32/42 layers in system memory
WeightsKV cacheOverheadIn system memoryUsable
Needs
≈ 76.5 GB (weights 72.5 + KV cache 0.4 + overhead 3.6)
Usable
21.6 GB (90% of its memory)
In system memory
55.3 GB · 10/42 layers on the GPU (--n-gpu-layers 10)
Generation speed
14–22 tok/s (reads the active 6.5B per token)
First token
about 0.21–0.31 s for a 2K prompt
PrecisionWeightsNeeds at 8KOn your hardwareLongest context
BF16 (native)maker’s file238.8 GB≈ 251.1Doesn’t fit—
Q8_0126.8 GB≈ 133.6Doesn’t fit—
FP8119.4 GB≈ 125.7Doesn’t fit—
Q6_K98.0 GB≈ 103.3Doesn’t fit—
Q5_K_M84.9 GB≈ 89.5Doesn’t fit—
Q5_082.1 GB≈ 86.5Doesn’t fit—
Q4_K_M72.5 GB≈ 76.5Needs system memory 14–22 tok/s—
Q4_067.2 GB≈ 70.9Needs system memory 16–24 tok/s—
IQ4_XS63.4 GB≈ 67.0Needs system memory 17–26 tok/s—
Q3_K_Mquality drops58.3 GB≈ 61.6Needs system memory 39–59 tok/s—
IQ3_XXSquality drops45.7 GB≈ 48.3Needs system memory 50–75 tok/s—
Q2_Kquality drops44.8 GB≈ 47.4Needs system memory 51–77 tok/s—
IQ2_XXSquality drops30.7 GB≈ 32.6Needs system memory 74–112 tok/s—

Click a row to choose a precision. “Maker’s file” sizes are the maker’s own files; others are parameters × bits per weight.

Compared with other hardware

Each at the highest precision it runs. Click one for details.

Smallest that runs it (Q4_K_M, 8K): GPU NVIDIA RTX PRO 6000 Blackwell Workstation Edition; unified memory Apple M5 Max (40-core GPU) · 128 GB.

Run commands

The maker publishes no files at this precision. Choose its native precision or one of its own builds, or quantise it yourself with llama.cpp.

Memory to fine-tune
Full≈ 1912.3 GBDoesn’t fit your hardware
LoRA≈ 241.3 GBDoesn’t fit your hardware
QLoRA≈ 69.7 GBDoesn’t fit your hardware

Batch 1, 2,048-token sequences, gradient checkpointing; LoRA and QLoRA train rank-16 adapters on the attention projections.

Estimates; facts from the maker’s Hugging Face repositories, as of 2026-11-06. How it’s estimated

Cited scores

From third-party leaderboards, not measured by us

This model isn’t on any leaderboard we cite yet.

  1. New language model

Sources

Some values on this page are still waiting to be checked against official pages: a filled dot is verified, a hollow one is not yet (with or without a source on file). How we verify data

Ant Group · China · developer.ant-ling.com

Snapshots, the same family and other models from this provider