WeMM Video 9B

Language Tencent Partly verified
  • In Input modalities: TextImage
  • Open weights

Prices

0 offerings · prices as listed

No priced offering is listed for this model yet.

Details

Licence
apache-2.0
Family
wemm-video

Run locally

Weights: tencent/WeMM-Video-9B
  • Parameters 10.5B
  • Dense
  • Native precision BF16
  • Layers 32
  • KV cache per token 32 KB
  • Config positions 256K (config.json max_position_embeddings)
My hardware GeForce RTX 4090 24 GB · 1008 GB/s · 64 GB DDR5 dual channel · 89.6 GB/s
On your hardware · GeForce RTX 4090
Runs well Q8_0 (automatic) 8K context 44–66 tok/sOne GPU
WeightsKV cacheOverheadUsable
Needs
≈ 11.1 GB (weights 10.4 + KV cache 0.3 + overhead 0.5)
Usable
21.6 GB (90% of its memory)
Generation speed
44–66 tok/s
Longest context
256K (the model’s limit)
First token
about 0.34–0.51 s for a 2K prompt
PrecisionWeightsNeeds at 8KOn your hardwareLongest context
BF16 (native)19.5 GB≈ 20.8Runs well 24–36 tok/s34K
Q8_010.4 GB≈ 11.1Runs well 44–66 tok/s256K
FP89.8 GB≈ 10.5Runs well 47–70 tok/s256K
Q6_K8.0 GB≈ 8.8Runs well 57–85 tok/s256K
Q5_K_M6.9 GB≈ 7.7Runs well 65–98 tok/s256K
Q5_06.7 GB≈ 7.5Runs well 67–101 tok/s256K
Q4_K_M5.9 GB≈ 6.7Runs well 76–114 tok/s256K
Q4_05.5 GB≈ 6.2Runs well 82–123 tok/s256K
IQ4_XS5.2 GB≈ 5.9Runs well 86–129 tok/s256K
Q3_K_Mquality drops4.8 GB≈ 5.5Runs well 93–140 tok/s256K
IQ3_XXSquality drops3.7 GB≈ 4.5Runs well 118–177 tok/s256K
Q2_Kquality drops3.7 GB≈ 4.4Runs well 120–180 tok/s256K
IQ2_XXSquality drops2.5 GB≈ 3.3Runs well 170–255 tok/s256K

Click a row to choose a precision. “Maker’s file” sizes are the maker’s own files; others are parameters × bits per weight.

Compared with other hardware

Each at the highest precision it runs. Click one for details.

Smallest that runs it (Q4_K_M, 8K): GPU GeForce RTX 3080; unified memory Apple M5 · 16 GB.

Run commands

The maker publishes no files at this precision. Choose its native precision or one of its own builds, or quantise it yourself with llama.cpp.

Memory to fine-tune
Full≈ 159.5 GBDoesn’t fit your hardware
LoRA≈ 22.9 GBDoesn’t fit your hardware
QLoRA≈ 8.9 GBFits your hardware

Batch 1, 2,048-token sequences, gradient checkpointing; LoRA and QLoRA train rank-16 adapters on the attention projections.

Estimates; facts from the maker’s Hugging Face repositories, as of 2026-11-21. How it’s estimated

Cited scores

From third-party leaderboards, not measured by us

This model isn’t on any leaderboard we cite yet.

  1. New language model

Sources

Some values on this page are still waiting to be checked against official pages: a filled dot is verified, a hollow one is not yet (with or without a source on file). How we verify data

Tencent · China · tencent.com

Snapshots, the same family and other models from this provider