bge-small-en-v1.5

Embedding BAAI Partly verified
  • Open weights

Prices

0 offerings · prices as listed

No priced offering is listed for this model yet.

Details

Languages
1

Not stated on BAAI’s pages: shortest vector, vector types, inputs per request.

Run locally

Weights: BAAI/bge-small-en-v1.5
  • Parameters 0B
  • Dense
  • Native precision FP32
  • Layers 12
  • KV cache per token 18 KB
  • Config positions 512 (config.json max_position_embeddings)
My hardware GeForce RTX 4090 24 GB · 1008 GB/s · 64 GB DDR5 dual channel · 89.6 GB/s
On your hardware · GeForce RTX 4090
Runs well FP32 (native) (automatic) 512 context 3527–5290 tok/sOne GPU
WeightsKV cacheOverheadUsable
Needs
≈ 0.6 GB (weights 0.1 (maker’s file) + KV cache 0.0 + overhead 0.5)
Usable
21.6 GB (90% of its memory)
Generation speed
3527–5290 tok/s
Longest context
512 (the model’s limit)
First token
about 0.00–0.00 s for a 2K prompt
PrecisionWeightsNeeds at 512On your hardwareLongest context
FP32 (native)maker’s file0.1 GB≈ 0.6Runs well 3527–5290 tok/s512
Q8_00.0 GB≈ 0.5Runs well 11229–16844 tok/s512
FP80.0 GB≈ 0.5Runs well 11776–17665 tok/s512
Q6_K0.0 GB≈ 0.5Runs well 13683–20524 tok/s512
Q5_K_M0.0 GB≈ 0.5Runs well 15197–22795 tok/s512
Q5_00.0 GB≈ 0.5Runs well 15569–23353 tok/s512
Q4_K_M0.0 GB≈ 0.5Runs well 16968–25451 tok/s512
Q4_00.0 GB≈ 0.5Runs well 17871–26806 tok/s512
IQ4_XS0.0 GB≈ 0.5Runs well 18557–27835 tok/s512
Q3_K_Mquality drops0.0 GB≈ 0.5Runs well 19579–29368 tok/s512
IQ3_XXSquality drops0.0 GB≈ 0.5Runs well 22705–34058 tok/s512
Q2_Kquality drops0.0 GB≈ 0.5Runs well 22964–34446 tok/s512
IQ2_XXSquality drops0.0 GB≈ 0.5Runs well 27957–41936 tok/s512

Click a row to choose a precision. “Maker’s file” sizes are the maker’s own files; others are parameters × bits per weight.

Compared with other hardware

Each at the highest precision it runs. Click one for details.

Smallest that runs it (Q4_K_M, 8K): GPU GeForce RTX 3080; unified memory Apple M5 · 16 GB.

Run commands

vLLM
vllm serve BAAI/bge-small-en-v1.5 --max-model-len 512
Memory to fine-tune
Full≈ 1.3 GBFits your hardware
LoRA≈ 0.8 GBFits your hardware
QLoRA≈ 0.8 GBFits your hardware

Batch 1, 2,048-token sequences, gradient checkpointing; LoRA and QLoRA train rank-16 adapters on the attention projections.

Estimates; facts from the maker’s Hugging Face repositories, as of 2026-11-06. How it’s estimated

Cited scores

From third-party leaderboards, not measured by us

No cited leaderboard covers embedding models yet. MTEB’s results are open (CC0); we will cite them per benchmark, never as a combined score.

No changes recorded yet.

Sources

Some values on this page are still waiting to be checked against official pages: a filled dot is verified, a hollow one is not yet (with or without a source on file). How we verify data

BAAI · China · baai.ac.cn

Snapshots, the same family and other models from this provider