bge-base-en-v1.5

Embedding BAAI Partly verified
  • Open weights

Prices

0 offerings · prices as listed

No priced offering is listed for this model yet.

Details

Languages
1

Not stated on BAAI’s pages: shortest vector, vector types, inputs per request.

Run locally

Weights: BAAI/bge-base-en-v1.5
  • Parameters 0.1B
  • Dense
  • Native precision FP32
  • Layers 12
  • KV cache per token 36 KB
  • Config positions 512 (config.json max_position_embeddings)
My hardware GeForce RTX 4090 24 GB · 1008 GB/s · 64 GB DDR5 dual channel · 89.6 GB/s
On your hardware · GeForce RTX 4090
Runs well FP32 (native) (automatic) 512 context 1103–1655 tok/sOne GPU
WeightsKV cacheOverheadUsable
Needs
≈ 0.9 GB (weights 0.4 (maker’s file) + KV cache 0.0 + overhead 0.5)
Usable
21.6 GB (90% of its memory)
Generation speed
1103–1655 tok/s
Longest context
512 (the model’s limit)
First token
about 0.00–0.01 s for a 2K prompt
PrecisionWeightsNeeds at 512On your hardwareLongest context
FP32 (native)maker’s file0.4 GB≈ 0.9Runs well 1103–1655 tok/s512
Q8_00.1 GB≈ 0.6Runs well 3728–5592 tok/s512
FP80.1 GB≈ 0.6Runs well 3927–5890 tok/s512
Q6_K0.1 GB≈ 0.6Runs well 4633–6949 tok/s512
Q5_K_M0.1 GB≈ 0.6Runs well 5210–7814 tok/s512
Q5_00.1 GB≈ 0.6Runs well 5354–8030 tok/s512
Q4_K_M0.1 GB≈ 0.6Runs well 5903–8854 tok/s512
Q4_00.1 GB≈ 0.6Runs well 6264–9396 tok/s512
IQ4_XS0.1 GB≈ 0.6Runs well 6542–9813 tok/s512
Q3_K_Mquality drops0.0 GB≈ 0.6Runs well 6963–10444 tok/s512
IQ3_XXSquality drops0.0 GB≈ 0.6Runs well 8296–12444 tok/s512
Q2_Kquality drops0.0 GB≈ 0.6Runs well 8410–12615 tok/s512
IQ2_XXSquality drops0.0 GB≈ 0.5Runs well 10708–16062 tok/s512

Click a row to choose a precision. “Maker’s file” sizes are the maker’s own files; others are parameters × bits per weight.

Compared with other hardware

Each at the highest precision it runs. Click one for details.

Smallest that runs it (Q4_K_M, 8K): GPU GeForce RTX 3080; unified memory Apple M5 · 16 GB.

Run commands

vLLM
vllm serve BAAI/bge-base-en-v1.5 --max-model-len 512
Memory to fine-tune
Full≈ 2.4 GBFits your hardware
LoRA≈ 1.0 GBFits your hardware
QLoRA≈ 0.9 GBFits your hardware

Batch 1, 2,048-token sequences, gradient checkpointing; LoRA and QLoRA train rank-16 adapters on the attention projections.

Estimates; facts from the maker’s Hugging Face repositories, as of 2026-11-06. How it’s estimated

Cited scores

From third-party leaderboards, not measured by us

No cited leaderboard covers embedding models yet. MTEB’s results are open (CC0); we will cite them per benchmark, never as a combined score.

No changes recorded yet.

Sources

Some values on this page are still waiting to be checked against official pages: a filled dot is verified, a hollow one is not yet (with or without a source on file). How we verify data

BAAI · China · baai.ac.cn

Snapshots, the same family and other models from this provider