bge-large-en-v1.5

Embedding BAAI Partly verified
  • Open weights

Prices

0 offerings · prices as listed

No priced offering is listed for this model yet.

Run locally

Weights: BAAI/bge-large-en-v1.5
  • Parameters 0.3B
  • Dense
  • Native precision FP32
  • Layers 24
  • KV cache per token 96 KB
  • Config positions 512 (config.json max_position_embeddings)
My hardware GeForce RTX 4090 24 GB · 1008 GB/s · 64 GB DDR5 dual channel · 89.6 GB/s
On your hardware · GeForce RTX 4090
Runs well FP32 (native) (automatic) 512 context 362–544 tok/sOne GPU
WeightsKV cacheOverheadUsable
Needs
≈ 1.8 GB (weights 1.2 (maker’s file) + KV cache 0.0 + overhead 0.5)
Usable
21.6 GB (90% of its memory)
Generation speed
362–544 tok/s
Longest context
512 (the model’s limit)
First token
about 0.01–0.02 s for a 2K prompt
PrecisionWeightsNeeds at 512On your hardwareLongest context
FP32 (native)maker’s file1.2 GB≈ 1.8Runs well 362–544 tok/s512
Q8_00.3 GB≈ 0.9Runs well 1240–1860 tok/s512
FP80.3 GB≈ 0.9Runs well 1307–1961 tok/s512
Q6_K0.3 GB≈ 0.8Runs well 1548–2322 tok/s512
Q5_K_M0.2 GB≈ 0.8Runs well 1746–2619 tok/s512
Q5_00.2 GB≈ 0.8Runs well 1795–2693 tok/s512
Q4_K_M0.2 GB≈ 0.7Runs well 1985–2977 tok/s512
Q4_00.2 GB≈ 0.7Runs well 2110–3165 tok/s512
IQ4_XS0.2 GB≈ 0.7Runs well 2207–3310 tok/s512
Q3_K_Mquality drops0.2 GB≈ 0.7Runs well 2354–3531 tok/s512
IQ3_XXSquality drops0.1 GB≈ 0.7Runs well 2823–4235 tok/s512
Q2_Kquality drops0.1 GB≈ 0.7Runs well 2863–4295 tok/s512
IQ2_XXSquality drops0.1 GB≈ 0.6Runs well 3689–5533 tok/s512

Click a row to choose a precision. “Maker’s file” sizes are the maker’s own files; others are parameters × bits per weight.

Compared with other hardware

Each at the highest precision it runs. Click one for details.

Smallest that runs it (Q4_K_M, 8K): GPU GeForce RTX 3080; unified memory Apple M5 · 16 GB.

Run commands

vLLM
vllm serve BAAI/bge-large-en-v1.5 --max-model-len 512
Memory to fine-tune
Full≈ 5.9 GBFits your hardware
LoRA≈ 1.6 GBFits your hardware
QLoRA≈ 1.1 GBFits your hardware

Batch 1, 2,048-token sequences, gradient checkpointing; LoRA and QLoRA train rank-16 adapters on the attention projections.

Estimates; facts from the maker’s Hugging Face repositories, as of 2026-11-06. How it’s estimated

Cited scores

From third-party leaderboards, not measured by us

No cited leaderboard covers embedding models yet. MTEB’s results are open (CC0); we will cite them per benchmark, never as a combined score.

No changes recorded yet.

Sources

Some values on this page are still waiting to be checked against official pages: a filled dot is verified, a hollow one is not yet (with or without a source on file). How we verify data

BAAI · China · baai.ac.cn

Snapshots, the same family and other models from this provider