Sarvam-1
2 builds of Sarvam-1 measured on real machines — different packagers, precisions and engines, each a different file with its own numbers. The best each engine proved is first; every build has its own page with the machines and signatures behind it. 2B parameters, as the vendor states.
on ollama · 1 build
proved 8K context proved by bartowski Q4_K_M
178.2 tok/s peak, by bartowski Q4_K_M
on vllm · 1 build
no context proved on this engine yet
proved by at least one build: Structured output · Sustained output · Follows instructions
| build | publisher | precision | engine | whose work | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|---|
| hf.co/bartowski/sarvam-1-GGUF:Q4_K_M | bartowski | Q4_K_M | ollama | quantizer | 8,192 | 178.2 | 5 |
| sarvamai/sarvam-1 | sarvamai | BF16 | vllm | vendor | — | — | 1 |